US ATLAS HL-LHC computing discussion

[Rui Zhang <rui.zhang AT cern.ch>]

Hi Amir, all,

If you are interested in, here is the reference for the idea of increasing 
learning rate while batch size is increased.

https://urldefense.proofpoint.com/v2/url?u=https-3A__arxiv.org_pdf_1706.02677.pdf&d=DwIFaQ&c=aTOVZmpUfPKZuaG9NO7J7Mh6imZbfhL47t9CpZ-pCOw&r=kuw27yCoJcWC7ZtdzaOk6YTOqz34dAcCjbRUwHbfVaASKm_7EhSsx7N1g0W2U9uR&m=dXy7mdn-3kqcyKn7iy3gcaOjpfCPn2S_yFRJTfb9f8c&s=QPK_HWnKxtKlU7eI4LYNh730O_JOtDV0AIjbT1gQflM&e=
 
(Linear scaling rule on page 2)

Cheers,
Rui

> On 10. Sep 2019, at 18:08, Rui Zhang <rui.zhang AT cern.ch> wrote:
> 
> My slides.
> 
> <Distributed20190910.pdf>
> 
>> On 30. Aug 2019, at 23:19, Rui Zhang <rui.zhang AT cern.ch> wrote:
>> 
>> Dear Abid,
>> 
>> Thanks for the doc and mailing list. I am also happy to present my 
>> preliminary studies with Summit in the next meeting.
>> 
>> Cheers,
>> Rui
>> 
>> 
>>> On 30. Aug 2019, at 23:05, Malik,Abid <amalik AT bnl.gov> wrote:
>>> 
>>> Dear Rui,
>>> 
>>> Thank you for your interest.  Our next meeting is on Sept 9th at 12:00 PM 
>>> EST. Necessary information is on the google doc
>>> 
>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1w5CXzODmv5Z9HoEpmORTi8-2Dsh6vChkLX4KCajCoFX-2Ds_edit-23heading-3Dh.lsmlha7nuv1h&d=DwIFaQ&c=aTOVZmpUfPKZuaG9NO7J7Mh6imZbfhL47t9CpZ-pCOw&r=kuw27yCoJcWC7ZtdzaOk6YTOqz34dAcCjbRUwHbfVaASKm_7EhSsx7N1g0W2U9uR&m=dXy7mdn-3kqcyKn7iy3gcaOjpfCPn2S_yFRJTfb9f8c&s=hs7YAsZ4fPB9B43gLsLUs5c40YcoPy2LZvUWWDSon-w&e=
>>>  
>>> 
>>> Are you in the us-atlas mailing list? 
>>> "usatlas-hllhc-computing-l AT lists.bnl.gov"
>>> 
>>> Would you be interested in talking about your work at the next meeting? 
>>> 
>>> 
>>> Thanks,
>>> Abid M. Malik
>>> Computational Science Initiative (CSI)
>>> Bld-725, 2-183
>>> Phone#6313444657
>>> 
>>> ________________________________________
>>> From: Rui Zhang <rui.zhang AT cern.ch>
>>> Sent: Friday, August 30, 2019 2:27 PM
>>> To: Malik,Abid
>>> Subject: US Distributed ML
>>> 
>>> Dear Abid,
>>> 
>>> I am working on ML at HPC at the University of Wisconsin. I am contacting 
>>> you to join the effort of the Distributed ML group. I am happy to join 
>>> the biweekly meeting. Can you please point me out the indico page and the 
>>> mailing list to which your announcement goes?
>>> 
>>> Best regards,
>>> Rui
>>> 
>>> On 30. Aug 2019, at 18:00, Paolo Calafiura 
>>> <pcalafiura AT lbl.gov<mailto:pcalafiura AT lbl.gov>> wrote:
>>> 
>>> Dear Sau Lan,
>>> In the US we have an active Distributed ML group that meets every other 
>>> Tuesday (last meeting was four days ago). May I suggest that Rui reaches 
>>> out to the group convenor Abid Malik 
>>> amalik AT bnl.gov<mailto:amalik AT bnl.gov> to coordinate their work?
>>> Paolo
>>> 
>>> #revised & corrected by your friendly AI#
>>> 
>>> 
>>> On Thu, Aug 29, 2019, 10:49 PM Sau Lan Wu 
>>> <Sau.Lan.Wu AT cern.ch<mailto:Sau.Lan.Wu AT cern.ch>> wrote:
>>> Dear Torre, Heather, Kaushik and Paolo,
>>> 
>>> Rui has been working in my group for two months. Since he got his Oak
>>> Ridge HPC account end of July, he has made quite some progress. He worked
>>> on setting up Machine Learning routing for an analysis on the HPC. He did
>>> some studies of accelerating the training using GPU, made some
>>> comparisons of different ML packages, and tried out distributed training
>>> strategy. In the upcoming ATLAS S&C week at the end of September, he
>>> should have enough material to give a talk on the topic of “Machine
>>> Learning on HPC”, which could be a 15-20min talk. Let me know if that is
>>> a good idea.
>>> 
>>> With best regards,
>>> Sau Lan
>>> 
>>> --
>>> ---------------------------------
>>> Sau Lan Wu   (Sau.Lan.Wu AT cern.ch<mailto:Sau.Lan.Wu AT cern.ch>)
>>> Enrico Fermi Professor of Physics
>>> Vilas Professor
>>> University of Wisconsin/Madison
>>> http://wisconsin.cern.ch/slw/
>>> ---------------------------------
>>> CERN, PH Dept., Bldg 32, R-A05
>>> CH-1211 Geneva 23, Switzerland
>>> Office Phone:  [41] 22 767 7171
>>> Swiss Mobile:  [41] 75 411 4443
>>> US Mobile:     [1] 510 484 8832
>>> E-Fax:         [1] 650 618 1618
>>> Skype:         saulan.wu
>>> ---------------------------------
>>> 
>>> 
>>> 
>>> 
>>> 
>> 
>