Deep Learning and Optimization Seminar

Organizing Committee:

Contact & Discussion: You are welcome to join our Google group and our Slack.

Coming Up

Date (yyyy-mm-dd hh:mm) Presenter Topic or Paper Materials
2023-?-? 16:30-17:30 (BJT) Anastasia Koloskova ? paper1, paper2.

Past Events

Date Presenter Topic or Paper Materials
2023-07-20 10:00-11:00 (BJT) Libin Zhu, UCSD Spikes in the training loss of SGD, catapults and feature learning abstract, slides, video.
2023-07-17 16:00-17:00 Fanghui Liu, EPFL The role of over-parameterization in machine learning - a function space perspective abstract, slides, video.
2023-07-11 19:00-20:00 Tongtian Zhu, ZJU Decentralize to Generalize? On the Asymptotic Equivalence of Decentralized SGD and Average-direction SAM abstract, slides, video, paper.
2023-06-28 16:00-17:00 Francesco Croce, University of Tübingen How to Quickly Obtain Models Robust to Multiple and Different Threats, and Their Advantages abstract, video.
2023-06-19 15:00-16:00 Binhang Yuan, HKUST Accommodating LLM Training over Decentralized Computational Resources abstract, slides, video.
2023-06-07 19:00-20:00 Bohang Zhang, Peking University Rethinking the expressive power of gnns via graph biconnectivity abstract, slides, video, paper.
2023-05-31 15:30-16:30 Jiaxin Shi, Google Deepmind Sequence Modeling with Multiresolution Convolutional Memory abstract, paper.
2023-04-28 09:00-10:00 Ziming Liu, MIT Physics of deep learning: Understanding grokking via the lens of physics abstract, slides.
2023-04-24 19:30-20:30 Dingfan Chen, CISPA Privacy-preserving Generative Modeling abstract, slides.
2023-04-21 16:00-17:00 Jialin Liu,
DAMO Academy (US)
Towards Constituting Mathematical Structures for Learning to Optimize abstract, slides, paper.
2023-04-12 17:00-18:00 Maksym Andriushchenko, EPFL SGD with large step sizes learns sparse features abstract, video, paper.
2022-12-01 16:00-17:30 Ligeng Zhu, MIT Algorithm-System Co-Design for TinyML. abstract, paper, slides, website, demo, code.