[Invited Talk] The Synergy Between Large Scale Learning and Statistical Physics: the Importance of Multidisciplinary Education
- Topic : [Invited Talk] The Synergy Between Large Scale Learning and Statistical Physics: the Importance of Multidisciplinary Education
- Speaker: Prof. Naftali Tishby, Hebrew University of Jerusalem, Israel
- Date: Friday, December 1st, 2017
- Time: 2:30 pm-3:30 pm
- Venue: R105, E.E. Building No. 2 , NTU 臺灣大學 電機二館 105
Abstract
Large scale machine learning, as in Deep Neural Networks, is not described well by worse case generalization bounds, as given by the PAC theory. It emphasizes the needs in understating typical learning theory of the type given by statistical mechanics and information theory. Statistical mechanics and the theory of stochastic dynamics are also the tools needed to understand the behavior of learning algorithms and optimization computational complexity in such machines. These example demonstrate the benefits of multidisciplinary education and why ML students should learn more physics and engineering to stay in the frontier of their field.
Biography
Dr. Naftali Tishby is a professor of Computer Science, and the incumbent of the Ruth and Stan Flinkman Chair for Brain Research at the Edmond and Lilly Safra Center for Brain Science (ElSC) at the Hebrew University of Jerusalem.