Ilya Sutskever - The unreasonable effectiveness of large generative models

Abstract

GPT3 has shown that large generative models are unexpectedly powerful and capable. In this talk, I will review some of these capabilities, discuss the possible causes for their emergence, and highlight limitations and unresolved problems.