Jacob Steinhardt recently posted a blog post discussing the potential for emergent behaviors in modern machine learning systems. He argues that with enough scale, a deep learning model can acquire qualitatively different behaviors, and that some of these emergent behaviors can be predicted. Steinhardt also suggests that ML researchers should write broader impacts statements to prospectively name the potential harms their work poses to society.
