Episode 05: Katja Schwarz, MPI-IS, on GANs, implicit functions, and 3D scene understanding

Katja Schwartz came to machine learning from physics, and is now working on 3D geometric scene understanding at the Max Planck Institute for Intelligent Systems. Her most recent work, “Generative Radiance Fields for 3D-Aware Image Synthesis,” revealed that radiance fields are a powerful representation for generative image synthesis, leading to 3D consistent models that render with high fidelity. We discuss the ideas in Katja’s work and more: 🥦 the role 3D generation plays in conceptual understanding 📝 tons of practical tips on GAN training 〰 continuous functions as representations for 3D objects