The other points I especially liked from the audience:
- Connecting unsupervised scientific simulation via interpretability to existing surrogate models methods in physics
- Bottleneck autoencoder or compression paradigms for video representations instead of sparse coder paradigms (some video representations seem to suffer from overly high-dimensionality and not superposition!)