#82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]

Machine Learning Street Talk (MLST)

AI Helps Ukraine - Charity Conference

A charity conference on AI to raise funds for medical and humanitarian aid for Ukraine

https://aihelpsukraine.cc/

YT version: https://youtu.be/LgwjcqhkOA4

Support us!

https://www.patreon.com/mlst

Dr. Joscha Bach (born 1973 in Weimar, Germany) is a German artificial intelligence researcher and cognitive scientist focusing on cognitive architectures, mental representation, emotion, social modelling, and multi-agent systems.

http://bach.ai/

https://twitter.com/plinz

TOC:

[00:00:00] Ukraine Charity Conference and NeurIPS 2022

[00:03:40] Theory of computation, Godel, Penrose

[00:11:44] Modelling physical reality

[00:15:19] Is our universe infinite?

[00:24:30] Large language models, and on DL / is Gary Marcus hitting a wall?

[00:45:17] Generative models / Codex / Language of thought

[00:58:46] Consciousness (with Friston references)

References:

Am I Self-Conscious? (Or Does Self-Organization Entail Self-Consciousness?) [Friston]

https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00579/full

Impact of Pretraining Term Frequencies on Few-Shot Reasoning [Yasaman Razeghi]

https://arxiv.org/abs/2202.07206

Deep Learning Is Hitting a Wall [Gary Marcus]

https://nautil.us/deep-learning-is-hitting-a-wall-238440/

Turing machines

https://en.wikipedia.org/wiki/Turing_machine

Lambda Calculus

https://en.wikipedia.org/wiki/Lambda_calculus

Godel's incompletness theorem

https://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems

Oracle machine

https://en.wikipedia.org/wiki/Oracle_machine