Humbling? That’s going on in my head. I’m that complicated! Or at least the “hardware” I run on is. I think having a brain that beautifully complex is more empowering than anything! I wonder what new discoveries will stem from this.
Super humbling because nature's complexity can provide data storage and retrieval capacity several orders or magnitude greater than the best we can do right now.
Also super exciting because look at what every brain on the planet is composed of, and how it functions, in a freakin' square millimeter!
That's because ChatGPT and the likes use machine learning to calculate odds of word combinations that make up a plausible sentence in a given context. There are scientific studies that postulate we'll never have enough data to train those models properly, not to mention exponential energy consumption required. But this is not the only application of this technology.
Noam Chomsky said “we don’t know what happens when you cram 10^5 neurons* into a space the size of a basketball” - but what little we know is astonishing & a marvel
The article isn't about automatic proofs, but it'd be interesting to see a LLM that can write formal proofs in Coq/Lean/whatever and call external computer algebra systems like SageMath or Mathematica.
I was thinking something similar: If you have the computer write in a formal language, designed in such a way that it is impossible to make an incorrect statement, I guess it could be possible to get somewhere with this
nature.com
Top