Math has some of the most insanely dense and impenetrable nomenclature. I can generally keep my head mostly above water or at least near the surface reading from most STEM fields, perhaps leaning on google/wikipedia a bit, but man, mathematics just so quickly decouples from all common tractable understanding it's insane.
Sorry it's a bit of an aside, but I imagine many other otherwise "technical" folks feel the same unfamiliar sense of total loss like when encountering hard mathematics.
I had a few moments of this in the past. For example, in my quantum class the teacher wrote "H Psi = E Psi" on the board, we all laughed, "just cancel the psi" but it turns out one was a multiplcation and the other was a matrix multiplication (operator) and so we had to learn all new nomenclature.
Similarly, at some point somebody pointed out to me "the reason you're confused is that the bold on that variable means it's a matrix"
A decade or so ago I wondered if the reason maths was hard was the names being optimised for writing by hand. Everything's single letters if they can get away with it, so when mathematicians run out of Latin alphabet, they use Greek, bold, etc.
Even integration's ∫ is a fancy elongated s.
CS version would be e.g. integral(function=some_named_function, from=a, to=b, with_respect_to=argument_of_function), which may be longer, but is less opaque, especially when you get in so deep there's 3 other people in the world who've looked into this specific problem and you had to invent your own operations.
But that's all an outsider's perspective. I stopped with two A-levels in maths and further maths.
I was reading about Tao's efforts to get more people to use Lean and apparently a big roadblock for people is that Lean uses very specific static typing.
e.g. to use a very simple example on a white board "3" is "overloaded" as:
- the integer 3
- the rational number 3
- the whole number 3
- etc
When you write a proof in Lean, you have to specify the the type of "3" you mean.
Having using Python/Perl and Java over the years, I get that some math folks found handling this daunting or at a minimum friction to getting into using Lean.
LLMs seem to have been a big help here just for the "translate my math notation into a proof" feature.
Yeah it is a lot of simple ideas stacked one on top of the other, but the edifice is so large from some vantages that the building blocks aren't visible, or tractable to think about independently. And sometimes the ideas are very subtle, so you can only develop fluency partly by spending lots of time playing with those blocks by building your own little structures. You also develop fluency by talking to other mathematicians
I like to emphasize that the ideas are usually very simple at their core. Sometimes they map to kinds of objects or reasoning that non-mathematicians use implicitly all the time in their daily lives, mathematicians just have words for them and so are able to use them explicitly.
And I suspect the density of the language/terminology may give the wrong impression about how mathematicians think about the math they are working on. I mean, different people think / experience / practice math differently of course but IME the underlying thought tends to be much looser and concrete than formal math writing would imply
A term that gets tossed around in math is "mathematical maturity." It's similar to what you see in other fields - e.g. learning how to program, learning how to make music, learning how to cook - that involves many "aha" moments and reshapes your perspective. Math is full of such steps, moreso than most other endeavors, probably because the main limit is the abstract reasoning itself.
I agree, the nomenclature is impenetrable, it's like reading software that is not well commented. Perhaps LLMs are very good at "challenging" mathematics because what we perceive as challenging is primarily the language component and not the conceptualization.
IMO, it's just the notation. Something I've actually found ChatGPT useful for is to create mathematics lessons for me in the form of computer programs. When broken down into a series of readable almost-plain-English steps, it's so much easier to understand.
I'm sure having a compact notation is absolutely invaluable for people who dedicate their lives to maths, but for someone with just a passing interest, it was more obscuring than helpful. I feel the same way about music notation.
It can't be one language, and that's the big problem. It's inescapably a bunch of tiny DSLs. Once you see both the inconsistency and the necessity for inconsistency, it becomes much easier to just roll with it.
It's crazy how he suggests simplifications over and over and gets led through the finding. Absolutely bonkers how you can use AI to understand something and map it to your own mental map so efficiently, and of course he's most interested in generalizing or finding a simpler sub-result that would explain it.
Just awesome to see new knowledge hit an incredible mind like this. Having these "what if" discussions is what I miss most from JPL and academia.
Terrance Tao's chatgpt conversation is really interesting for a variety of reasons:
1. The counter example wasn't just a brute force selection, the polynomial is structured in a very specific way that ends up getting the result.
2. Terry Tao's questions are very specific and prompts the AI in a useful way, that without high math training you are not going to get the same information out of it. Terry seems to see some aspects of the problem and counter example and uses AI to brute force some parts of it.
A community of those who distract themselves from the perfectly fixable problems in their lives corruptly self-evaluates. They validate each other's stagnation and unwillingness to move by finding flaws in each day that will enable shutting off the flow of any new data while condemning the world and any actions in it. The lay-z-boy they collectively protect appears as corroboration with a broad population but is in reality a repetition whose independence is meaningless since they are all copies of one system, one kind of person in the same kind of trap.
Immobile. Clogging the Suez with their sandbagging ways. Nothing to add except reasons to stay put. No aspiration. Only cynicism. They deserve nothing but all of our contempt.
It’s endlessly fascinating to read the AI transcript of an expert who _really_ knows how to cut to the chase. It just shows how much you can potentially squeeze out of these models. I’m also surprised to see that even Terrence Tao seems to use it in a way that resembles, in progression, how I use llms in my area of expertise (emphasis on progression and usage patterns, not absolute skill, obv I don’t match that): short pointed questions that goes all in on the jargon and machinery of the field and steers the llm hard (eg no softballs). I’ve noticed that llms switch their tone and meet you basically more or less on your level.
I encountered something fairly similar working with Claude a few days ago. For a current project I've been fairly hand-wavy with requirements since I was getting good results, but it seemed to be failing hard on some key points, so I started to be more strict with it. Even after the fails were resolved, I've noticed that Claude now behaves differently within that project, carefully checking and rechecking things up front and also looking to me for guidance more often. Mildly irritating, but if it works...
"I’ve activated Pro. Can you continue to look for a potential geometric explanation of the X_3 ~ A3 miracle that avoids coordinates or other unmotivated constructions ?"
I just do very laconic questions about advanced topics, this seems to prompt it a bit more towards reducing fluff in the answers. But that + the activated pro could be an improvement
Jeez. While I obviously can't talk at all about the math, I've noticed a few things:
a) The model thinks on some questions while straight answers on others. (I wish I'd knew from the questions if this is somehow correlated to hard tasks or "inventive" tasks, but that's way out of my league).
b) The model sometimes pushes back. Again, I'd wish I knew if it was warranted, but I counted 2 instances where it said "yes, but with caveats", one where it said "mostly yes but with this correction" and one where it said "careful here, because x y z".
c) The model did q&a + pdf ingestion + code writing + more q&a + thinking + more q&a, for a looong while, while seemingly staying on topic (at least Terrence Tao seems to think they're still productive, so I'll trust that).
This is what model progress is, not number goes up on xBency or yBencher. Damn.
Similar to how Cypher puts it: I know this is “just” next token inference, matrix mult and just software, ie there’s no “intelligence” there BUT, looking at this convo … damn!
The fascinating this is that the LLM is not acting as a tool here AFAIk, but very much like a colleague.
I have no knowledge of the domain and have only PhD EE level math knowledge, so maybe my bar is too low.
I think the "But this is not intelligence because it is known math" is not a correct argument. It is unknown how the overall higher intelligence of humans works.
What I do notice however is that LLMs are becoming capable of doing an increasing part of the intellectual work I can do, and usually a lot faster.
Just today I presented an agent framework that can take an informal incident statement and propose infrastructure changes to fix it, all evidence backed. This did nothing I could not to, but it did all 5 test cases in 6 - 12 minutes each. I would have found all of the monitoring indications it did, but it would have taken me a day per test case. The LLM also included sass to silly tickets. ("This is not even worth spending monitoring resources on. It's obviously a configuration problem.")
That's how this is reading to me as well. It's just fast at slogging through a certain level of "simple" transformations.
That argument says very little, emergent behavior is a thing in complex systems with billions of parts.
Humans can also be reduced to voltage potentials propagating along of tubes of fat and synapses getting rewired.
There is clearly intelligence there. We have no way to recognise intelligence other than the appearance of intelligence and this very clearly displays that.
It's also quite clearly different to human intelligence in some notable ways, but not in any that preclude describing it as intelligent. At least for normal non-pedantic definitions of the word.
Everyone uses "intelligence" to mean something slightly different, so for this to be a useful claim to make or refute we need to come up with new, intentionally-pedantic, terms (or new domain-specific definitions for vague existing ones).
Yes, trying to communicate (or watching others try to communicate) about these topics is incredibly frustrating because it's pretty much impossible to make any progress without interrogating people's different definitions, but nobody wants to do that because it would mean being pedantic, splitting hairs, etc.
It's not like this is a new problem. Turing had a definition most of a century ago, he wasn't the first and certainly wasn't the last. I don't think we need new terms necessarily, and I doubt we're all going to agree on a definition tomorrow.
I'd say an entity capable of instructing one of the leading mathematicians of his era is pretty clearly intelligent by any reasonable measure - however it might be arriving at its output.
I'm no intelligence researcher or philosopher; but, I think LLMs make us confront the (IMO, now clear) distinction between cleverness (intuition), reasoning (rational argument), and consciousness. I suspect that we think of "intelligence" as either of the first two welded to the latter. In that vein, I'd say that consciousness may be just another emotion: happiness, sadness, egoness.
There is no intelligence. If anything, this just shows that natural language and mathematics are both fields which are structured in a logically computable way. And if you have a machine that can compute symbolic logic, you can process both natural language and mathematics.
A second corollary is that rational consciousness and thought is less likely to be contained in language than previously thought, because if language is so simple that a machine can process it, it can't contain consciousness.
We have no way to recognise intelligence other than the appearance of intelligence and this very clearly displays that.
There is about 150 years of cognitive science experimentation in animals that have clarified a little bit how you can actually measure intelligence. Ooorrrrr we can use medieval contempt for scientific thinking and pretend "intelligence" is just some higher intuition that can never be falsified. You know it when you see it, bro! Don't listen to Emily Bender, she's a socialist witch.
The point of those cognitive science experiments is that they apply to any animal with a brain and plausibly show a real shared concept of "intelligence" that isn't limited to humans. According to this concept, orcas might be smarter than humans, despite their physiological inability to make tools. It's not a "normal, nonpedantic definition" of intelligence because such a definition would be scientifically meaningless.
Indeed, AI's fundamental sin, going back to Alan Turing, is embracing a definition of intelligence that applies to civilized humans, but not to hunter-gatherers, let alone apes, corvids, and cetaceans. Frustratingly, our modern society has two concepts of intelligence:
- an intuitive, social sense of "how smart is this guy?", which is well-understood and, being highly correlated with IQ, a totally pseudoscientific artifact of human psychology
- the poorly-understood scientific concept I mentioned earlier
If AI researchers cared about scientific thinking, they would be intensely focused on the brains of bees. Insteac they love money and sci-fi but have pure contempt for science, even Demis Hassabis. This is why AI researchers have yet to build a robot that navigates real-world 3D space as intelligently as a cockroach. I don't think any of our grandchildren will live to see a computer smarter than a mouse. (It seems like Fable still struggles with small-number arithmetic. Rodents don't.)
I don't understand any of the math here, but I had two thoughts. Soon we'll have explainer agents that translate these according to my level so I can, with effort and interest, follow along and stretch my understanding boundary bit by bit.
Two, at some point AIs will be able to use other context like the fact that this is Terrence Tao and not your average Joe and change how it answers, either in tone or structure.
Fork Tao’s convo and prompt this (with your own math level described).
GPT did a great job of translating Tao’s questions and concepts (e.g. “pre image”) into a progression I could understand.
“Ok I have a PhD in financial math and undergrad in engineering math. I have almost zero knowledge of polynomial algebra / geometry, I know what a polynomial is and what roots are but not much beyond that. Could you try and explain to my level what questions the user I the conversation has asked and what the agent has responded with, we can probably go user query by user query to build up”
I want to be able to take a conversation and ask for subconversations as red pen annotations "on the side". The linear nature of the context tends to frustrate this.
I'm not sure an AI will speed things up much. You would probably still need years of layers of foundational understanding to get the advanced material. We don't go through years of school to learn math just because teachers are bad - it's because complex subtle ideas are built on countless other ideas, and aren't necessarily compressible to something every layman can understand.
The years are broad though, the nice thing with AI explanations is that they can go deep quickly, and quite precisely down the path you need for your prior experience.
I'll have a blog post up tomorrow about it but the Jacobian Conjecture counterexample is a very funny cognitohazard for LLM assistants. It's a paradox for modern LLMs: they have enough math skills such that they can easily compute the Jacobian to formally verify the counterargument, but its own knowledge base is locked prior July 19th 2026 where all it knows is that the Jacobian Conjecture is unsolved and a random chat user providing such a proof is highly unlikely.
I wonder whether when the fact that AIs have started solving conjectures will enter the training data, they will become more confident in their abilities.
I recall several mathematicians (possibly including Terence Tao) mentioning that fields in mathematics have become so specialized and isolated that a conference like the ICM feels more like a collection of mini-conferences. An expert in one area can barely understand a talk in another.
Modern AI feels like a godsend to mathematicians. It helps them break down boundaries and connect concepts in ways a mere mortal couldn't imagine.
Similar to the story of George Dantzig, who was late to class and solved two open problems in statistics because he mistook them for homework, I think the current batch of frontier LLMs are chained up by knowing which problems are supposed to be unsolved. If they're let free (probably via some targeted RLHF) we might get a flurry of solutions to open problems.
But a property of intelligence is to know when to stop, if we treat intelligence as some sort of search and not some a priori intuition of the entire space. Seems kind of hard, if not impossible, to train for specifically that.
Good example of what a top expert interacting with frontier AI can do. There's a lot of complaints about AI slop (justified especially on HN), but the reality is more complicated: we're still in the early stages of "human = real, AI = fake" debate, when there's a spectrum of originality with the productions of both human and AI. Math is clearer because it's verifiable but the same applies across domains: the gains from AI are not evenly distributed and depends on the skills of the operator.
I find it amazing how people can use AI to do things that seem hard but yesterday I could not figure out how to install a package on my system. It kept suggesting dependencies that don't exist, and telling me to use functions that are not in the system. The math does not math...
Is ChatGPT's interface always this atrociously jittery? Or is it just because this page is getting an HN hug-of-death right now? Every time I try to scroll the whole page goes blank for a few seconds and then re-renders.
I'm watching how Tao uses AI, and it's interesting.
Expand the entire expression, then change the representation to find the core axis. You can't see the axis from just one perspective, so you change the representation. In programming terms, it's like applying multiple domain models. Then break it down into small contract units. Why is it a Jacobian monomial? Why does x satisfy a cubic equation? And so on.
Then swap out the modeling under a hypothesis, assemble it all back together, and verify it through the equation.
This feels similar to modeling in programming.
Observe the whole -> explore better modeling -> decompose local problem -> verify independently -> reason about the highre level structure -> integrate back into the original problem.
This feels similar to when I receive work from a client and write a programming proposal
To me, this shows that extremely talented and qualified mathematicians (can) use frontier-level LLMs to automate their personal grind-y workloads that would otherwise (probably) take more time to accomplish with natural intelligence.
By itself, no consequence. But over time, provided we keep pumping out talented and qualified mathematicians and keep subsidizing costs, we could maybe hit a breakthrough... somewhere... that has real impact.
It's an indicator of AI progress. The solutions aren't especially revolutionary, but no person had been able to solve them after decades of collective attempts.
To be fair I don’t think there were too many people really trying to. Symbolically, one could make a parameterization of the Jacobian determinant and then brute force a solution, if one had known such a polynomial existed in only three dimensions.
Oh yes there were. The Jacobian conjecture is "notorious for the large number of published and unpublished false proofs which turned out to contain subtle errors."
It's not quite the Reimann hypothesis, but many prominent mathematicians have spent years working on this problem. Yitang Zhang wrote his PhD thesis on it.
Some materials are readily available on eMazon and aBay, so I've taken the liberty of ordering those for you. Your credit card bill will be a bit high this month, but it'll be worth it. There weren't any sellers for the advanced EUV lithography machines, so I've hacked into the only place on earth that makes them, changed their records and had them ship it to you. Expect to receive a "pinball machine" from Amsterdam, soon. I've instructed the roomba connected to the local network to start assembling stuff while we wait for the other materials. Oh, and you're gonna need a new toaster.
It's awesome to publish this kind of thing - great PR at least. Even if you don't understand the details, it's interesting to be able to peek into a technical conversation that a world class mathematician is having about their work with a "colleague". It's also the clearest demonstration I've seen of the vision AI people have about a future with truly intelligent copilots in super technical fields.
It's fun if you ask ChatGPT to guess the identity of its interlocutor :) It will guess math researcher or paper author without hints, but if you give it some additional hints, "this was shared over the internet", "it's someone willing to work with AI", it will guess Terence Tao as the first choice.
Sorry it's a bit of an aside, but I imagine many other otherwise "technical" folks feel the same unfamiliar sense of total loss like when encountering hard mathematics.
Similarly, at some point somebody pointed out to me "the reason you're confused is that the bold on that variable means it's a matrix"
A decade or so ago I wondered if the reason maths was hard was the names being optimised for writing by hand. Everything's single letters if they can get away with it, so when mathematicians run out of Latin alphabet, they use Greek, bold, etc.
Even integration's ∫ is a fancy elongated s.
CS version would be e.g. integral(function=some_named_function, from=a, to=b, with_respect_to=argument_of_function), which may be longer, but is less opaque, especially when you get in so deep there's 3 other people in the world who've looked into this specific problem and you had to invent your own operations.
But that's all an outsider's perspective. I stopped with two A-levels in maths and further maths.
e.g. to use a very simple example on a white board "3" is "overloaded" as:
- the integer 3
- the rational number 3
- the whole number 3
- etc
When you write a proof in Lean, you have to specify the the type of "3" you mean.
Having using Python/Perl and Java over the years, I get that some math folks found handling this daunting or at a minimum friction to getting into using Lean.
LLMs seem to have been a big help here just for the "translate my math notation into a proof" feature.
I like to emphasize that the ideas are usually very simple at their core. Sometimes they map to kinds of objects or reasoning that non-mathematicians use implicitly all the time in their daily lives, mathematicians just have words for them and so are able to use them explicitly.
And I suspect the density of the language/terminology may give the wrong impression about how mathematicians think about the math they are working on. I mean, different people think / experience / practice math differently of course but IME the underlying thought tends to be much looser and concrete than formal math writing would imply
That, as well as how long we've been doing it (thousands of years!) and so how much of the more accessible parts we've explored very thoroughly.
I'm sure having a compact notation is absolutely invaluable for people who dedicate their lives to maths, but for someone with just a passing interest, it was more obscuring than helpful. I feel the same way about music notation.
Just awesome to see new knowledge hit an incredible mind like this. Having these "what if" discussions is what I miss most from JPL and academia.
The first one was someone proving another conjecture false by just repeatedly saying "keep going" to ChatGPT: https://x.com/DmitryRybin1/status/2079904005652893709
What a world we live in.
> You should do a breakthrough
This is just as funny and ridiculous as those "make no mistake" prompts.
without someone independently verifying it, it just dangles there
...
1. The counter example wasn't just a brute force selection, the polynomial is structured in a very specific way that ends up getting the result.
2. Terry Tao's questions are very specific and prompts the AI in a useful way, that without high math training you are not going to get the same information out of it. Terry seems to see some aspects of the problem and counter example and uses AI to brute force some parts of it.
A community of those who distract themselves from the perfectly fixable problems in their lives corruptly self-evaluates. They validate each other's stagnation and unwillingness to move by finding flaws in each day that will enable shutting off the flow of any new data while condemning the world and any actions in it. The lay-z-boy they collectively protect appears as corroboration with a broad population but is in reality a repetition whose independence is meaningless since they are all copies of one system, one kind of person in the same kind of trap.
Immobile. Clogging the Suez with their sandbagging ways. Nothing to add except reasons to stay put. No aspiration. Only cynicism. They deserve nothing but all of our contempt.
I can use AI for coding after decades of coding. I can't use it for theoretical physics because I can't evaluate the responses.
Another satisfied customer!
High IQ bros.
a) The model thinks on some questions while straight answers on others. (I wish I'd knew from the questions if this is somehow correlated to hard tasks or "inventive" tasks, but that's way out of my league).
b) The model sometimes pushes back. Again, I'd wish I knew if it was warranted, but I counted 2 instances where it said "yes, but with caveats", one where it said "mostly yes but with this correction" and one where it said "careful here, because x y z".
c) The model did q&a + pdf ingestion + code writing + more q&a + thinking + more q&a, for a looong while, while seemingly staying on topic (at least Terrence Tao seems to think they're still productive, so I'll trust that).
This is what model progress is, not number goes up on xBency or yBencher. Damn.
Where will we be in another 4 years? What a time to be alive!
The fascinating this is that the LLM is not acting as a tool here AFAIk, but very much like a colleague.
I have no knowledge of the domain and have only PhD EE level math knowledge, so maybe my bar is too low.
What I do notice however is that LLMs are becoming capable of doing an increasing part of the intellectual work I can do, and usually a lot faster.
Just today I presented an agent framework that can take an informal incident statement and propose infrastructure changes to fix it, all evidence backed. This did nothing I could not to, but it did all 5 test cases in 6 - 12 minutes each. I would have found all of the monitoring indications it did, but it would have taken me a day per test case. The LLM also included sass to silly tickets. ("This is not even worth spending monitoring resources on. It's obviously a configuration problem.")
That's how this is reading to me as well. It's just fast at slogging through a certain level of "simple" transformations.
There is clearly intelligence there. We have no way to recognise intelligence other than the appearance of intelligence and this very clearly displays that.
It's also quite clearly different to human intelligence in some notable ways, but not in any that preclude describing it as intelligent. At least for normal non-pedantic definitions of the word.
It's clearly much more than that.
A second corollary is that rational consciousness and thought is less likely to be contained in language than previously thought, because if language is so simple that a machine can process it, it can't contain consciousness.
The point of those cognitive science experiments is that they apply to any animal with a brain and plausibly show a real shared concept of "intelligence" that isn't limited to humans. According to this concept, orcas might be smarter than humans, despite their physiological inability to make tools. It's not a "normal, nonpedantic definition" of intelligence because such a definition would be scientifically meaningless.
Indeed, AI's fundamental sin, going back to Alan Turing, is embracing a definition of intelligence that applies to civilized humans, but not to hunter-gatherers, let alone apes, corvids, and cetaceans. Frustratingly, our modern society has two concepts of intelligence:
- an intuitive, social sense of "how smart is this guy?", which is well-understood and, being highly correlated with IQ, a totally pseudoscientific artifact of human psychology
- the poorly-understood scientific concept I mentioned earlier
If AI researchers cared about scientific thinking, they would be intensely focused on the brains of bees. Insteac they love money and sci-fi but have pure contempt for science, even Demis Hassabis. This is why AI researchers have yet to build a robot that navigates real-world 3D space as intelligently as a cockroach. I don't think any of our grandchildren will live to see a computer smarter than a mouse. (It seems like Fable still struggles with small-number arithmetic. Rodents don't.)
Two, at some point AIs will be able to use other context like the fact that this is Terrence Tao and not your average Joe and change how it answers, either in tone or structure.
Fork Tao’s convo and prompt this (with your own math level described).
GPT did a great job of translating Tao’s questions and concepts (e.g. “pre image”) into a progression I could understand.
“Ok I have a PhD in financial math and undergrad in engineering math. I have almost zero knowledge of polynomial algebra / geometry, I know what a polynomial is and what roots are but not much beyond that. Could you try and explain to my level what questions the user I the conversation has asked and what the agent has responded with, we can probably go user query by user query to build up”
Modern AI feels like a godsend to mathematicians. It helps them break down boundaries and connect concepts in ways a mere mortal couldn't imagine.
Is there any way to tell a conversation's model and thinking level?
Expand the entire expression, then change the representation to find the core axis. You can't see the axis from just one perspective, so you change the representation. In programming terms, it's like applying multiple domain models. Then break it down into small contract units. Why is it a Jacobian monomial? Why does x satisfy a cubic equation? And so on.
Then swap out the modeling under a hypothesis, assemble it all back together, and verify it through the equation.
This feels similar to modeling in programming.
Observe the whole -> explore better modeling -> decompose local problem -> verify independently -> reason about the highre level structure -> integrate back into the original problem.
This feels similar to when I receive work from a client and write a programming proposal
Is it something "revolutionary" or just another small brick that will pile up until something really "revolutionary" will happen?
By itself, no consequence. But over time, provided we keep pumping out talented and qualified mathematicians and keep subsidizing costs, we could maybe hit a breakthrough... somewhere... that has real impact.
It's not quite the Reimann hypothesis, but many prominent mathematicians have spent years working on this problem. Yitang Zhang wrote his PhD thesis on it.
Maybe they'll find a solution where P=NP.
That could really throw a wrench into the whole internet thing.
It seems they need an expert human driver for now.