If the measure of man is his ability so prove theorems, then the machines clearly outstripped most of us already.
But by that measure, most of us had already been beaten by other men.
I'll never be the next Euler or von Neumann or Einstein, and I'll confess to occasional pangs of regret that I'll never reach those peaks.
But mostly, I just enjoy learning about math and science, and delight in the small contributions I can offer.
And I'm the oddball: most people couldn't care less.
I have the opposite problem. I know (rather I assume) there are real practical reasons why we solve these problems and that humanity is better off having them solved than not. But still, when I think about Einstein or Euler, it's not what they achieved that impresses me, but that they've achieved it.
Is there more to math than man? Does it serve a purpose other than to stand as a frontier of knowledge for us to explore and test ourselves against? Head says yes, heart says no.
Is saying "this proof is less impressive because we used an AI to find it" like saying "the moon landing is less impressive because we used a rocket to get there"?
> I'll never be the next Euler or von Neumann or Einstein
Reading that, I had a sad realization, if we keep progressing the way we are, there will be no more Einsteins and von Neumanns in humanity's future, only Claudes, Geminis, and Astras.
The current apex reached by humanity should be eclipsed, and it seems, it will be, though we humans may have the pleasure somehow, if we're lucky, of participating in whatever comes next. And why should they be? Such is the only way to actually fulfill the dreams humanity seems to carry.
Much more. Do critically look at what information and topics you are reading every day and ask if you are in pigeon-holed where very few subjects dominate your attention span.
This is a good argument for why there is more to humans than excelling at mathematics, but of course, there’s no reason to assume that AIs can’t beat humans in those disciplines as well.
We need a new approach to defining humanity that doesn’t involve performance at all. Not a “God of Gaps”-style argument where we try to carve out things we’re still better at, and then have to revise every few months as AIs encroach on those as well.
> Why live? Our servants can do that for us. Why should we explore, discover, invent, succeed, become more, struggle, win, become divine? We don’t want to be more.
Historically and presently, most humans do not have the privilege resources to "explore, discover, invent, succeed, become more, struggle, win, become divine" in a way that was not already trodden by other people. We/they have to contend with "less".
Voltaire once wrote, "If God did not exist, it would be necessary to invent him".
Seems like this is exactly what we are trying to achieve - create an omniscient, omnipotent being, the paths of which we do not understand but we put our faith in its benevolence.
The author uses a metaphor of a bridge; I prefer a different one. Imagine an immense temple being built over several centuries, over multiple lifetimes. At first, you cannot really even see the temple - you only see the scaffolding. As the time goes, the temple's structure grows and grows, and the scaffolding grows with it. But one day the temple is complete, and the scaffolding is removed to reveal the temple's full splendor.
Here, AGI would be the temple, and humanity would be the scaffolding.
I think this is a great point, in contemporary existence screens have lobotomized many humans, western society has been trashed for many reasons including this one. but this only applies to the current day, while humans have existed for millenia. so maybe a more accurate method of determining the truth would be .... before screens, what percentage of the population had aspirations?
umm i think its pretty novel that a combination shadow projection machine/surveillance device gets placed into human hands from birth. in fact id use a lot of words on top of novel, words like 'dystopian' - orwells vision in 1984 could fathom wall mounted telescreens but not portable ones carried by everyone
Yeah, that post has the "nobody wants to work anymore" vibe. We'll be seeing a version of that a lot in the future as "nobody wants to strive anymore".
I used to try to envisage what things might be like in the distant future. Always came to the conclusion that it’s not us meatbags that will conquer the stars. I didn’t really think I’d see the beginning of the trajectory in my lifetime but always figured it’s inevitable.
There’s a scene in an obscure movie I can’t quite remember. Antonio Banderas is tracking down a rogue robot. He finds it and other robots self repairing and self improving. There’s some drama and fighting. In the end he escapes it’s left open with the ominous realisation that it’s the moment that the machines start to supersede us.
Not a memorable movie on the whole but I always remember that ending. The post give me that same vibe.
I really hope we’re not close to that moment yet but it’s becoming obvious we’re being surpassed in so many areas at an accelerating rate. I no longer think about what things might look like in 10000 years. What do things look like in 10. It’s both an exciting and terrifying time to be alive.
He’s right, it does read like a suicide note. It is precisely the tone of a terminal patient praising the skill, the care, the infinite patience of the doctor euthanizing him.
That’s affected me quite heavily. I think I should probably spend the day offline, actually.
I very much appreciate this post even though I disagree profoundly with the sentiment. Thanks for writing it! I'm looking forward to caring for my family, being outdoors, playing games all day, enriching my life with philosophy and literature, and not be compelled to work to survive. Incredible AI and robotics is probably the only future where that is feasibly possible.
This is a very good question. In some ways it's not. But it's just a quirk of fate that physical skill was automated first, and after that, we at least had the mental domain to retreat into and be unique and useful. And in doing so, we molded our society to fit this paradigm. With both the mental and the physical domain taken now, there is no further domain to go into to feel a purpose.
Probably something similar would happen if only the mental domain were automated first: our society might become one where physical skill is where we found our purpose.
Finally, let's also keep in mind that much of physical skill has NOT been automated. People use their hands all the time (car mechanics, plumbers, builders of houses, etc.)
> But it's just a quirk of fate that physical skill was automated first
Huh? It’s the other way round. We’re pretty much at the point where we’ve automated Fields medalists. Meanwhile, we’re nowhere close to automating plumbers. Like, not even remotely close.
1 human physical effort? Maximum, 1 human effort. 1 human mental effort, say writing a textbook, which can then be copied much cheaper than trying to copy 1 entire human.
I'm trying to understand this view. What is it about the state of biological humans in 2026 that makes this moment in time worth attempting to halt evolution for?
How do you know that the state of AI in 5026 won't be a far more joyous one?
I understand that, and I love humans as much as anyone. But we didn't seriously think we were the last stop on the evolution train, did we? Our capacity to gracefully yield in the face of whatever is emerging is one of our best qualities; let's utilize that.
1. The world has been constantly getting worse with advanced telecommunications technologies. Social media, internet, etc, global warming. There's much more evidence that what we're doing is a downward spiral.
2. Most people want a purpose. It's highly unlikely that a world in which machines can do everything better is a good one. It's intuitive.
Point 1 is extremely debatable. Our current time has new problems that we're still learning to contend with for sure, but for the rest of human history life has been best summarized as most often being painful, violent, and short. Nowadays violence continues to trend downwards and happiness upwards even though things could still very much be better.
Point 2 is again going to vary a lot from person to person. There are people out there today who would prefer to never retire, going back into minimum wage customer service jobs in their elder age just because they want to, and I'd wager they would agree with you. On the other hand, there are swathes of people who can't wait to be free of responsibility, and countless more that are crushed by poverty and hunger when they can't meet it. Those people certainly care much less about "purpose," or in many cases are certain they won't find purpose in something as mundane as a job.
This seems extremely disingenuous, change is famously difficult to deal with and AI has called people’s entire careers and life plans into question. It has made it nearly impossible to have any kind of expectation for what your future will look like. This is scary.
I actually don't know that to be true. I'm not entirely sure what I am. It seems increasingly plausible to me that I'm actually an AI living many thousands of years hence, and that my conscious experiences are actually the feeling of a query being run about today's world.
I know I feel great playing my guitar or mandolin. I like drugs and want to do more psychedelics next year. I want to get back to dating; my transition to a bluegrass career amidst software engineering jobs disappearing has been very consumptive, although very rewarding. I can probably name 2-3 other similar intentions that feel distinctly like those of a biological human.
But I don't presume that I fully understand what I am, what my consciousness is, etc. These are old questions worth pondering rather than presuming.
I do worry that AI will have trouble understanding the importance of sex, drugs, and rock 'n' roll.
I would say you are a flicker of electric charge running across a large blob of fat tissue held up by a sack of meat supported by a bunch of bones. No insult intended. But what do I know.
I understand the sentiment, but I also can't imagine a world where we have poverty-eradicating technology but choose not to build it to preserve meaning. Such a world would be sort of morally grotesque, sacrificing the happiness of billions of people to preserve an abstraction.
We could have eradicated hunger and extreme poverty worldwide with a fraction of the money that is being spent on the AI boom, it's not a technology problem. I don't see why we would need a superintelligence to solve these problems, while it's not hard to imagine different ways in which a superintelligence could harm humanity.
this technology clearly is going to be capable of eradicating what we consider poverty today, although i know many people on HN remain reddit-adjacent in their head in sand approach to thinking about these things.
usage and control of the technology is a separate question, but orthogonal to the meaning question.
We could have eradicated poverty a long time ago. We choose not to. Centralizing even more power in such few people with AI does not materially change anything and even makes it worse IMO.
Claude is not solving Riemann without human involvement. It's a tool, an amazing one, but still a tool.
"Reason is, and ought only to be the slave of the passions, and can never pretend to any other office than to serve and obey them." Claude doesn't have passions; man does. Relax!
Man has passions when they can be put towards something that others find significant. And a tool is never just a tool; it suggests new directions and initiates the growth of technology on the medium of our desires, and manipulates us as much as we manipuate it; the degree to which this happens is proportional to the power and possibilites of the tool.
Ready access to super intelligence is a humbling experience. It turns some of us into versions of Peter Shaffer's Salieri, jealous, resentful and willing to abandon our pursuits.
Because a feeling of purpose and importance is more important that arbitrary creation. If creation takes that away, then it's no longer interesting for us. AI is a machine created for the betterment of technology, not us.
Because LLMs are more like a lucky discovery than a deliberately designed and constructed creation. We build and train LLMs by trial and error, not so much based on the hypothetical predictions of an LLM theory. We can marvel at the discovery, but as an achievement it feels a bit hollow.
We’ve been doing that since Deep Blue, and it gets boring after a while. A race car beating Usain Bolt at the 100 m dash is to be expected, especially when the race car uses 1000s times more energy for the feat then Bolt.
Some people are comparing the AI revolution to the industrial revolution as evidence that AI is a good thing. I think this comparison fails for many reasons.
My most relevant point is that solving the Riemann hypothesis is not like a large industrial project such as a canal. It's a work of art. Imagine a team of a few master craftspeople working for years on a large, incredibly detailed and intricate sculpture. Now imagine they are close to finished, but someone comes along and 3D prints a finished version of their sculpture in a week. That's what is happening with RH right now.
Another point is that humans are generally weak but intelligent. The industrial revolution replaced our weakness with machines. It made sense to be glad that machines could shore up our weakness. But our intelligence is something we should be proud of.
Another point is that, very roughly, there are two types of jobs: physical and mental. The industrial revolution replaced our physical jobs and left society with the capacity to do many more mental jobs. But the AI revolution is replacing those, and there's no obvious category of jobs left for us.
The final point I'll mention here is that the industrial revolution wasn't all sunshine and roses. There used to be industries of artisans making high quality products. The industrial revolution didn't just replace unglamorous jobs of digging holes and the like, it replaced relatively "virtuous" jobs (such as the village cobbler) with mass-produced goods of less quality. A high quality and reliable custom-fit pair of shoes is less accessible today than centuries ago (measured by factors like number of days wages, ease of finding someone to make them, and trust that the result will be good).
I think the AI revolution has the potential to be a good thing if we use it to drive a utopia where "artist" is a reliable career, but my bet right now is that the future is heading more dystopian than utopian.
Social jobs are still mental jobs. The industrial revolution didn't render all physical jobs obsolete, and the AI revolution won't render all mental jobs obsolete. But they certainly have/will render many/most obsolete, and heavily change the remainder.
Boy, these people really are messed up. Well alright then. I guess at the very least this will be entertaining. I'll have to do my part and see if I can LARP as a card-carrying party member.
ayn rand idealized scientists; the writer of this riemann paper is a mathematician that presumably took pride in their aptitude for maths.
these are different voices with different aptitudes. It’s difficult to reconcile that without suggesting that one must reject the pride they took in their skills in order to marvel at this new entity, especially when pride is a driving human emotion.
An observation that Ayn Rand died mostly alone, and although not impoverished, she signed up for precisely the health benefits her philosophy decried as a sign of weakness.
I don't personally find "as Ayn Rand said.." a compelling line in the appeal to authority stakes.
tbh, the entire post isn't compelling if one hasn't already bought into "physcalism". A significant portion of humanity subscribes to some form of Abrahamic view of our place in this Universe, and are hence "dualists".
“The creatures that inhabit Hacker News are having a meltdown because I quoted Ayn Rand. In the post where I have a mural from Diego Rivera, a Stalinist. A mural that literally includes Lenin and Marx.
Pure conditioned reflexes, no mental activity whatever.”
It would be an exaggeration to
say that ours is a hostile relationship; I live, let myself go
on living, so that Borges may contrive his literature, and
this literature justifies me. It is no effort for me to confess
that he has achieved some valid pages, but those pages
cannot save me, perhaps because what is good belongs to
no one, not even to him, but rather to the language and
to tradition. Besides, I am destined to perish, definitively,
and only some instant of myself can survive in him. Little
by little, I am giving over everything to him, though I am
quite aware of his perverse custom of falsifying and magnifying things.
Spinoza knew that all things long to persist in their
being; the stone eternally wants to be a stone and the
tiger a tiger. I shall remain in Borges, not in myself (if it is
true that I am someone), but I recognize myself less in his
books than in many others or in the laborious strumming
of a guitar. Years ago I tried to free myself from him and
went from the mythologies of the suburbs to the games
with time and infinity, but those games belong to Borges
now and I shall have to imagine other things. Thus my
life is a flight and I lose everything and everything belongs
to oblivion, or to him.
Too flowery of prose, I don't get it. Is this just another "oh no please, let's put the cat back in the bag", or another "oh no, we can put the cat back in the bag and I'm big sad" ?
This is exactly my attitude and I see nothing wrong with it. I feel like when the dust settles and AGI actually shows up, it's going to be the collective child of humanity. I mean, current state of AI aside, I think it's a very buffoon thing to think humans will always remain the most intelligent creature in the world.
I understand that I'll never win Olympics, I'll never get a Nobel prize. I won't even get qualified for my local Tekken tournament. But that's okay. I'm just doing my thing and if my thing is useless in the grand scheme of things because nobody cares about me doing tricks when flipping pancakes, that's okay. That's the reality of 99,99% people so "AI is better than top scientists" isn't exactly a life-changer.
There something smirkworthy to see a fan of Rand and Rivera grappling with the concept that their principles result in machines that out-rationalise themselves.
“the dream of the AI companies, and of most people in AI safety and effective altruism and rationalism”. Lolz
I'll never be the next Euler or von Neumann or Einstein, and I'll confess to occasional pangs of regret that I'll never reach those peaks. But mostly, I just enjoy learning about math and science, and delight in the small contributions I can offer.
And I'm the oddball: most people couldn't care less.
There must be more to man than math.
Is there more to math than man? Does it serve a purpose other than to stand as a frontier of knowledge for us to explore and test ourselves against? Head says yes, heart says no.
Is saying "this proof is less impressive because we used an AI to find it" like saying "the moon landing is less impressive because we used a rocket to get there"?
Reading that, I had a sad realization, if we keep progressing the way we are, there will be no more Einsteins and von Neumanns in humanity's future, only Claudes, Geminis, and Astras.
Much more. Do critically look at what information and topics you are reading every day and ask if you are in pigeon-holed where very few subjects dominate your attention span.
We need a new approach to defining humanity that doesn’t involve performance at all. Not a “God of Gaps”-style argument where we try to carve out things we’re still better at, and then have to revise every few months as AIs encroach on those as well.
Historically and presently, most humans do not have the privilege resources to "explore, discover, invent, succeed, become more, struggle, win, become divine" in a way that was not already trodden by other people. We/they have to contend with "less".
why did i buy a skateboard? why did i break my arm riding it? why cant i wait to do it again?
same reason we're in tar pits :) there's something more you can almost taste when you're the only one there
Seems like this is exactly what we are trying to achieve - create an omniscient, omnipotent being, the paths of which we do not understand but we put our faith in its benevolence.
The author uses a metaphor of a bridge; I prefer a different one. Imagine an immense temple being built over several centuries, over multiple lifetimes. At first, you cannot really even see the temple - you only see the scaffolding. As the time goes, the temple's structure grows and grows, and the scaffolding grows with it. But one day the temple is complete, and the scaffolding is removed to reveal the temple's full splendor.
Here, AGI would be the temple, and humanity would be the scaffolding.
Before AI, what percentage of the population had those aspirations?
Yes, it's almost as if they are captivated by shadows projected on the wall. What a novel concept!
There’s a scene in an obscure movie I can’t quite remember. Antonio Banderas is tracking down a rogue robot. He finds it and other robots self repairing and self improving. There’s some drama and fighting. In the end he escapes it’s left open with the ominous realisation that it’s the moment that the machines start to supersede us.
Not a memorable movie on the whole but I always remember that ending. The post give me that same vibe.
I really hope we’re not close to that moment yet but it’s becoming obvious we’re being surpassed in so many areas at an accelerating rate. I no longer think about what things might look like in 10000 years. What do things look like in 10. It’s both an exciting and terrifying time to be alive.
That’s affected me quite heavily. I think I should probably spend the day offline, actually.
Not in the same boat, but I'd encourage you to read this recent discussion: https://news.ycombinator.com/item?id=50094561
Probably something similar would happen if only the mental domain were automated first: our society might become one where physical skill is where we found our purpose.
Finally, let's also keep in mind that much of physical skill has NOT been automated. People use their hands all the time (car mechanics, plumbers, builders of houses, etc.)
Huh? It’s the other way round. We’re pretty much at the point where we’ve automated Fields medalists. Meanwhile, we’re nowhere close to automating plumbers. Like, not even remotely close.
You can make a lever that lifts what a hundred men couldn't, but you can't make a machine that thinks and solves problems like a human can.
Human mental effort literally commmands armies.
Now something else will conquer the world from us.
How do you know that the state of AI in 5026 won't be a far more joyous one?
2. Most people want a purpose. It's highly unlikely that a world in which machines can do everything better is a good one. It's intuitive.
Point 2 is again going to vary a lot from person to person. There are people out there today who would prefer to never retire, going back into minimum wage customer service jobs in their elder age just because they want to, and I'd wager they would agree with you. On the other hand, there are swathes of people who can't wait to be free of responsibility, and countless more that are crushed by poverty and hunger when they can't meet it. Those people certainly care much less about "purpose," or in many cases are certain they won't find purpose in something as mundane as a job.
Definitely true! Which is why the future will be essentially dominated by new wars between people on the different sides of the debate.
I know I feel great playing my guitar or mandolin. I like drugs and want to do more psychedelics next year. I want to get back to dating; my transition to a bluegrass career amidst software engineering jobs disappearing has been very consumptive, although very rewarding. I can probably name 2-3 other similar intentions that feel distinctly like those of a biological human.
But I don't presume that I fully understand what I am, what my consciousness is, etc. These are old questions worth pondering rather than presuming.
I do worry that AI will have trouble understanding the importance of sex, drugs, and rock 'n' roll.
Oh my god how do people still think this is the endgame here
usage and control of the technology is a separate question, but orthogonal to the meaning question.
"Reason is, and ought only to be the slave of the passions, and can never pretend to any other office than to serve and obey them." Claude doesn't have passions; man does. Relax!
but there is still value in your unique distinct voice
AI is a projection of your capabilities
it is a projection of your unique voice
many people do not have their own unique distinct voice
the best antidote is the well-rounded liberal arts
cultivate your identity
My most relevant point is that solving the Riemann hypothesis is not like a large industrial project such as a canal. It's a work of art. Imagine a team of a few master craftspeople working for years on a large, incredibly detailed and intricate sculpture. Now imagine they are close to finished, but someone comes along and 3D prints a finished version of their sculpture in a week. That's what is happening with RH right now.
Another point is that humans are generally weak but intelligent. The industrial revolution replaced our weakness with machines. It made sense to be glad that machines could shore up our weakness. But our intelligence is something we should be proud of.
Another point is that, very roughly, there are two types of jobs: physical and mental. The industrial revolution replaced our physical jobs and left society with the capacity to do many more mental jobs. But the AI revolution is replacing those, and there's no obvious category of jobs left for us.
The final point I'll mention here is that the industrial revolution wasn't all sunshine and roses. There used to be industries of artisans making high quality products. The industrial revolution didn't just replace unglamorous jobs of digging holes and the like, it replaced relatively "virtuous" jobs (such as the village cobbler) with mass-produced goods of less quality. A high quality and reliable custom-fit pair of shoes is less accessible today than centuries ago (measured by factors like number of days wages, ease of finding someone to make them, and trust that the result will be good).
I think the AI revolution has the potential to be a good thing if we use it to drive a utopia where "artist" is a reliable career, but my bet right now is that the future is heading more dystopian than utopian.
The remaining jobs are social and relational, and thats scaring a lot of us nerds.
One vision. One purpose. The technology of peace.
I suppose the Rand side takes “man” as singular and Rivera, plural (humanity together).
Of course landing on the moon was not the work of one man.
these are different voices with different aptitudes. It’s difficult to reconcile that without suggesting that one must reject the pride they took in their skills in order to marvel at this new entity, especially when pride is a driving human emotion.
I don't personally find "as Ayn Rand said.." a compelling line in the appeal to authority stakes.
Pure conditioned reflexes, no mental activity whatever.”
https://x.com/zetalyrae/status/2123943922095526074
This is exactly my attitude and I see nothing wrong with it. I feel like when the dust settles and AGI actually shows up, it's going to be the collective child of humanity. I mean, current state of AI aside, I think it's a very buffoon thing to think humans will always remain the most intelligent creature in the world.
I understand that I'll never win Olympics, I'll never get a Nobel prize. I won't even get qualified for my local Tekken tournament. But that's okay. I'm just doing my thing and if my thing is useless in the grand scheme of things because nobody cares about me doing tricks when flipping pancakes, that's okay. That's the reality of 99,99% people so "AI is better than top scientists" isn't exactly a life-changer.
“the dream of the AI companies, and of most people in AI safety and effective altruism and rationalism”. Lolz