Why I'm still bearish on LLMs after Navier-Stokes

(dank.systems)

88 points | by jaykru 6 hours ago

13 comments

  • carodgers 36 minutes ago
    This April 2026 paper is a fun and related read.

    https://arxiv.org/html/2509.24239v4

    Researchers asked frontier models to play chess. Have a look at the MAR rates in Table 3. When not explicitly told which moves were legal, no model identified legal moves at a rate better than 80%. Many asked for more illegal moves than legal moves. And even when explicitly told which moves were legal, the models continued to ask for illegal moves. With illegal asks discarded, none of the bots could beat a chess model calibrated to 1100 ELO.

    The author of the originating post says that "current frontier models need laborious oversight and guardrails on even the simplest tasks", and he's absolutely correct.

    • joefourier 20 minutes ago
      > current frontier models

      > Gemini 2.5 Pro, O3, Claude Sonnet 3.7 and ChatGPT 4.1

      The gap in capabilities between those models which they tested, and actual current frontier ones is enormous. I would not trust that any conclusions they made are applicable.

      • sigmoid10 12 minutes ago
        The actual current frontier plays somewhere around GM level.

        https://chessbench-ai.github.io/#leaderboard

        It's also worth noting that the very latest models (GPT-6 and Fable 5.1) actually play worse than their immediate predecessors, so it is likely that the labs are not benchmaxxing for this yet. If they did, I'm sure they could come up with something superior to humans. But there is probably very little demand for this compared to IT stuff.

    • famouswaffles 6 minutes ago
      Frontier labs don't care about chess. If OpenAI cared, GPT-7 could be a grandmaster+ level chess player. In fact there's a google paper on grandmaster level chess without search with a 270M transformer. Outside that, there was gpt-3.5-turbo instruct which was incidentally a 1800 lichess elo player that didn't make any illegal moves even after a few thousand moves. Frontier labs care deeply about automating knowledge work and computer use. They are working hard on getting models better and better, and they are succeeding. Astra is a step change on that front. So good luck i guess, if chess performance is your barometer.
    • wat10000 20 minutes ago
      I wonder how current models would fare. The ones they tested are fairly old now.
    • consensus1 12 minutes ago
      This isn't how intelligence works. The LLM may not be able to play chess directly through inference, but it can write a program to do it and execute that program. Same as how human intelligence works. We can't fly, but we can build planes.
      • nefarious_ends 6 minutes ago
        Thanks for saying this, feels like everyone has gone insane over this stuff.
    • threethirtytwo 28 minutes ago
      The story isn't so clear cut.

      The caveat is: It depends on the task.

      Are there reams of chess moves that the model can train off of? No.

      Are there reams of math papers the model can train off of? Yes.

      • vmg12 12 minutes ago
        > The caveat is: It depends on the task.

        I think the line of criticism around LLMs sucking at chess makes more sense when you understand what the AI companies are saying about the future trajectory of these models.

        The entire recursive self improvement story falls apart once you point out that there is not much "cross domain transfer learning". Meaning that training an LLM to become good at coding, math, etc, will eventually transfer into them being good at other skills that were not explicitly trained for.

        Using games like chess which have little economic value is actually a good test for this. What's even more surprising about chess is how much information about chess strategy exists in the training data.

      • freejazz 7 minutes ago
        >Are there reams of chess moves that the model can train off of? No.

        For real??

      • tjwebbnorfolk 15 minutes ago
        > Are there reams of chess moves that the model can train off of? No.

        This is as false as something can possibly be. There are open databases of millions of chess games spanning hundreds of years.

        • XenophileJKO 6 minutes ago
          It is even worse.. This is a classical reinforcement problem where data generation is easy because the rule set is pre-defined. So you really don't even need any data to start with (but would help).
      • iwontberude 22 minutes ago
        [dead]
      • keephnacct 25 minutes ago
        look I'm dignifying your comment with a reply, isn't that funny
  • vatsachak 0 minutes ago
    I agree with the caveat that it's more like a cracked junior engineer who can manage swarms of interns.

    Frontier Labs will probably survive off hype valuations but will serve the important purpose of discovering architectures/techniques, that will probably spread through rumors/transfers to the rest of the world.

  • knuppar 34 minutes ago
    Short and to the point! Open and cheap models will undercut the big labs continuously. The blast radius won't be pretty once spending commitments knock the door.
    • pvab3 15 minutes ago
      I agree with you but I'm still worried about the safety of open weight models as well. Both aligned and unaligned models.
  • ausbah 1 hour ago
    > the best alternative to rigorous specification is human review. human review doesn't scale well to the volumes of output produced by language models. to make matters worse

    when the business model is selling more tokens you get such per serve ice times that lead to “more” thinking, engagement baiting, fluffy narratives, and straight up dark patterns

  • robinpie 1 hour ago
    I really appreciate seeing a tempered take that's not literally denialist about current capabilities.
    • an0malous 48 minutes ago
      I don’t know who you’re talking about, even the most bearish people like Gary Marcus and Ed Zitron acknowledge that LLMs are useful in these same cases the OP admits. Gary Marcus is even still a long term AI advocate, he just doesn’t think LLMs are enough and we need more foundational breakthroughs. Zitron says it’s valuable technology but not worth the trillion dollar valuations the frontier labs are claiming.

      The lack of temperament is very skewed towards the bulls who have been saying AGI is here, software engineering is solved, mathematics is solved, it’s going to destroy the white collar job market, and it’s going to kill us all for like 5 years now.

      • pvab3 13 minutes ago
        Even a lot of the people who think that LLMs are a dead end think that we will soon find something signficantly more powerful, which I find deeply alarming. I don't want to know what my white-collar knowledge work will look like in a decade or 2.
      • arctic-true 44 minutes ago
        Gary Marcus is an especially puzzling addition. If I recall correctly, he has made statements along the lines that superintelligence this century is more likely than not. If you’re AGI-pilled that might read as bearish, but that is still extremely rapid progress in the grand scheme of things.
    • jaykru 1 hour ago
      Thanks :) I do enjoy and use these things every day and the current capabilities are indeed amazing, just ludicrously overpriced at the frontier.
      • dumberquestions 42 minutes ago
        I can see current limitations, but how do you expect capabilities to change in the next few years? A repeat of the gain that happened in the last two years feels like it would be significant, even if it took a little more than two years this time around.
    • brindleth 54 minutes ago
      > current frontier models need laborious oversight and guardrails on even the simplest tasks

      It is literally denialist about current capabilities

      • jaykru 50 minutes ago
        why don't anthropic and openai ship yolo mode by default?
        • Human-Cabbage 38 minutes ago
          They do…? Well, “auto” mode has been default in Claude Code for a couple months now. It’s effectively “safer yolo:” tool calls are inspected by a separate classification system (another smaller LLM, I believe) to approve or deny. And you can always layer on additional sandboxing mechanisms to limit the blast radius deterministically.
          • vmg12 6 minutes ago
            > They do…? Well, “auto” mode has been default in Claude Code for a couple months now

            They have never shipped "yolo" mode by default. Auto mode is not yolo mode. They trained a task specific model just for ensuring the llm didn't accidentally delete every file from your computer.

        • SyneRyder 35 minutes ago
          Anthropic basically does at this point with Auto Mode being default. Or was that the point you were making?
          • jaykru 13 minutes ago
            That is the point I was making, that auto mode is itself a guardrail on top of the model (and not a perfect one.) auto mode seems to cover merely actions the model could take that are clearly bad, like wiping your disk, using an overly privileged context to complete the task, etc.

            I recently tasked a GPT model in Codex with implementing part of a new architecture I'm working on. I gave it a very detailed spec and the code it produced looked pretty reasonable and passed my tests. It even did exceptionally well in my evals, so I excitedly declared victory to a few friends. The next day after more careful review I found that the architecture implementation was totally correct, but the model had slipped a one line change to the observation encoding of the RL environment I was prototyping against. The encoding change made the learning problem essentially trivial; the architecture itself, I later realized, had a major flaw that was revealed by returning to the natural encoding.

            This is the type of reward hack that is hard to paper over with easy guardrails like auto mode and even harder to specify out. It's also the type of thing a reasonable human wouldn't do unless they were intentionally trying to deceive you.

  • Founderarcstone 8 minutes ago
    I am bullish on AI. At some point well see some true advancements.
  • againstapples 40 minutes ago
    > the models generalize well only on tasks within a small neighborhood of the specific tasks they've been trained on, and even then with severe caveats. the frontier labs have developed a general recipe to teach models almost any specific task enjoying clearly defined levels of task performance; many tasks are covered in the training data

    Is this really any different to how humans learn, it takes a lot of training on one specific task to make a human expert as well?

    • JohnMakin 36 minutes ago
      > Is this really any different to how humans learn

      yes.

      • knuppar 31 minutes ago
        being a bit more specific: the sample efficiency of humans is orders of magnitude larger for more abstract concepts. the same doesn't hold for memory-intensive tasks though (like any kind of trivia), but that only takes you so far.
    • bravoetch 22 minutes ago
      I was a young child when I learned chess by reading a short book, then practicing with a friend. That is not how LLMs learn. I'm no expert on LLMs, but if you showed a human all chess games and books in all history and then said 'play chess' and they still kept making illegal moves, they would have to have a brain injury.
      • harimau777 12 minutes ago
        It seems like an LLM potentially could learn that way if each practice game it participated in was added to its training data.
    • danielmarkbruce 16 minutes ago
      Humans wear a lot of hats when the do work. They don't even realize how many. My experience with building real systems using LLMs is that you have to be very explicit about such hats and you don't realize how many are worn until you see edge case after edge case after edge case. Check this. Check that. Check this. Check that. Check check check.
    • bananzamba 24 minutes ago
      Also doesn't the very good ARC AGI 2 score of GPT-6 Astra kinda contradict this, since each problem is its own game with very different rules
  • randomImmigrant 47 minutes ago
    I think bearish on LLMs for automation, and bullish for LLM+human experts in specific fields, is about the right expectation for current architectures.

    Apart from issues with task generalization, or perhaps related to it, is the fact that LLMs have real trouble with timekeeping, and cannot estimate the real world time it will take them to do things very well. This plus the memory issues make dreams of long horizon agents, that could plausibly handle changing specifications, quite implausible with current architectures.

    In narrow domains with more deterministic outputs though, this is less of an issue, and we see multiple agents succeed much better.

    The fusion of that capacity, with humans in the loop able to better direct such agents and act as their temporal tethers, is where I think the real action will be for a while at least.

  • pfdietz 1 hour ago
    Specifically: bearish on LLMs generally, not bearish on LLMs for pure math.
    • jaykru 1 hour ago
      yes, huge for pure math and activities that look like it.
      • danielmarkbruce 14 minutes ago
        Doesn't really even need to look like it. If you can verify rewards, RLVR will optimize really really well. If you can't... it's a struggle. There are probably fewer fields where you can verify rewards than one might hope.
  • aogaili 30 minutes ago
    good post/take.
  • war-is-peace 22 minutes ago
    refreshing to see amongst the endless tide of "i haven't written a single piece of code since 2025, llms are so good that they have already replaced everyone" gaslighting
  • jaykru 6 hours ago
    archive link in case i get hugged lol https://archive.ph/Z4gxF
  • baceituno 28 minutes ago
    doomers gonna doom