Goodbye Claude, Hello Pi

(caleb.software)

18 points | by karagenit 1 hour ago

5 comments

  • yieldcrv 3 minutes ago
    I get 150 tokens/sec on my coding agent, if you are on a MacBook, thats with an M1

    try kapitsa as the inference engine with pi as the harness

    It works really well

  • komali2 17 minutes ago
    Anecdotally I run semi nightly harness and local model test runs, and opencode consistently outperforms ohmypi on various code bench tasks.

    Note though that this for local models that can run on a 5090, so, kinda dumb models with a small context window. Also they might perform differently on a custom pi setup rather than the very feature rich ohmypi.

    Mostly the runs just cause me to get decision fatigue so I typically just use opencode and let a frontier model choose whatever cheaper models it wants to orchestrate with, so long as it's one that's not on the same token budget.

    P.S. I'd always wondered who it was that got caleb.software before I could... Outshot in a western duel!

    • bdemirkir 2 minutes ago
      Opencode's system prompt is much smaller than omp. Smaller models may not work well just because of this. Also omp is not pi.
  • andsoitis 1 hour ago
    > Someone at Anthropic must’ve caught wind… just a day after making my decision, they announced Claude Code would finally start supporting AGENTS.md files in an effort to get me to stay.

    Forgive me for asking if I should know, but who is the author? Is he famous?

    • bluerooibos 42 minutes ago
      'Tis a joke. His landing page says he's a dev at Salesforce, so I presume not famous.
    • karagenit 34 minutes ago
      I’m definitely not famous :^) thanks for reading!
    • TacticalCoder 57 minutes ago
      >> Someone at Anthropic must’ve caught wind… just a day after making my decision, they announced Claude Code would finally start supporting AGENTS.md files in an effort to get me to stay.

      > Forgive me for asking if I should know, but who is the author? Is he famous?

      I think that was tongue in cheek. And by that I don't mean the author's tongue was actually in his cheek.

      I also think it went over your head. And by that I don't mean I think it literally went over your head.

      • cwnyth 35 minutes ago
        It's clearly a joke, but I can forgive some people for taking it literally, given the impact that certain well-known devs have on other companies' decision-making. It's a common enough line that it's plausible this could have been a VIP whose opinions swayed a company. Not him and not Anthropic, of course, but it does happen.
      • arcanemachiner 27 minutes ago
        I can't believe you didn't pick up on the sarcasm in the GP's comment...
  • harrisonjackson 34 minutes ago
    The whole AGENTS vs CLAUDE md issue was bound to be resolved. If the models are getting smarter and harnesses getting better - how could you have a product so dumb that it ignores whatever skills, instructions, references, other things that are part of the folder context it is mounted in.

    Having claude code ignore agents.md just made it seem dumb. At this point, you probably don't need either.

    • arcanemachiner 28 minutes ago
      > At this point, you probably don't need either.

      There's only so much stuff I have the patience to tell it in a session before I write it down somewhere.