Muse Spark 1.3

(developer.meta.com)

61 points | by bvaldivielso 26 minutes ago

11 comments

  • simonw 18 minutes ago

      llm -m meta-ai/muse-spark-1.3 "Generate an SVG of a pelican riding a bicycle"
    
    https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    4.2266 cents, 38 seconds.

    For comparison here's Muse Spark 1.2, which animated it without me asking it to: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    The 1.3 one is definitely better - better bicycle frame, better wing, better pelican hat.

    UPDATE: Here's another one with five pelicans for each of the five Muse Spark 1.3 reasoning levels: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    The most expensive was reasoning level xhigh - 7.5 cents, 1m34s.

    And I ran five pelicans at all reasoning levels for 1.2 as well, here: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    • jonahx 4 minutes ago
      If you have a grading rubric, huge points off for adding arms instead of using the wings as arms!
      • Fergusonb 0 minutes ago
        I think it's hilarious that this detail is enough for me to dismiss looking into the model, but here we are, and it is.
    • drusepth 16 minutes ago
      Is there a reason these pelicans always have roughly the same composition (side-view, 2d, biking right, flat ground beneath, etc)? I don't see any of that detailed in the prompt, yet they all seem to generate roughly the same image of differing quality.
      • vunderba 11 minutes ago
        The more generic your prompt, the more generic the response. It's a regression to the "mean" of the training data aka GIGO for AI.

        It's like when you ask your average person off the street to draw a house - it'll almost always be square with a triangle roof, one door, and two windows.

        In the pelican/bike example, it's probably a bit of a self-perpetuating snowball too. If the earliest examples were bike left-to-right, flat ground, etc. then they are also being scraped up in future LLMs.

      • postalcoder 8 minutes ago
        Search Google Images for "bicycle". Almost all bicycle product shots are staged the same way: side view, going left-to-right. It makes sense to me that given that skew in the training data, the model grounds itself in the bicycle.
        • daemonologist 2 minutes ago
          and furthermore, this is because the drivetrain is ~always on the right side of the bike - if you want to inspect or admire a bicycle you look at the right side, as you might look under the hood of a car.

          (Why the drivetrain is on the right, I don't know. But most bike parts follow open standards so it's quite entrenched.)

      • simonw 14 minutes ago
        It's really interesting, isn't it? They almost always cycle from left to right - but I have had a few which cycle in the other direction.

        The 2D / flat ground feels reasonable for a SVG, which implies a vector illustration.

    • tomrod 6 minutes ago
      What does the mean pelican look like at this point?

      Also 3X token use vs. 1.2

    • jmkni 16 minutes ago
      lol

      Definitely an upgrade over 1.2

  • superfrank 2 minutes ago
    I started using Spark 1.2 for development because if you're willing to let Meta train on your data it was dirt cheap and was actually really pleasantly surprised with it. It's not a frontier model by any means, but for work that didn't require a top of the line model, I really enjoyed using it. I'm anthropomorphizing it a bit, but it felt like it knew its weaknesses and didn't try to impose it's opinions on me. What I mean by that is that it did what I told it and if there was something unexpected in the code that it put out it was often because I gave it ambiguous or conflicting instructions. It didn't try to go above and beyond and just acted like a tool, which is what I want from a coding agent 90%+ of the time. I also felt that it did a much better job of following established patterns in my code than many of the other current models do.

    Tangential, but when I first started using Spark 1.2, it made me realize how much I miss 5.3 Codex. That model was the peak of coding models, IMO, in that it knew how to write good code, but didn't try to overstep or be "helpful" in unexpected ways. That got me thinking about how the major labs seem to be stepping away from coding focused models toward more general purpose ones and how I can't help but feel like that's a mistake.

  • Gecko4072 15 minutes ago
    Used Muse Spark 1.2 and was not impressed at all. Fast and cheap but even GPT 5.6 Terra felt much more capable. Also not really looking to support a company that was just forced to pay $18B for mental health damages.
    • WASDx 6 minutes ago
      I'm party using 1.2 to reverse engineer and re-implement an old game binary and it has been quite good and fast. The contributor pricing is very attractive, excited to try 1.3 and see if I feel a difference. 1.2 can get stuck outputting similar sounding thought summaries with no apparent progress when asked to solve bugs. Then I've switched to GLM-5.3-Flash which for this use case has been clearly better at finding suspected causes and following tracks.
  • finnjohnsen2 9 minutes ago
    So one model is "Not used to improve our products" and is 10-20 times more expensive to the "Used to improve our products"-model.

    Given this is Meta, my immediate assumptions that one is cheap because it lets me "be the product". I know I'm rushing to conclusions but there is zero trust here. The brain will do its thing. And the wording here is giving the brains a lot of wiggle room.

    • thefreeman 6 minutes ago
      aren't they explicitly saying this with both their pricing and their wording? I'm not sure what you are alluding to?
    • whimsicalism 6 minutes ago
      the meaning is pretty obvious - they want to train on your chats & tasks and are willing to subsidize for the privilege of doing so.
  • majerep 9 minutes ago
    The previous version was, in my experience, the best free model available on OpenCode. It's been very good at simple/moderate tasks where I am precise in my ask and it doesn't need to make a ton of undefined assumptions. Hopefully this new version is also available on opencode for free.
  • 7734128 5 minutes ago
    Practically free for "contributors" at 0.2 usd/mtok. That's going to be hard to say no to for hobbyists.
  • wxw 9 minutes ago
    “contributor” pricing at $0.10/$0.20 is crazy cheap if it’s measuring up to Sol.

    Definitely shows how important a user data flywheel is for RL and model improvement.

  • meerita 6 minutes ago
    I declined the use of cookies and everything went black. No content at all. Dissapointed.
  • geooff_ 7 minutes ago
    Could this be best intelligence / $ if you're willing to let zuck digest your data?
  • tinyhouse 1 minute ago
    I had no idea Meta has a coding agent harness. Does anyone have experience with it and can comment? The 1.3 contributor prices look very attractive. I'll probably start using their API if performance is good and the API is reliable with decent rate limits.
  • frozenseven 19 minutes ago
    This should probably be primary:

    https://news.ycombinator.com/item?id=49541149