Foundation Models framework

 (developer.apple.com)

59 points | by kermatt 1 hour ago

4 comments

  • imagetic 1 hour ago
    Why is this up front on HN? Did it get an update?
    [-]
  • albertgoeswoof 50 minutes ago
    I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt

    Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)

    [-]
    • jshier 45 minutes ago
      Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.
  • dvdplm 21 minutes ago
    Can the local model code at all? Eg as the predictor in Zed?
  • amelius 41 minutes ago
    I'll ask my LLM to build me a framework, thank you.
    [-]
    • steve1977 18 minutes ago
      Why would you do that, assuming that you're not coding yourself/using the framework?