3 comments

  • augment_me 38 minutes ago
    Quirks from the article:

    1) The performance numbers are simulated

    2) The details say that the performance numbers require 2.7x the overall power, so around 13.5W. Power needed for all the memory is not explicit in the numbers.

    3) The compiler is also simulated and it's a prototype, so it's not a drop-in replacement for anything like Nvidia ISAAC

    4) 5W seems to refer to sub-4B models, so not the 100B param ones.

  • baalimago 3 minutes ago
    > "large large language models"
  • tensward 1 hour ago
    Wonder how it would feel because the details shown seems a bit slow to edge device use