Running Qwen3.8-Flash-Next NVFP4 at 184 tok/s on a single RTX 6000 Pro

2 comments

• IronWolve 2 hours ago
  Been running versions of this on my pc, if you have 64 gigs ram, you can run it on a 12+ gig cards easily.
• lowbloodsugar 4 hours ago
  Been running Qwen3.8-Flash-Next NVFP4 for weeks now. What's new about this?
  [-]
  • catchnear4321 4 hours ago
    hn title is completely different from the article title, which takes clicking the hn title to discover.

    > Our first model-kernel combos