3 comments

  • khimaros 48 days ago
    created something similar but specific to llama-server. it takes advantage of logprob output and completes decisions in a single forward pass https://github.com/khimaros/verdict
  • ljlolel 48 days ago
    we also have several jev type models available in seconds built on top of models on our router

    mev (based on mercury) gemmev (based on gemma)

    also these take images input

    zev, lev etc

    https://trustedrouter.com/docs/decide

  • jgilias 48 days ago
    But… why???
    • czl_my 46 days ago
      as an alternative option to Jev, and to take advantage of LLM's reasoning for the classification.