10 comments

  • butz 1 day ago
    What translation quality can be expected form such "tiny" model, especially for older games with text only in hiragana? Is there any context memory, or is each sentence translated as standalone?
    • butz 1 day ago
      I'll answer to my own question with one fine translation: "It's called a pine tree, and it's a pine tree. It's a pine tree. It's a pine tree. It's a pine tree." Hint: original text had no mention of pine trees. All jokes aside, some sentences were translated correctly and, most important, with only about 1s of delay on CPU.
  • surrTurr 1 day ago
    Related - this one also works with manga: https://github.com/SethRobinson/UGTLive
    • TehCorwiz 1 day ago
      Looks like the main difference is that UGTLive calls out to Gemini. This one runs locally.
  • haunter 1 day ago
    I wonder how does it work with multi button multi menu games like Pro Yakyū Spirits
  • lunias 5 hours ago
    Awesome stuff. +100 cool points for using a local model
  • darcien 1 day ago
    Nice, I wonder how the banner would work for menu or any complex screen that's not a single sentence.

    In the past, I've used MORT to play some Japanese MMO game. In-place overlay makes it easier to actually play the game instead of doing dictionary lookup on the side.

    These days I stopped using realtime translator and just embrace the slow pace of learning these languages while enjoying the game story.

    MORT: https://github.com/killkimno/MORT

  • kalind 1 day ago
    Nice! I wrote a script similar to this that triggers when I take a screenshot with Flameshot, OCR's the screenshot using an API and opens web page with the OCR'd text. I prefer to use a Japanese to Japanese dictionary when possible which I have as a browser extension (yomitan). I like that this approach doesn't require an external API.
  • terrycody 17 hours ago
    Not techy at all, may I ask how to run it on windows 10/11?
    • terrycody 17 hours ago
      And does it work when you running an amulator inside windows OS?
  • 999900000999 1 day ago
    Very very cool!

    I imagine this is more for turn based games though.

  • self_awareness 1 day ago
    > Inplace overlay on Wayland only works with fullscreen windows (Wayland's security model prevents knowing window positions).

    "Security is more important than usability. In a perfect world, no one would be able to use anything!"