[Feature] MangaOCR

[kamik-hub]

Could you add MangaOCR to this app? I think it could also perform well in games, or maybe someone wants to read manga with your app.

[bquenin]

Thanks for the suggestion! Reading manga with in-place translation is an interesting use case.

It would require some changes to support well:

• OCR model - MangaOCR is better suited for manga's stylized fonts and speech bubbles
• Text layout - Manga uses vertical text (top-to-bottom), which needs different handling than horizontal game text
• Processing - Full manga pages have more text density than typical game screens

This might be something to explore in the future, but for now I'd like to keep the focus on the video game use case.

[VorgonBattlecruiser]

that would be amazing if it could do that as well!
id use both in equal measure!

[rtr46]

besides performing worse on video games (since it isnt made for that), mangaocr also uses way more resources and has a much higher latency than meikiocr.

@bquenin you may want to checkout https://github.com/AuroraWright/owocr - it is a ocr middleware that lets you use microsoft ocr/apple ocr/glens/etc.... it supports outputting json incl. regions via websocket which makes it easy to integrate. that way you could give users some control/options about what ocr to use (though meikiocr is a pretty good default choice 💪 )

[olteanu-ca]

I tried using Interpreter for a game and Meiki was having trouble on almost every textbox. I ended up using a different program with Google Lens as the OCR.