3 ms·

Ocrbase is CUDA only while dots.ocr uses vLLM, so should support ROCm/AMD cards?

• actionfromafar 9mo ago
  How about CPU?
  • jasonni 9mo ago
    dots.ocr requires requires a considerable amount of computational resources. If you have Mac device with ARM CPU(M series), you can try my dots.ocr.runner(https://github.com/jason-ni/app.dots.ocr.runner https://github.com/jason-ni/app.dots.ocr.runner). There is a pipeline solution with multiple small specific models that can run only with CPU: https://github.com/RapidAI/RapidOCR https://github.com/RapidAI/RapidOCR
    • sgc 9mo ago
      Jason, your runner looks interesting. I am using debian linux on my laptop with an intel cpu and nvidia gpu (proprietary nvidia cuda drivers). Should I be able to get it working? What is your speed per page at this point? Thank you