3 ms·
Show HN: FormAIt – Free, private offline note formatting using LLMs
- properbrew 10mo agoCompletely free, offline note and text formatting using local LLMs. I write a lot of notes that end up unstructured and hard to reuse and make sense of. So the goal was to build a fast, easy, local-first way to turn rough input into usable text without sending anything to the cloud. Desktop builds are available for macOS, Windows, and Linux, with optional Windows/Linux CUDA builds for faster inference. Everything runs locally. Big shout out to https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp along with PyQt6, pdfplumber, pytesseract, and python-docx for making it easy to wire everything together. It uses an 8Gb Phi-4 model, however there's no reason you couldn't point to any other GGUF models you have. Still very much a work in progress, any suggestions welcome.
- deleted 10mo ago[deleted]