4 ms·
Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a nat
by ubermon 2mo ago
Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a natively managed llama.cpp engine are all inside. No runtime dependencies, no node_modules, no account.
- Ante installs a pinned, checksum-verified official llama.cpp build matched to your machine (Metal on Apple silicon; CUDA, Vulkan, or CPU on Linux) and handles upgrades when the pin changes.
- It discovers GGUF files already on disk (~/.ante/models, the llama.cpp and Hugging Face caches), attaches to llama servers already running on local ports, and estimates RAM/VRAM from model size and context window before anything loads.
- `ante --offline-model /path/to/model.gguf "prompt"` boots the server, runs the session, and shuts it down. `/offline-mode` does the same interactively; `ante serve --offline-model` loads a model once for many clients.
- No API key, no account. Once the model is on disk, inference needs no network at all; set ANTE_TELEMETRY=off and no telemetry is exported either.
On capability, we'd rather publish the number than oversell: we benchmark local models with the same harness and auditable runs as frontier ones, and Qwen3.6 27B (a 17 GB download) scores 56.2% on Terminal-Bench 2.1 across 445 trials (live results: https://antigma.ai/eval https://antigma.ai/eval). That's a real gap from frontier models. The design bet is that you mix: hosted providers and local live in the same catalog, `/providers` switches mid-session, so sensitive repos or high-volume work go local and hard problems go frontier.
Hosted models work with your own keys or subscription. But nothing about trying Ante requires signing up for anything: download the binary, point it at a GGUF.
Offline mode is under active development and has rough edges with the overview at https://ante.run/local/overview https://ante.run/local/overview. I'll be in the comments.
- majorchord 2mo agoOpt-out telemetry is a hard no for me, sorry.
- stronglikedan 2mo agoRight? How hard is it to just ask a single opt-in question during installation. Opt-out just seems lazy, especially if I have to dig though configs to get to it.
- ubermon 2mo agofeedback received, it was carry over from the preview dev build.
- nextblock 2mo agoAgreed! When a tool is explicitely marketed for offline use, opt-out telemetry feels especially contradictory. Should Definitely be opt-in by default...
- abdullahk0634 2mo ago[dead]
- nazgulsenpai 2mo agoNot sure why this was dead but I vouched. It would be nice if telemetry was opt-in, otherwise this looks awesome and can't wait to try it!
- ubermon 2mo agowill add those soon!
- niutech 2mo agoWhy not make it Actually Portable Executable using Cosmopolitan Libc, like Llamafile, to make it run on Windows/Linux/MacOS? Why don't you support Windows with CUDA?
- adastra22 2mo agoWhere is the source code?
- ubermon 2mo agofor now only some of core crates is migrated, will do so progressively
- wwww23 2mo agoMany people have slow computers, but for agent it is no problem. Only run LLM slow too.
- ubermon 2mo agoyes. Offline mode is choice, should be able to run frontier one first and then figure out how do incorporate local models as real workhorse
- felooboolooomba 2mo agoHere you say: > Ante installs a pinned, checksum-verified official llama.cpp But in README: > Ante ships its own inference engine May I suggest you use the first phrasing in both places. I took it as Ante devs had written their own engine and I doubt I'm the only one.