3 ms·
grep doesn't need tokens, so what is 98% fewer than zero?
by ludicrousdispla 5mo ago
grep doesn't need tokens, so what is 98% fewer than zero?
- stephantul 5mo agoYou need readfile to do something with those tokens. Grep only gives you the matching lines, not the context.
- djaboss 5mo ago`grep -C $NUM` ? ;)
- stephantul 5mo agoEven so. Take a look at the NDCG numbers for grep. It's not pretty
- hparadiz 5mo agoripgrep exists though
- stephantul 5mo agoThe comparison is with ripgrep, see the benchmarks.
- mrweasel 5mo agoWe might not be AI/agent enough for this product. I wondered about that as well, but it's not actually a grep problem, it's an ingest problem for agents. Apparently some agents use grep to navigate code and it's this "operation" that consume tokens, grep does in fact consume zero tokens.