3 ms·
"I’ll probably write an elisp function to send the output to GPT and insert the results into the buffer" I suggest taking a look at my LLM command-line tool. I
by simonw 3y ago
"I’ll probably write an elisp function to send the output to GPT and insert the results into the buffer"
I suggest taking a look at my LLM command-line tool. It's great for cobbling together these kinds of things, because you can use whatever shell integration your environment has to pipe things to it.
cat bad-dictation.txt | \
llm -m gpt-4-turbo --system '
You are going to correct for text that
has been produced by voice recognition
software. Rewrite any text provided to
you. The text will not have punctuation,
so please add where needed. If the text
has the word period, then insert a
period, and do not insert another one
just before or after. If the text has
“new line” or “newline”, insert a newline
character and start a new paragraph. If
the text says “comma”, insert a comma. If
the text has a number spelled out,
replace it with the actual number. So
“five thousand” becomes “5000”. Also, if
something seems off in the text, it was
probably due to a misrecognized word.
Please correct for it.' > out.txt
Should be easy to call that from elisp, and you can then install plugins to have it talk to other models like Claude or Llama 3: https://llm.datasette.io/en/stable/plugins/directory.html https://llm.datasette.io/en/stable/plugins/directory.html
- fzzzy 3y agoThanks a lot for llm, Simon. I've started to integrate it more and more in what I do as an abstraction layer over llm apis. By the way, do you know of any models that support streaming input tokens to reduce latency to output tokens?
- BeetleB 3y agoI wrote it in December, when I was none the wiser. I've already got an elisp function (using whisper now for the backend - which has some cons to it). In fact, it's fairly common for me to use the combination of Whisper and GPT to compose emails, etc. I should do a followup post on my setup. Interestingly, Simon, I also submitted another story[1] where I refer to your shot-scraper. You're the gift that keeps on giving (especially given that my first programming job was with Django in 2008!) [1] https://news.ycombinator.com/item?id=40174802 https://news.ycombinator.com/item?id=40174802
- jilijeanlouis 3y agoBTW I’ve heard from researchers from a big GAFAM (can’t name) that they actually use gpt to do this on the ground truth and spot that correction and do a second pass of human labelling on the ground truth to have better dataset.
- tedmiston 3y agoThanks for sharing this! Direct link to the repo for those curious - https://github.com/simonw/llm https://github.com/simonw/llm