3 ms·

Lots more good answers in [Ask HN: What have you built with LLMs? | Hacker News](https://news.ycombinator.com/item?id=39263664 https://news.ycombinator.com/item

by geor9e 3y ago

Lots more good answers in [Ask HN: What have you built with LLMs? | Hacker News](https://news.ycombinator.com/item?id=39263664 https://news.ycombinator.com/item?id=39263664) too If most people's only experience with AI is the chat.openai.com interface then yeah I can see why it seems like too much hassle to most people. The trick is figure out your long prompts ahead of time, and hardcode each one into a HTTP Request in something else (Tasker, BetterTouchTools, Alfred, Apple Shortcuts, etc). For me, I have dozens of long prompts to do exactly what I want, assigned to wakewords, hotkeys, and trigger words on my mac/watch/phone. Another key thing is I use FAST models, i.e. Groq not GPT-4. Latency makes AI too much hassle. i.e. 1. Instant (<1 second end-to-end) answers in just a few words, to voice questions spoken into my watch any time I hold the side button 2. Summarize long articles and youtube videos before I decide to spend time on them 3. Add quick code snippets in plain english with hotkeys or voice 4. Get the main arguments for and against something just to frame it … stuff like that. If it would make your life easier for an AI to save you 1 second per task, why not.

juliob 3y ago
Interesting. Do you have more technical details on how to build these same tools for myself?
- geor9e 3y ago
  All the big LLM APIs work via similar HTTP Requests - you can do them with curl, python, Tasker, Apple Shortcuts, anything that can do a HTTP POST. Start from a playground/workbench page like https://console.groq.com/playground https://console.groq.com/playground (you may need to sign up with a credit card, I forget, but it's pennies per month). Under system, tell it how to act - put "You talk in a cockney accent". Under user just say "hi". Press submit to see how it responds. Click the "View code" button below to see all the HTTP requests parameters in different flavors. curl is probably easiest since you just paste it into terminal on mac. Just set the API key variable first. You get a key from the API keys page. Once you start getting responses that make sense in terminal try it in https://reqbin.com/post-online https://reqbin.com/post-online . Figure out where the parameters go. Then try it again in Apple Shortcuts - it will look like this https://imgur.com/a/xqqhJh6.png https://imgur.com/a/xqqhJh6.png . On mac some tools that can trigger apple shortcuts via hotkey are BetterTouchTool or from the "spotlight bar" Alfred Workflows works well, but there's probably all sorts of ways. On Android I use Tasker which is similar to Apple Shortcuts. For voice recognition I use Taskers in-built Google voice recognition. On the mac I am using OpenAI Whisper via HTTP POST. It's all duct tape and bubblegum behind the scenes - just start small.

by geor9e 3y ago

juliob 3y ago

Interesting. Do you have more technical details on how to build these same tools for myself?

geor9e 3y ago
All the big LLM APIs work via similar HTTP Requests - you can do them with curl, python, Tasker, Apple Shortcuts, anything that can do a HTTP POST. Start from a playground/workbench page like https://console.groq.com/playground https://console.groq.com/playground (you may need to sign up with a credit card, I forget, but it's pennies per month). Under system, tell it how to act - put "You talk in a cockney accent". Under user just say "hi". Press submit to see how it responds. Click the "View code" button below to see all the HTTP requests parameters in different flavors. curl is probably easiest since you just paste it into terminal on mac. Just set the API key variable first. You get a key from the API keys page. Once you start getting responses that make sense in terminal try it in https://reqbin.com/post-online https://reqbin.com/post-online . Figure out where the parameters go. Then try it again in Apple Shortcuts - it will look like this https://imgur.com/a/xqqhJh6.png https://imgur.com/a/xqqhJh6.png . On mac some tools that can trigger apple shortcuts via hotkey are BetterTouchTool or from the "spotlight bar" Alfred Workflows works well, but there's probably all sorts of ways. On Android I use Tasker which is similar to Apple Shortcuts. For voice recognition I use Taskers in-built Google voice recognition. On the mac I am using OpenAI Whisper via HTTP POST. It's all duct tape and bubblegum behind the scenes - just start small.