3 ms·

I do the same, I make chrome extensions and my most recent extension uses a byo api key model for calls to an LLM. Means I can offer the service for free and n

I do the same, I make chrome extensions and my most recent extension uses a byo api key model for calls to an LLM. Means I can offer the service for free and not worry about hosting keys, serving ads, and storing users keys in a db. Everything can be done client side. Good to hear I’m not alone in the endeavour, what software are you building?

afiodorov 2y ago
I made two one-page react apps https://www.livetranslate.net/ https://www.livetranslate.net/ https://www.subsgpt.com/ https://www.subsgpt.com/ Second one is more refined but both are functional. I was pleasantly surprised somebody made a YouTube tutorial in Japanese about the latter https://www.youtube.com/watch?v=8gAkvZYayEc https://www.youtube.com/watch?v=8gAkvZYayEc - feels like retro internet where people share things on their personal webpages. Curiously the first one also landed me a contracting opportunity for a company that wanted to add live captions to their product and we went live with my help. I also made a decentralized twitter dapp ages ago but AI apps definitely have had more interest.
- slowmotiony 2y ago
  Do you think it would be possible to attach other language SRTs in the context? For example when translating English to Polish, the LLM has no idea whether the lines are spoken by a man or a woman, so the polish translation will be very confusing. However, if I could give the model both English and French subtitles, the gendered words from French would let the model avoid the confusion and the polish translation could be much more accurate. Does that make sense?