inaciom

4 ms·

1.
Efficient LLM Inference (2023)(artfintel.com)
96 points by inaciom 3y ago|11 comments
2.
by inaciom 3y ago
Here's also the Github: https://github.com/try-reason/reason
3.
Show HN: RΞASON – Open-source TypeScript framework for LLM apps(tryreason.dev)
16 points by inaciom 3y ago|2 comments
4.
by inaciom 3y ago
Awesome! That'd actually be great — just a warning that the repo is a complete mess right now. If you need any help, feel free to contact me either on Github or in my email (inacio@hey.com).
5.
by inaciom 3y ago
Great question! The return value is not guaranteed to be correct. REASON uses function calling to force the model to return a valid JSON object; however, sometimes models hallucinate. For OpenAI models that have JSON mode, REASON uses that
6.
by inaciom 3y ago
That's weird. Can you access using this URL https://tryreason-www.vercel.app/ ? EDIT: if that also doesn't work, there is the documentation — which is where 99% of the info is: https://docs.tryreason.de
7.
by inaciom 3y ago
To me https://tryreason.dev is working. Which browser are you on?
8.
by inaciom 3y ago
Thanks for the feedback! :) Yeah, adding audio to the video would help — I'll try do record something later today and update it. When building LLM apps a good chunk of the workflow is testing new stuff and seeing what works or not, and
9.
by inaciom 3y ago
The website has a video demo in case you guys want to check it out: https://tryreason.dev
10.
Show HN: RΞASON – Open-source TypeScript framework for LLM apps(github.com)
7 points by inaciom 3y ago|11 comments