3 ms·
Starting with this post: https://community.home-assistant.io/t/using-gpt3-and-shorcuts-to-talk-with-home-assistant-in-a-very-smart-way/522908 https://community
by tmzt 3y ago
Starting with this post:
https://community.home-assistant.io/t/using-gpt3-and-shorcuts-to-talk-with-home-assistant-in-a-very-smart-way/522908 https://community.home-assistant.io/t/using-gpt3-and-shorcut...
I've been trying to adapt it to an offline LLM model, probably a LLaMA-like one using the llm package for Rust, or a ggml-based C implementation like llama.c.
It could even be fine-tuned or trained to perform better and always output only the json.
This could be a good fit with open sourced tovera when that is released.
I like the idea of supporting natural language commands that feel more natural and don't have to follow a specific syntax.
It can also process general LLM requests, possibly using a third-party LLM like Bard for more up to date responses.