4 ms·

> You have to very specifically fine tune it to understand what light conditions are, where you are in the house, and what it is you need to turn on. Where you

> You have to very specifically fine tune it to understand what light conditions are, where you are in the house, and what it is you need to turn on. Where you are in the house and what needs to turn on, at least, is an API query job, not a fine-tuning job. As far as whether it can understand the relevance of lighting to the situation, I just asked ChatGPT 3.5 the question 'Acting as an AI home assistant, if you hear me say "I'm finding it hard to read", what actions would you take?' and 'Adjust the lighting' was the second option it gave back (after 'ask for clarification'). I think we're there, honestly, we just don't have the different parts connected yet.

troupo 3y ago
> Where you are in the house and what needs to turn on, at least, is an API query job, not a fine-tuning job. And that API magically comes form where? > I just asked ChatGPT 3.5 the question 'Acting as an AI home assistant, if you hear me say "I'm finding it hard to read", what actions would you take?' So, basically: - you had to pre-program Chat GPT to act as a home assistant - you had to provide it with specific context and specific phrasing for it - it still failed, asked for clarification, and only then responded And now you have to this song and dance every time you want to coax GPT into doing what you need (and that's what RestGPT does).
- regularfry 3y ago
  > And that API magically comes form where? HomeAssistant, or any number of other providers. Do you think this part is somehow difficult? > you had to pre-program Chat GPT to act as a home assistant That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. > you had to provide it with specific context and specific phrasing for it That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. > it still failed, asked for clarification, and only then responded You have misunderstood. In its list of actions to take, the first and only response it gave, the first thing it said it would do in context is ask for clarification as to why I was finding it hard to read. That seems entirely reasonable to me. Does it not to you? > And now you have to this song and dance every time you want to coax GPT into doing what you need (and that's what RestGPT does). So what? It's not something the person sat in the dark ever has to care about.
  - troupo 3y ago
    > That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. > That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. Funny how we're in the discussion about context, and you decided to ignore and discard the entire context of the discussion :)
- selalipop 3y ago
  What you're describing as pre-programming is a little misleading if the "pre-programming" doesn't need to change for each specific request: a real product would provide that "pre-programming" for the user. Prompting for task performance is fine as long as you're not expecting the end user to have to replicate your prompting. Your goal is to change model activations for a given input, the end user is similarly affected regardless of if you used a prompt or fine-tuned. - This task doesn't require fine-tuning though, zero-shot performance is enough: I generated a mock schema from Home Assistant's API (https://data.home-assistant.io/docs/states/ https://data.home-assistant.io/docs/states/) and explicitly gave the model the option to ask for clarification, but it has no problem translating non-obvious commands into actions without asking for details: https://chat.openai.com/share/fc5b972f-4641-47a1-9842-2e0d690ec189 https://chat.openai.com/share/fc5b972f-4641-47a1-9842-2e0d69... Note those objects mirror Home Automation, you could hook that up today without any song and dance. Combine that with RAG and you'd have something that's a lot more useful than Siri and capable of improving performance over time.
  - troupo 3y ago
    We're back to "how is it different from Siri". You had to provide two pages of text and do manual mapping between human-readable names and some weird identifiers to provide the simplest functionality. Funnily, this functionality is also completely unpredictable. I ran your prompt and first request, and got "Identify the area with the lowest observed request volume and increase the brightness of the light in that area to improve the lighting." ChatGPT then proceeded to increase brightness in the garage. --- It's also funny how in the discussion about context the context of the app is forgotten.
    - omniglottal 3y ago
      Indeed, the context is "people using natural language to make requests". No soul on earth would consider/use your phrasing. I (a human) have clue what your request is for - "lowest observed request volume"...??? Try "raisr the lights where we usually aren't asking you for much" and you might get tge same result. As far as I can tell, brightness increase in the garage (where, I'd guess, you've made the least requests), the AI apparenyly understood better than you or I what you meant.

troupo 3y ago

> Where you are in the house and what needs to turn on, at least, is an API query job, not a fine-tuning job. And that API magically comes form where? > I just asked ChatGPT 3.5 the question 'Acting as an AI home assistant, if you hear me say "I'm finding it hard to read", what actions would you take?' So, basically: - you had to pre-program Chat GPT to act as a home assistant - you had to provide it with specific context and specific phrasing for it - it still failed, asked for clarification, and only then responded And now you have to this song and dance every time you want to coax GPT into doing what you need (and that's what RestGPT does).

regularfry 3y ago
> And that API magically comes form where? HomeAssistant, or any number of other providers. Do you think this part is somehow difficult? > you had to pre-program Chat GPT to act as a home assistant That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. > you had to provide it with specific context and specific phrasing for it That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. > it still failed, asked for clarification, and only then responded You have misunderstood. In its list of actions to take, the first and only response it gave, the first thing it said it would do in context is ask for clarification as to why I was finding it hard to read. That seems entirely reasonable to me. Does it not to you? > And now you have to this song and dance every time you want to coax GPT into doing what you need (and that's what RestGPT does). So what? It's not something the person sat in the dark ever has to care about.
- troupo 3y ago
  > That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. > That is what we call "a prompt". It is a well-known technique. I am surprised that this should look strange to you. Funny how we're in the discussion about context, and you decided to ignore and discard the entire context of the discussion :)
selalipop 3y ago
What you're describing as pre-programming is a little misleading if the "pre-programming" doesn't need to change for each specific request: a real product would provide that "pre-programming" for the user. Prompting for task performance is fine as long as you're not expecting the end user to have to replicate your prompting. Your goal is to change model activations for a given input, the end user is similarly affected regardless of if you used a prompt or fine-tuned. - This task doesn't require fine-tuning though, zero-shot performance is enough: I generated a mock schema from Home Assistant's API (https://data.home-assistant.io/docs/states/ https://data.home-assistant.io/docs/states/) and explicitly gave the model the option to ask for clarification, but it has no problem translating non-obvious commands into actions without asking for details: https://chat.openai.com/share/fc5b972f-4641-47a1-9842-2e0d690ec189 https://chat.openai.com/share/fc5b972f-4641-47a1-9842-2e0d69... Note those objects mirror Home Automation, you could hook that up today without any song and dance. Combine that with RAG and you'd have something that's a lot more useful than Siri and capable of improving performance over time.
- troupo 3y ago
  We're back to "how is it different from Siri". You had to provide two pages of text and do manual mapping between human-readable names and some weird identifiers to provide the simplest functionality. Funnily, this functionality is also completely unpredictable. I ran your prompt and first request, and got "Identify the area with the lowest observed request volume and increase the brightness of the light in that area to improve the lighting." ChatGPT then proceeded to increase brightness in the garage. --- It's also funny how in the discussion about context the context of the app is forgotten.
  - omniglottal 3y ago
    Indeed, the context is "people using natural language to make requests". No soul on earth would consider/use your phrasing. I (a human) have clue what your request is for - "lowest observed request volume"...??? Try "raisr the lights where we usually aren't asking you for much" and you might get tge same result. As far as I can tell, brightness increase in the garage (where, I'd guess, you've made the least requests), the AI apparenyly understood better than you or I what you meant.