4 ms·

GPT4 is really good at code and you can generally verify hallucination easily. The other good use cases are using LLM to turn natural language prompts into API

by TX81Z 3y ago

GPT4 is really good at code and you can generally verify hallucination easily. The other good use cases are using LLM to turn natural language prompts into API calls to real data.

LASR 3y ago
This is what I've been doing. GPT-4 to generate some data from some input, followed up by a 3.5T call to verify the output against the input to verify the content. You can feed the 3.5T output straight back into GPT-4 again and it will self-correct. Doing this a couple of times gives me 100% accuracy for my use case that involves some level of summarization and reasoning. Hallucinations are not as big of a deal at all IMO. Not enough that I'll just sit there and wait for models that don't hallucinate.
- adriand 3y ago
  This sounds interesting, can you detail this data flow a bit more and maybe provide an example?
simion314 3y ago
>GPT4 is really good at code for popular languages, though for JS it most of the time outputs obsolete syntax and code. Today i tried to do a bit of scripting with my son in Garrys Mod, it uses Expression 2 for a Wiremod module. GPT hallucinated a lot of functions and the worst part it switched almost each time from e2 to lua. It is good at solving homeworks for students, or solving popular problems in popular languages and libraries though it might give you an ugly solution and ugly code, it is probably trained on bad code too and it did not learn to prefer good code over bad code.
- TX81Z 3y ago
  I’ve been writing JavaScript for 25 years and have always felt it has utterly trash syntax. I’m not sure that’s 100% on GPT. (And I don’t mean to be rude - I just really hate that syntax!)
  - simion314 3y ago
    What I mean it will generate code using var instead of let or const like instead of a nice array.forEach it will create for(var i i mean use at least "let"
    - TX81Z 3y ago
      Yeah, same point I’m making - what other language declares variables like that? It’s a mess!

by TX81Z 3y ago

GPT4 is really good at code and you can generally verify hallucination easily. The other good use cases are using LLM to turn natural language prompts into API calls to real data.

LASR 3y ago

This is what I've been doing. GPT-4 to generate some data from some input, followed up by a 3.5T call to verify the output against the input to verify the content. You can feed the 3.5T output straight back into GPT-4 again and it will self-correct. Doing this a couple of times gives me 100% accuracy for my use case that involves some level of summarization and reasoning. Hallucinations are not as big of a deal at all IMO. Not enough that I'll just sit there and wait for models that don't hallucinate.

adriand 3y ago
This sounds interesting, can you detail this data flow a bit more and maybe provide an example?

simion314 3y ago

>GPT4 is really good at code for popular languages, though for JS it most of the time outputs obsolete syntax and code. Today i tried to do a bit of scripting with my son in Garrys Mod, it uses Expression 2 for a Wiremod module. GPT hallucinated a lot of functions and the worst part it switched almost each time from e2 to lua. It is good at solving homeworks for students, or solving popular problems in popular languages and libraries though it might give you an ugly solution and ugly code, it is probably trained on bad code too and it did not learn to prefer good code over bad code.

TX81Z 3y ago
I’ve been writing JavaScript for 25 years and have always felt it has utterly trash syntax. I’m not sure that’s 100% on GPT. (And I don’t mean to be rude - I just really hate that syntax!)
- simion314 3y ago
  What I mean it will generate code using var instead of let or const like instead of a nice array.forEach it will create for(var i i mean use at least "let"
  - TX81Z 3y ago
    Yeah, same point I’m making - what other language declares variables like that? It’s a mess!