3 ms·

I’ve actually found Sol delivers great results with Odin, despite there not being much Odin code available. I think it is able to work well with it because: -

I’ve actually found Sol delivers great results with Odin, despite there not being much Odin code available. I think it is able to work well with it because: - It is a rather simple language - It has a lot of very useful libraries already built in. With just a single main.odin file you can do a heck of a lot stuff, which LLMs seem to like.

aleph_minus_one 2mo ago
> I think it is able to work well with it because: > - It is a rather simple language - It has a lot of very useful libraries already built in. > With just a single main.odin file you can do a heck of a lot stuff, which LLMs seem to like. Also Wolfram/Mathematica has an insane amount of useful libraries already built in (there even exists the saying "Python is 'batteries included', Wolfram is 'spaceship included'"), and also there in a single file you can do a heck of a lot stuff. On the other hand: - LLMs tend to hallucinate non-existing function when you ask an LLM to code something in Wolfram that is not commonly done (concerning this point, nevertheless keep in mind that Wolfram is often used for "one-of-a-kind programs", i.e. for writing very specialized programs that have possibly never been done before). - Wolfram code tends to be quite dense. - If there is a small mistake in Wolfram code, the code typically simply won't work.
- petra 2mo ago
  Is there a way in Wolfram to check whether all function names exist ? And than give it as feedback to the llm?
  - aleph_minus_one 2mo ago
    > Is there a way in Wolfram to check whether all function names exist ? There is a way to check whether a symbol has been defined: ValueQ[FunctionName, Method -> "SymbolDefinitionsPresent"] See https://reference.wolfram.com/language/ref/ValueQ.html https://reference.wolfram.com/language/ref/ValueQ.html Replace FunctionName by the function name that you want to check.
ch4s3 2mo ago
It’s interesting I’ve been surprised by how well Claude sonnet can write code in a language I’m developing that probably has no code in the training set. It seems like anything with syntax like python/ruby/elixir is pretty LLM friendly, and layering on a HM type system seems to help catch most errors.

aleph_minus_one 2mo ago

> I think it is able to work well with it because: > - It is a rather simple language - It has a lot of very useful libraries already built in. > With just a single main.odin file you can do a heck of a lot stuff, which LLMs seem to like. Also Wolfram/Mathematica has an insane amount of useful libraries already built in (there even exists the saying "Python is 'batteries included', Wolfram is 'spaceship included'"), and also there in a single file you can do a heck of a lot stuff. On the other hand: - LLMs tend to hallucinate non-existing function when you ask an LLM to code something in Wolfram that is not commonly done (concerning this point, nevertheless keep in mind that Wolfram is often used for "one-of-a-kind programs", i.e. for writing very specialized programs that have possibly never been done before). - Wolfram code tends to be quite dense. - If there is a small mistake in Wolfram code, the code typically simply won't work.

petra 2mo ago
Is there a way in Wolfram to check whether all function names exist ? And than give it as feedback to the llm?
- aleph_minus_one 2mo ago
  > Is there a way in Wolfram to check whether all function names exist ? There is a way to check whether a symbol has been defined: ValueQ[FunctionName, Method -> "SymbolDefinitionsPresent"] See https://reference.wolfram.com/language/ref/ValueQ.html https://reference.wolfram.com/language/ref/ValueQ.html Replace FunctionName by the function name that you want to check.

ch4s3 2mo ago

It’s interesting I’ve been surprised by how well Claude sonnet can write code in a language I’m developing that probably has no code in the training set. It seems like anything with syntax like python/ruby/elixir is pretty LLM friendly, and layering on a HM type system seems to help catch most errors.