3 ms·
LLMs are not based on brute force algorithms. They are based on finding the best string of tokens (for text based LLMs) that would correspond to a prompt. To i
by JPLeRouzic 1y ago
LLMs are not based on brute force algorithms. They are based on finding the best string of tokens (for text based LLMs) that would correspond to a prompt.
To illustrate that you can see how DeepSeek "thinks". There are lots of "Given the instructions, if we", "Alternatively, we can ", "Also, if ", "wait", "but" etc...
- aurizon 1y agoBrute force is also comprehensive parametric exploration. Things a human programmer often shortens based on his analysis as well as to save time. The AI has the ability to use massive parallelism to run down these alleys versus sequential exploration - although a pass word 'guesser' can run 10,000 strings in parallel as well. Not quite the same as password exhaustive testing of all characters/lengths, but is related to it.