hdjdbdirbrbtv

3 ms·

1. 1.▲
   by hdjdbdirbrbtv 1y ago

   I am playing with open weights models at home and yeah they are like that ... I use Claude 3.7 @ work and yeah it is a lot better ... Sometimes it will flub things but it also can write large amounts of code ... Mostly how I want (the paret
2. 2.▲
   by hdjdbdirbrbtv 1y ago

   As a professional rust dev, I will say this, I don't notice. Generally because I am doing partial builds mostly. And when I am not the m1 max I have is fast enough to compile the project. Really there are much larger issues that I hav
3. 3.▲
   by hdjdbdirbrbtv 1y ago

   But also unfathomably large because of the speed at which you could consume it was measured in kbps....
4. 4.▲
   by hdjdbdirbrbtv 1y ago

   Project Binky (YouTube) ep 39 or 40 did this with their CNC mill
5. 5.▲
   by hdjdbdirbrbtv 1y ago

   Respectfully, I disagree. An llm in my mind is a new compiler. Just it takes natural language and produces code.
6. 6.▲
   by hdjdbdirbrbtv 1y ago

   So the issue with genetic algorithms / genetic programming is you need a good way to handle the path the population takes. It is more reinforcement than y = f(x) for deep learning f() is what the nn is computing. X and y is the traini
7. 7.▲
   by hdjdbdirbrbtv 1y ago

   Yes, one is committing knowledge to neurons, the other is commuting knowledge to short term memory. Put another way, if you took a llm with random weights. Do you expect you could rely on context alone?
8. 8.▲
   by hdjdbdirbrbtv 1y ago

   Lol thanks for the correction! like I said... it had been 20 years.. I misremembered the amounts :P
9. 9.▲
   by hdjdbdirbrbtv 1y ago

   Are you talking about teaching in the context window or fine tuning? If it is the context window, then you are limited to the size of said window and everything is lost on the next run. Learning is memory, what you are describing is an llm
10. 10.▲
    by hdjdbdirbrbtv 1y ago

    IIRC ( and it was 20 years ago now that I learnt this) the brain uses 20% of the body's resting energy usage. Most of that is keeping neurons polarised to the outside (ion pumps need ATP!!!). The body uses 25w resting and thus the bra