llm_trw

15 ms·

151.
by llm_trw 2y ago
Units tests save lives.
152.
by llm_trw 2y ago
I shudder to ask, but what exactly is a math pet?
153.
by llm_trw 2y ago
There are multiple providers for it since it's open source.
154.
by llm_trw 2y ago
Having tried using it, it is much worse than r1. Both the standard and high effort version.
155.
by llm_trw 2y ago
The cookbook is a work in progress by the looks of it.
156.
by llm_trw 2y ago
This is standard notation that's been used for decades. https://arxiv.org/abs/2402.01790v1
157.
by llm_trw 2y ago
Can someone explain what the point of ollama is? Every time I look at it, it seems like it's a worse llama.cpp that removes options to make things "easier".
158.
by llm_trw 2y ago
I know a number of people who were building AI systems that either completely dropped off the face of the earth or show up once every few months with an update then disappear again. Granted the majority of them are perverts whose main use c
159.
by llm_trw 2y ago
https://www.youtube.com/results?search_query=would%20you%20l...
160.
by llm_trw 2y ago
>HudZah was told that he could be killed by the high voltage, X-ray radiation and possibly other things. This only made him more excited. “My whole intention was, ‘If I fuck up, I’m dead, and this is why I should do it,’” he said. It sou
161.
by llm_trw 2y ago
Yes, but the r1 model is shiny and new. I've been using it locally for a day and I'm already finding odd spots. One thing that I've seen it do a number of times is get the correct answer in the thinking tokens, then ignore it
162.
by llm_trw 2y ago
There is nothing in the deepseek paper that suggests you can't use the order of magnitude in hardware costs you saved to just train models that are ten times as large.
163.
by llm_trw 2y ago
>This is all ignoring the fact that if the h800 was good enough amd's top line cards should be too. You can't pay me to use AMD cards. I have work to do. I don't have time to write drivers for cards that no one supports. T
164.
by llm_trw 2y ago
I can't wait for the 2000 dot com crash for AI. What gets me about the deepseek work is that it's neither novel or theoretically difficult. I've been using a similar synthetic data pipeline to generate examples for sota bert
165.
by llm_trw 2y ago
Having read the paper from deepseek I seriously don't get how anyone can think "Oh now is the time to sell nvidia". Both at the tactical level and strategic level that paper means we will see _more_ nvidia gpus fly off the sh
166.
by llm_trw 2y ago
>Pony Stark is absolutely a Nazi >Your Klansplaining is ridiculous >wtf is wrong with you! Ah blue sky, keeps reminding me why I left a day after I signed up.
167.
by llm_trw 2y ago
Did the introduction of assemblers lead to creating more or fewer programming jobs?
168.
by llm_trw 2y ago
The only people who think that Ai models won't result in more demand for human labour are the ones who have never used them.
169.
by llm_trw 2y ago
End result is on par with o1 preview, which is ironically more intelligent than o1, but the intermediate tokens are actually useful. I've got it running locally last night and out of 50 questions so far I've gotten the answer in t
170.
by llm_trw 2y ago
Jesus we are reaching levels of blinking for torture of these models: https://www.youtube.com/watch?v=WZ256UU8xJ0
171.
by llm_trw 2y ago
It's hardly more brute force than using a trillion parameter model in the first place.
172.
by llm_trw 2y ago
The distils run on the same hardware as the llama models they are based on llama models anyway. The full version... If you have to ask you can't afford it.
173.
by llm_trw 2y ago
>There is still no mechanism in GenAI that enforces deductive constraints (and compositionality), ie., situations where when one output (, input) is obtained the search space for future outputs is necessarily constrained (and where such
174.
by llm_trw 2y ago
An rag model can already sort your email. Its just that it costs too much to do that for the hoi polloi who think everything digital should be free forever.
175.
by llm_trw 2y ago
Llama is worse than gpt4 because they are releasing models 1/50th to 1/5th the size. R1 is a 650b monster no one can run locally. This is like complaining an electric bike only goes up to 80km/h
176.
by llm_trw 2y ago
I use qubes. A corporate antivirus is a rather large step down.
177.
by llm_trw 2y ago
It's because people now treat parties like they used to treat football teams.
178.
by llm_trw 2y ago
ML workloads where I can do a few epochs locally to see where the data is going wrong before running the full training run in the data center.
179.
by llm_trw 2y ago
Ones without a straitjacket of bureaucracy. It's not like I can't exfiltrate all their data with a python script and a web cam.
180.
by llm_trw 2y ago
The hardware costs tens of billions. The electricity cost is around what you guessed.

More ›