boppo1

37 ms·

751.
by boppo1 4y ago
3090 or 4090. That's it as far as LLMs go. You can run 13b on a 4080 but 13B sucks compared to 30B. And ROCm is a poorly supported hair-pulling nightmare.
752.
by boppo1 4y ago
I dunno, I just watched it and he almost immediately throws out the formality of the delta-epsilon definition and starts using infinitesimals. Thank god.
753.
by boppo1 4y ago
>Throwing blanket accusations of incompetence at the jury Clearly you haven't spent much time in the art world. The idea of competence is fundamentally opposed with the reigning ideology in fine art (as opposed to commercial art).
754.
by boppo1 4y ago
Who is making said hardware?
755.
by boppo1 4y ago
additional point of reference I don't know shit about ML or stats, and am a very weak programmer. I just know how to install programs on linux and use CLI in a basic fashion. I have had no problem getting llama.cpp going by following g
756.
by boppo1 4y ago
Get a 13900 or 7950X and 64 gb of ram. You can run llama 30B and 65B, slowly but surely. Play with that before buying a gpu. If you really, really see yourself getting into this, then go ahead and get a 3090 or 4090. But otherwise get a che
757.
by boppo1 4y ago
30B llama needs a 3090 or 4090. 13B I think you can get away with a 3/4080. If you have 64 gigs of ram and a beefy CPU you can run even 65B, but boy it's slow. 13B is pretty meh, but 30B is great, if not quite Chatgpt. But I can a
758.
by boppo1 4y ago
Have you actually tried running llama 13B on a phone? iirc mmap doesn't work as much magic as it was initially hyped to, but I've only tried it on my desktop. The initial model-load is faster, but inference is the same.
759.
by boppo1 4y ago
Tell me more. Real or anecdote?
760.
by boppo1 4y ago
Examples of 'failed-to-replicate-but-used-to-justify'?
761.
by boppo1 4y ago
A joke going around the finmeme world lately: What's the difference between a stripper and a realtor? 75bps.
762.
by boppo1 4y ago
I think langchain lets you do this.
763.
by boppo1 4y ago
Programmers like you are why I have to upgrade my computer every two years just to browse the web.
764.
by boppo1 4y ago
What about Slaren? https://rentry.org/Jarted
765.
by boppo1 4y ago
What will the defense be?
766.
by boppo1 4y ago
> I could probably teach a solid generalist who cared to get to the level of being able to dissassemble something and say, "yeah, this is dodgy" or not in an afternoon. Please write and post this guide.
767.
by boppo1 4y ago
Who ran the slave trade?
768.
by boppo1 4y ago
Any word on who has better vulkan support?
769.
by boppo1 4y ago
how do I turn on this feature flag? I'm quite happy on xubuntu.
770.
by boppo1 4y ago
Adding to this: I used AMD's official amdgpu tool to install ROCm and now my card is failing to be recognized on boot by ubuntu ~80% of the time, causing a failure to load lightdm & start up. Tomorrow I'll dig around in journa
771.
by boppo1 4y ago
What's the joke?
772.
by boppo1 4y ago
I use blender a lot. I know what the api can do. I'm not terrified. Getting anything significant done will still take real work/knowledge because the number of potential 'parameters' of what you can do/make requires
773.
by boppo1 4y ago
Can't get it to run on amd 6700xt even though there's ROCm installation instructions. Tried to run llama 7b but got hung up because bitsandbytes calls CUDA.
774.
by boppo1 4y ago
Oddly enough, 4chan is not part of that definition. There's an edgy 12 year old somewhere in my head cackling and gleefully shouting 'Let the good times roll!'
775.
by boppo1 4y ago
Or maybe his dad did all the early work.
776.
by boppo1 4y ago
Why do people use the phrase 'My brother in Christ' so often all of a sudden? Typically nonbelievers and the non observant.
777.
by boppo1 4y ago
Well, the guys on 4chan are making great strides toward a , uh, "loving" relationship.
778.
by boppo1 4y ago
Running models is one thing, but surely lots of power will remain with those who have the capital/hardware to train them?
779.
by boppo1 4y ago
If I'm using VS Code, am I opting in to sharing my code as training data?
780.
by boppo1 4y ago
QRD on what Kissinger had to do with this? I've no doubt he's a bad guy, but my schooling left out his involvement in cambodia.

More ›