brrrrrm

13 ms·

181.
by brrrrrm 3y ago
Philosophy is a good tool to find very poetic and often quite succinct descriptions of what you might otherwise come to on your own. It also provides a shared language among people, although often at the expense of inclusivity
182.
by brrrrrm 3y ago
Why do you say “prompts” is the canonical trade secret?
183.
by brrrrrm 3y ago
Out of curiosity, why do you think the answer would be so simple and also completely untested?
184.
by brrrrrm 3y ago
Boo hoo? A predictable situation and an entitled/cocky developer. Sounds like he’ll get his other stuff back in due time
185.
by brrrrrm 3y ago
Any plan for web support? :)
186.
by brrrrrm 3y ago
mind boggling that 7B is now considered a small model. I think it's valid, given the preeminence of 70B+ sized models. But wow, the community really just leap frogged over single digit billion parameter sizes.
187.
Show HN: A 3D Stipple Plotter Built with Pyodide and Three.js(jott.live)
2 points by brrrrrm 3y ago|0 comments
188.
by brrrrrm 3y ago
Any recommendations on modern philosophy/literature that goes deeply into this stuff? "Bias" is of course a woefully under-defined and weaponized word.
189.
by brrrrrm 3y ago
Hierarchical attention gets you close https://arxiv.org/abs/2210.05529
190.
by brrrrrm 3y ago
how much faster is 3b in practice? Seems like an uncommon size, so it would make sense to have the title of "best 3b" lol
191.
by brrrrrm 3y ago
https://mistral.ai/news/announcing-mistral-7b/ looking at the 3b results (here https://github.com/Stability-AI/StableLM#stablelm-alpha-v2 ?), it looks like Mistral (which outperforms Llama-2
192.
by brrrrrm 3y ago
Curious how this compares to Mistral's release? 3b->7b doesn't seem like a huge leap and Mistral has shown phenomenal results for its size
193.
by brrrrrm 3y ago
Probably. I’ve had limited success getting LLMs (trained on chats/instruct) to output special codes indicating they’re communicating with a separate system (e.g. google, stable diffusion) and then taking that and feeding it back to th
194.
by brrrrrm 3y ago
Audio to text solves written word articulation, right? Besides this post is about vision, which also solves it.
195.
by brrrrrm 3y ago
> This is likely a compiler issue where the v0 += acc * v0 sequence couldn’t be converted into a FMA instruction. Err, is the ISA undocumented/impossible to inspect in the execution pipeline? Seems like an important thing to verify
196.
by brrrrrm 3y ago
I just want to see real un-hyped benchmarks. Comparing random Python native code makes no sense and seems dishonest, deterring me from actually trying out the tool. I want a Python that can statically plan underlying GPU allocations, avoid
197.
by brrrrrm 3y ago
I notice that a lot of really successful people speak quite quickly early in their careers. It's almost as if their own voices can't keep up with the excitement they have about their product/idea and they haven't quite
198.
by brrrrrm 3y ago
I think attempts to tease out this distinction is going to make these laws unwieldy to use in practice
199.
by brrrrrm 3y ago
What’s going to be the name used for the laws that attempt to tackle machine paraphrasing?
200.
by brrrrrm 3y ago
https://github.com/huggingface/candle/blob/main/candle-kerne... That’s the C++ variant of cuda, not Rust. They’re just binding it as one might in Python. At which point, what’s the value add?
201.
by brrrrrm 3y ago
At least with the more common modern ML (LLMs etc) operations, no one drops down to Rust. It's really only good for IO/CPU work, but that's rarely a spot for new operations, just for data loading and high-latency network stu
202.
by brrrrrm 3y ago
It's worth noting that these pre-built blocks are both convenient and incredibly flexible. Before I started getting my hands dirty, it was hard to really see this. For example, here's a masked gather operation along the innermos
203.
by brrrrrm 3y ago
I've come to the personal conclusion that the issue with compiled languages and machine learning is that the API surface is so big and the operations themselves are very self-contained. I find that I am not typically writing complex &q
204.
Ask HN: What is the implication of room-temperature super conductors?
2 points by brrrrrm 3y ago|3 comments
205.
by brrrrrm 3y ago
Without meaningful discussion of energy saving (flops per watt compared to Nvidia), this article is just an ad.
206.
by brrrrrm 3y ago
Pretty standard practice at this point right?
207.
by brrrrrm 3y ago
I'd start with the example of implementing the fastest reduction you possibly can. Pretty much all complexity in every kernel used in ML extends from this concept (reductions with addition). https://developer.download.nvidi
208.
by brrrrrm 3y ago
driving multiple GPUs on the same node is better handled by threads. Python is forced to use multiprocessing
209.
by brrrrrm 3y ago
Developer velocity is extremely important at FAANG scale.
210.
by brrrrrm 3y ago
The conversions are just a mask and shift? Super cheap

More ›