rao-v

10 ms·

181.
by rao-v 9mo ago
I'm really charmed by this project (I know there are a few like it). In particular it's got a single ~600 line file ( https://github.com/robitec97/gemma3.c/blob/main/gemma3_kerne... ) with a clea
182.
by rao-v 9mo ago
I'm surprised this article doesn't provide a bigger list of calls that run on the gpu and further examples of what needs some cpu interop.
183.
by rao-v 9mo ago
Why don’t we just do this by default for threading in most languages? It’s pretty rare for me to actually want to do memory sharing while threading (mostly because of the complexity)
184.
by rao-v 9mo ago
Anybody know of a good service / docker that will do BM25 + vector lookup without spinning up half a dozen microservices?
185.
by rao-v 9mo ago
Do you know of a IDE that does this automagically?
186.
by rao-v 9mo ago
If every version of your OS ships with a default local model, it maybe interesting to see compression conditioned on the standard LLM weights
187.
by rao-v 9mo ago
Cowork + litellm proxy + a local vision LLM should work incredibly well for overnight organizing tasks organizing md files, photos etc.
188.
by rao-v 9mo ago
I'd really love a locally hostable limited version of this, so I can do some quick messing around before switching to the cloud version for long term usage. It cannot be too hard to spin up an API compatible version that just uses the
189.
by rao-v 10mo ago
The idea of what LLMs could do in CoreWars has been hanging around in the back of my head for a while now. So happy to see someone explore it systematically
190.
by rao-v 10mo ago
In a world where node based editors and code are also equivalent to LLMs, it's not super clear to me that the future will not be nicely visualized and understandable nodes (generated by the LLM to explain things to me and to get guiden
191.
by rao-v 10mo ago
ULAs don't keep you from every internet connection from your household being trivially linked to your GUA.
192.
by rao-v 10mo ago
There are lots of ways to run services without IPV6 transparently linking your service to every single other internet call that your household has ever made! I do it right now and have a little separability from my IPv4.
193.
by rao-v 10mo ago
There is not enough information in pasted code for a language server to indent pasted in python code. Try copy pasting a random stackoverflow snippet into deeply indented python code.
194.
by rao-v 10mo ago
Honestly the games issue might be out of day. Game devs have access to great services to punch through NAT at this point. Tech finds a way…
195.
by rao-v 10mo ago
I have to say it's just lovely seeing such a nicely crafted and written technical essay. It's so obvious that this is crafted by hand, and reading it just reemphasises how much we've lost because technical bloggers are too r
196.
by rao-v 10mo ago
I’d love to pay my ISP to rotate my ipv6 subnet every week. It’s not an option. My comcast IP changes every so often and that’s of some value. It’s very unclear to me why people should be able to deterministic reach out to a specific device
197.
by rao-v 10mo ago
I don’t know of a ISP that will randomize in anyway your v6. It’s tied to your account forever. It’s of some practical real world value that people cannot resolve v4 IPs to individual households with certainty. It’s a shame to lose that val
198.
by rao-v 10mo ago
One day Brython (python with braces allowing copy paste code to autoindent) will be well supported by LSPs and world peace will ensure
199.
by rao-v 10mo ago
What’s the pragmatic solution to ipv6 allowing everybody in my household to be trivially and stably mapped to a unique subnet? I like the accidental semi-randomization that ipv4 and ISP NAT offered and I don’t see anything like it short of
200.
by rao-v 10mo ago
Yeah I'd hope they were doing this, atleast in repos! Thought the mechanism was a little unclear in your specific example - did Github revoke Discord tokens?
201.
by rao-v 10mo ago
I'm a little frustrated with articles like this that scattershot their critique by conflating genuine failures with problems that even FAANGs struggle with. In particular, I don't love it when an article attacks a best practice as
202.
by rao-v 10mo ago
I’m surprised that GitHub, OpenAI etc. doesn’t have automation to scan the usual surfaces for hashes of their access tokens. It seems like a cheap and simple thing to offer your customers a little extra safety. Anybody interested in startin
203.
by rao-v 11mo ago
That makes sense ... is there a typical path? Basically - are they right in thinking it's a high risk thing for them or should I encourage them to take a shot? My understanding is that their time spent on the company before YC accepts
204.
by rao-v 11mo ago
I've got friends who tell me they'd never consider applying for YC because they are on a classic H1B with a tech company. What typically happens with folks on a H1B who make it into YC?
205.
by rao-v 11mo ago
I’d rather give an LLM the earnings report for a stock and the next day’s SNP 500 opening and see if it can predict the opening price. Expecting an LLM to magically beat efficient market theory is a bit silly. Much more reasonable to see if
206.
by rao-v 11mo ago
The general rule about computer fans is that the bigger they are the the quieter they are (i.e. 140mm > 120mm etc.) It's a wierd market gap that large "commercial" air moving fans are so loud.
207.
by rao-v 11mo ago
Unironically this
208.
by rao-v 11mo ago
Windows registry just sort of hovering in the backdrop
209.
by rao-v 11mo ago
Hey - good response! I'm sure you guys are thinking about this, but please just go through the steps of setting up via docker, uploading say a grad student's worth of papers and docs, scrape a small topic off wikipedia, try and us
210.
by rao-v 11mo ago
I was pretty excited for Onyx as a way to stand up a useful open source RAG + LLM at small scale but as of two weeks ago it was clearly full of features ticked off a list that nobody has actually tried to use. For example, you can scrape si

More ›