radarsat1

7 ms·

61.
by radarsat1 9mo ago
I was thinking mainly about the standard AR loop, yes I can see that grammars would make it a bit more complicated especially when considering batching.
62.
by radarsat1 9mo ago
I don't know what the pros are doing but I'd be a bit shocked if it isn't already done this way in real production systems. And it doesn't feel like porting the standard library is necessary for this, it's just some
63.
by radarsat1 9mo ago
> shows me exactly what I did I get that, but I guess what I'm asking is, why does it matter what you did? The result is working, documented source code, which seems to me to be the important part. What value does keeping the prompt
64.
by radarsat1 9mo ago
Right, I get that writing prompts is "the work", but if you run them again you don't get the same code. So what's the point of keeping them? They are not 'source code' in the same sense as a programming languag
65.
by radarsat1 9mo ago
I've thought about saving my prompts along with project development and even done it by hand a few times, but eventually I realized I don't really get much value from doing so. Are there good reasons to do it?
66.
by radarsat1 9mo ago
Reminds me of ColdFusion. Don't recall having a great time using it, though I was very young at the time so maybe my memory is distorted on this.
67.
by radarsat1 9mo ago
Heh, at least this wouldn't spread emojis all over my readmes. Hm, come to think of it I wonder how much tokenization is affected. Another thought, just occurred when thinking about readmes and coding LLMs: obviously this model wouldn
68.
by radarsat1 9mo ago
Something I wonder is, what happened to asm.js? It got killed by WASM. In a way this is good, WASM is a "better" solution, being a formal bytecode machine description, but on the other hand, asm.js would not have the same limitati
69.
by radarsat1 10mo ago
I find it really interesting that it uses a Mamba hybrid with Transformers. Is it the only significant model right now using (at least partially) SSM layers? This must contribute to lower VRAM requirements right? Does it impact how KV cachi
70.
by radarsat1 10mo ago
you're kind of describing the figure in table 1 (page 8) of the diffusion forcing paper https://arxiv.org/abs/2407.01392 of course it doesn't redraw the image on every step, so not exactly what you're su
71.
by radarsat1 11mo ago
Maybe what they should do in the future is just automatically provide AI reviews to all papers and state that the work of the reviewers is to correct any problems or fill details that were missed. That would encourage manual review of the A
72.
by radarsat1 11mo ago
A lot of "generative" work is like this. While you can come up with benchmarks galore, at the end of the day how a model "feels" only seems to come out from actual usage. Just read /r/localllama for opinions on
73.
by radarsat1 11mo ago
> fuzzifying logical computation? Isn't that basically what the sigmoid operator does? Or more in the direction of averaging many logical computations, we have random forests.
74.
by radarsat1 11mo ago
God of the gaps
75.
by radarsat1 11mo ago
Ah so nothing bad happening anymore due to people believing what they read on the internet, huh? Interesting take.
76.
by radarsat1 11mo ago
I would love to read more, but apart from not finding a lot of time lately, when I do read, it's fiction. Occasionally I have read a textbook on a topic I am really interested in, and I've read blogs and articles on various scienc
77.
by radarsat1 11mo ago
It is a strange phenomenon though, these walls of text that LLMs output, when you consider that one thing they're really good at is summarization, and that if they are trained on bug report data, you'd think they would reproduce i
78.
by radarsat1 11mo ago
This sounds more correct to me. I've read previously somewhere that better generalization is usually associated with wider, smoother minima, and this is why regularization is important, because it has a smoothing function on the loss l
79.
by radarsat1 1y ago
Location: Utrecht, The Netherlands Remote: Yes (Remote or Hybrid, EU Timezone) Willing to relocate: No Technologies: [Deep Learning] PyTorch, TensorFlow, MLFlow; [Languages] Python, C, C++; [Infrastructure] AWS, Docker, PostgreSQL, DynamoDB
80.
by radarsat1 1y ago
Just search for "chess LLM leaderboard" there are already several. Also check https://www.reddit.com/r/llmchess/ although admittedly it doesn't get a lot of traffic.
81.
by radarsat1 1y ago
one word: chairdogs
82.
by radarsat1 1y ago
That's exactly the problem in Europe though. It's quite the opposite here.
83.
by radarsat1 1y ago
I agree and honestly it may as well be considered a form of ABI incompatibility. They should make this explicit such that existing C extensions need to be updated to use some new API call for initialization to flag that they are GILless-rea
84.
by radarsat1 1y ago
what do you think vector databases are? absolutely. i think the idea of a database and a "model" could start to really be merged this way..
85.
by radarsat1 1y ago
Oh wow, finally! They should have done this 20 years ago but this is awesome news.
86.
by radarsat1 1y ago
I'm curious, what is the use case for open-ended labeling like this? I can think of clustering ie finding similar tweets but that can also just be done via vector similarity. Otherwise maybe the labels contain interesting semantics but
87.
by radarsat1 1y ago
it's literally the same technology as LLMs. Transformers were proposed for translation. (But I don't know what methods the Firefox translation uses. I assume it's a local model but don't even know that for sure.)
88.
by radarsat1 1y ago
> scalability needs a whole bunch of complexity I am not sure this is true. Complexity is a function of architecture. Scalability can be achieved by abstraction, it doesn't necessarily imply highly coupled architecture, in fact scal
89.
by radarsat1 1y ago
I see, not so clean imho but I guess it works.
90.
by radarsat1 1y ago
I got confused reading this because I wasn't sure how I, as a reader with no knowledge of the system under discussion, was supposed to know that all the buckets should be in the same region. Nor is it clear to me how the "for loop

More ›