spindump8930

5 ms·

1.
by spindump8930 8d ago
Yes, but even nvidia doesn't have unlimited gpus. Everything they hold for internal teams is a reduction in revenue and customers can have aggressive commitments.
2.
by spindump8930 10d ago
This is one of the jagged mismatches between users and LLM developers. The median user doesn't care or want to know about static models and knowledge cutoffs and whether a model can do tool calls or if tool calls even happened. They ju
3.
by spindump8930 10d ago
It can be quite hard to determine what needs a tool call or not. LLMs are not well calibrated to what they know and don't know, and tool calls can add latency and extra costs. There are lots of things that are "obvious" right
4.
by spindump8930 11d ago
Clem knows they have the community support and potential legal leverage here. It's not unreasonable to ask for a lot. It's in everyone's interests to play nice. Huggingface could do a lot with more compute, even with nvidia b
5.
by spindump8930 12d ago
If you take the recent anthropic misuse report seriously, they don't need to "take over weapons" because they're actively being used to give a lift in capability to groups who already want to use weapons. > The six ca
6.
by spindump8930 12d ago
This is likely being discussed because it's relevant to this similar modern day story involving Tesla: https://news.ycombinator.com/item?id=49686766
7.
by spindump8930 15d ago
Sure. But that was months ago, and not the newsworthy event scoped to "The Last 24 Hours" as the title says :)
8.
by spindump8930 15d ago
> Maybe you’ve already heard about the guy who resigned from OpenAI. While he worked at both OpenAI and Anthropic, he resigned from Anthropic. Mistaken reporting in the first few sentences, definitely a horror concept.
9.
by spindump8930 15d ago
That might be true, but nothing else has been as effective at accelerating model development and research sharing. In earlier circles they were known as the "pytorch-pretrained-bert" guys, still under the huggingface company name.
10.
by spindump8930 16d ago
"Improve the model for everyone" can be implemented in so many ambiguous ways. https://news.ycombinator.com/item?id=49643513
11.
by spindump8930 16d ago
Reminder that there are degrees of "trained on conversations". From John Schulman: > pretrain on user data, with users' tokens as prediction targets: high regurgitation risk, improper > use user prompts to distill large
12.
by spindump8930 16d ago
The canary string was more about inadvertent scraping or analysis in other papers. Not direct training on user data. And the use of BB has eroded quite a bit, with BB-Hard or other variants being typically used.
13.
by spindump8930 21d ago
Commenters in these discussions always confuse wikipedia editors with Wikimedia employees - this is the latter!
14.
by spindump8930 22d ago
Folks are concerned that nvidia won't support these efforts if it gets models running on competing hardware. Two responses: - The projects started without HF/nvidia involvement and were massively successful BECAUSE folks want to r
15.
Lab Policy on AI in Writing and Communication(cs.columbia.edu)
2 points by spindump8930 22d ago|0 comments
16.
by spindump8930 23d ago
Care to comment on this model from a quite serious company being labeled as derived from GLM? Also, do you have a source for: "99% certainly european chips, almost certainly EIC-funded. (Eg. Hailo, Axelera, ..)" For Hailo, the bes
17.
by spindump8930 23d ago
On Artificial Analysis it's listed as "Quasar 438B (max, based on GLM-5.2)" - so you see exactly right. Not sure if this was changed post publicity drive or not, this is the first I'm seeing about this model. https:&#x2
18.
by spindump8930 1mo ago
> While fishers predominantly use the method to catch fish for sale at local markets — identifiable by their ruptured internal organs and burst swim bladders The article agrees, assuming "here" is global north tech workers.
19.
by spindump8930 3mo ago
I agree with your recomendation, but converting a pdf to an image is by no means smaller. PDFs are much closer to SVGs then to jpegs.
20.
by spindump8930 3mo ago
> Claude and ChatGPT are both blocked in China So it's presumably cheaper than attempting to spin up your own method of circumventing the blocks.
21.
by spindump8930 4mo ago
Exactly. Good peer reviewers understand that you can also move down on the scaling curve, not just up. Also laughable to try a "yolo" run without validating a scaling ladder/curve.
22.
by spindump8930 4mo ago
Can you share the specific part of this work that demonstrates better scaling than original transformers? Also note that many of the changes to that architecture, that have been proven in their use at actual scale, were brought about by mem
23.
by spindump8930 4mo ago
That's why you do several small and medium scale tests, fit a curve, and ideally show that the trend persists at several scales. Not a single large or medium run - see the other comments down thread for example sizes.
24.
by spindump8930 4mo ago
I think folks looking for more on this incident are better off reading the original threads linked elsewhere in the comments. This blog doesn't seem to add any information and is instead a narrative retelling of some documented events.
25.
by spindump8930 5mo ago
Likely in this case the time vault was the collapse of Mt Gox, which has now recently been paying back holders.
26.
by spindump8930 5mo ago
Some combination of reporting bias given concerns about LLM security capabilities and actual new vulnerabilities found with LLM assistance. Even if exploits and outages are unrelated to LLMs, I'm certainly thinking about whether claude
27.
by spindump8930 5mo ago
It's very common if you improperly seed, as others in the thread brought up! Or in your framing, as rare as earth getting hit if it were surrounded by a sci-fi density asteroid field.
28.
by spindump8930 5mo ago
Sure, this is cute and interesting, but there's no validation or baselines and those examples are not particularly compelling. The o3 example just lists some terms!
29.
by spindump8930 5mo ago
Between the neo and the chances for privacy respecting local model inference, all the new apple hardware has me excited.
30.
by spindump8930 5mo ago
That artificial analysis page has some great references for this, thanks for sharing.

More ›