janalsncm

7 ms·

151.
by janalsncm 3mo ago
The first of the two steps is a web search. The model didn’t answer from its trained weights.
152.
by janalsncm 3mo ago
Sure, go ahead and ask the LLM who won the 2026 World Cup. Or nearby BBQ places open now. Even assuming no hallucinations, an LLM can replace some use cases for search but not all.
153.
by janalsncm 3mo ago
It’s a different topic but it’s correct imo. Open sourcing things is the best way to accelerate development. Put another way, if you want to slow things down, put it behind a paywall, tag ideas ans “intellectual property” (meaning you’re th
154.
by janalsncm 3mo ago
Deepseek is funded by their hedge fund, high flyer. They intentionally cap their token prices to basically recoup server costs. The meeting transcript describes it as a moral commitment, that they don’t care about trends like image and vide
155.
by janalsncm 3mo ago
Deepseek’s R1 paper was the first paper to describe how to do it. O1 was released before R1 came out. A month before the R1 paper came out, they released the Deepseek math paper which described their method for MoE load balancing.
156.
by janalsncm 3mo ago
Many of the Chinese optimizations are public because they are published by the Chinese labs themselves. Hard to say what the labs are doing of course.
157.
by janalsncm 3mo ago
Open your app in the iOS emulator and push the screenshot button. Upload that. What you have now is marketing material.
158.
by janalsncm 3mo ago
Either you need to understand how your codebase works or you don’t. Claude can write the code for you but it can’t understand it for you. That part has to happen at human speeds. There are cases where you don’t have to understand everything
159.
by janalsncm 3mo ago
> nobody on the internet is really in a position to judge We don’t need to adjudicate the theoretical question of whether some vision-only system can meet the performance of vision + other modalities. Tesla FSD is not a research experime
160.
by janalsncm 3mo ago
Yeah apparently Opus and Sonnet are like that.
161.
by janalsncm 3mo ago
It’s a good idea. The results probably depend a lot on how close your task is to the benchmarks though. I think OpenAI already has (had?) a feature like this called “auto” mode for thinking.
162.
by janalsncm 3mo ago
Intuitively, your savings depend heavily on how hard the tasks are in the first place. If you have a base rate where 99% of your tasks can be routed to a cheap model, yeah, you can save a ton by not using Fable for that. So “1/3 the co
163.
by janalsncm 3mo ago
In MoE systems the routing decision is made per-token, not per prompt or task. It’s one of ML’s many confusing naming conventions. Even more confusingly, there are older pre-LLM MoE systems which ensemble and pool the predictions from multi
164.
by janalsncm 3mo ago
An example would be setting batch size too high causing OOM which isn’t really a python problem.
165.
Git Koans(stevelosh.com)
5 points by janalsncm 3mo ago|2 comments
166.
by janalsncm 3mo ago
It’s really hard to feel bad for these Web 2.0 platforms that made money off of free content and are now enshittifying on top of it. I stopped using Reddit when they blocked 3rd party apps and forced people to use their first party ad-ridde
167.
by janalsncm 3mo ago
Worth stating that this is one of the success stories from AI. Someone who has domain expertise outside of programming is able to create a really useful piece of software because the barrier to entry has been significantly lowered. Really n
168.
by janalsncm 3mo ago
Not really. Quality nonfiction books are a subset of quality books.
169.
by janalsncm 3mo ago
Checks out. China has 10,000 TWh, the US only has 4,000.
170.
by janalsncm 3mo ago
Your question is a little like asking why we arrest arsonists when there are fires to put out. The law does not need to choose.
171.
by janalsncm 3mo ago
If you are training an LLM, you need to tokenize the text before it’s trained on. A lot of time this can be done in parallel with the GPU though. I have spent way too much time waiting 10-15 minutes tokenizing my training dataset only for t
172.
by janalsncm 3mo ago
It is guaranteed to work worse than top_k=1, that’s for sure.
173.
by janalsncm 3mo ago
> China can keep up because it's cheaper to run a frontier lab there Not sure if this is what you meant, but their training runs are significantly cheaper. This was one of the big shockers from the Deepseek R1 paper. US foreign poli
174.
by janalsncm 3mo ago
Yes, the human actors in your scenario were the ones who built the autonomous cannon and turned it on while knowing that 1) a good neighbor does not destroy their neighbor’s property 2) cannons can destroy property. Also OpenAI specifically
175.
by janalsncm 3mo ago
It would be a pretty big plot twist if we found out that Shai Halud was a worm created by GPT during testing.
176.
by janalsncm 3mo ago
Absolutely bewildering. If I am building a giant cannon and blow a hole straight through my neighbor’s house, I’m not going to say “we are working with our neighbors to improve their giant cannon defenses”. OpenAI brought this weapon and as
177.
by janalsncm 3mo ago
By Anthropic. The government blocked it after it was already released. Every LLM product goes through testing and alignment after training, maybe even some quick improvements here and there. Kimi probably did something similar. Put another
178.
by janalsncm 3mo ago
I’m glad you only find crime “annoying”. Others find it oppressive. For example the murder rate in New York City (a similarly dense urban area) is around 35-50x the rate of Singapore. This means your chance of being murdered within the firs
179.
by janalsncm 3mo ago
That and/or the business case isn’t as clear when serving enormous models? You’re constantly stuck in a red queen’s race where your profitability window is increasingly measured in weeks because the Chinese are right behind you. For sm
180.
by janalsncm 3mo ago
There are two separate types of events with associated probabilities: 1) the probability of being harmed by criminals, and 2) the probability of being harmed by the government. For most people in most places, police are ineffective and ther

More ›