visarga

47 ms·

871.
by visarga 2y ago
Those are a cancer on YouTube, they don't offer any way to disable the shit. And on mobile it's even worse, there is a dedicated tab button you can't hide, even if you are a paying customer no way to avoid it.
872.
by visarga 2y ago
Sounds like "people who are not physically similar to me are p-zombies relative to me". By the same rule even our past selves are p-zombies relative to present selves, they could not possibly imagine our feelings as they lack the
873.
by visarga 2y ago
I signed up and right from the start I have -3 words left. LOL
874.
by visarga 2y ago
> Model weights are something like a bytecode blob Can you update a bytecode blob as easily as finetuning and prompting models? It only takes a few input-output pairs and a few dollars worth of compute. They are more like an operating sy
875.
by visarga 2y ago
Yes, the smart toys are search, code execution, simulations and games.
876.
by visarga 2y ago
> this stuff isn't making a qualitative leap into emergent anything. The magical missing ingredient here is search. AlphaZero used search to surpass humans, and the whole Alpha family from DeepMind is surprisingly strong, but narro
877.
by visarga 2y ago
Well parrots can make more parrots, LLMs can't make their own GPUs. So parrots win, but LLMs can interpolate and even extrapolate a little, have you ever heard a parrot do translation, hearing you say something in English and translati
878.
by visarga 2y ago
> GPT and LLM are very interesting but say little or nothing to me of new theory of mind, or display inductive logic and reasoning, or even meet the bar for a philosophers cave solution to problems. The simple fact they can generate lang
879.
by visarga 2y ago
> Thinking of the OCR vendors who get replaced. Where might they go? We are solving more complicated document types, in more languages, longer in size. The scope of work expanded a lot.
880.
by visarga 2y ago
OCR is not 100% either. Reading order is also fragile, it might OCR the word but mess up the line structure.
881.
by visarga 2y ago
I think creativity comes from search, inspiration or discoveries from the environment. Creativity is basically searching and stumbling into novel ideas. Creativity doesn't come from the brain itself, the brain is just exploring and acc
882.
by visarga 2y ago
> There's nothing special about an LLM, there's no learning The model is 100-500x smaller than its training set. That is something hinting at learning, as direct storage is impossible.
883.
by visarga 2y ago
> R1-Zero removes the human bottleneck I disagree. It only removes the bottleneck to collecting math and code reasoning chains, not in general. The general case requires physical testing not just calculations, otherwise scientists would
884.
by visarga 2y ago
I prefer prose because it has better flow. Usually I have to specify this manually or the LLMs will happily generate bulletpoints and listicles. More recently I prefer chain-of-thought prose to the final answer. I can trigger it with a prom
885.
by visarga 2y ago
> the ability for a company like OpenAI to collect novel data from interacting with real humans is a material advantage over their competition It's different kind of data from the R1 reasoning chains. When LLMs have human in the loo
886.
by visarga 2y ago
> I wonder if there is a cap to multi head attention architecture I don't think there is a cap other than having good data. The model learns all languages in the world, it has capacity. A simple model like AlphaZero beats humans at
887.
by visarga 2y ago
> This assumes that you give honest feedback. You don't need honest user feedback because you could judge any message part of a conversation using hindsight. Just ask a LLM to judge if a response is useful, while seeing what message
888.
by visarga 2y ago
The view is created by every spectator.
889.
by visarga 2y ago
> that's a bit like saying that by painting a a bare wall green you have demonstrated that you can build green walls 27x cheaper, ignoring the cost of building the wall in the first place That's a funny analogy, but in reality
890.
by visarga 2y ago
They stole the data just as much as a painter steals the view.
891.
by visarga 2y ago
R1 stands out not just because of efficient training, but because it created its own training data. Works similar to AlphaGo - it tries to solve problems, and has a way to check when the result is correct. The trick is to let it run more, t
892.
by visarga 2y ago
> Just kidding, we all know it's stolen. This thief has small pockets, about 500x smaller than the "stolen" material. Where to stash all that?
893.
by visarga 2y ago
> You will need to have all parts involved open-sourced to make a model "open", not just the weights How do you propose to opensource terabytes of web scrape text? They give you what they can give you - paper, code, model weigh
894.
by visarga 2y ago
> so this is a PySpur ad, alright They should have also posted the PySpur pipeline, it would be interesting to see the agentic flow they used in this article. I am doing a lot of this kind of worflows manually, copy pasting stuff, I&#x27
895.
by visarga 2y ago
I don't like formatting in bullet points and listicles much, but the contents are pretty good, they cover many papers in a lightweight way, you can get a decent overview in 10 minutes for what would take hours to research.
896.
by visarga 2y ago
> But why wouldn't Sam Altman or whomever just start AI Ycombinator with hundreds of thousands of AI "founders"? Do you really think it would be more "democratic"? AI is useful in the same way with Linux - can ru
897.
by visarga 2y ago
Since everyone has AI, then it stands that humans still make the difference. That is why I don't think companies will be able to automate software dev too much, they would be cutting the one advantage they could have over their competi
898.
by visarga 2y ago
In the AI age, those who own the problems stand to own the AI benefits. Utility is in the application layer, not the hosting or development of AI models.
899.
by visarga 2y ago
> It requires no skill, no intuition, no mastery Next time you use generative AI try to use a prompt and iterate on it. We usually prompt generative AI, maybe you are using it without prompting. Who knows.
900.
by visarga 2y ago
Maybe it's a negative for you if you already have marketable skills, but a positive for others who want to get in.

More ›