golol

7 ms·

91.
by golol 2y ago
But why would the dataset be worse, they can just use the same one as before.
92.
by golol 2y ago
Do you want household androids? Because this kind of stuff is on the level of research a bery large step towards that. Think as it as ab example where we can make a model understand a lot of physical common sense stuff, which is the goal fo
93.
by golol 2y ago
I disagree. With more computation you can train a bigger model on the same size training data and it will be better. There is a lot if knowledge on the internet that GPT-4 etc. have not yet learned.
94.
by golol 2y ago
I learned that 1 / e is the limit probability of a permutation not having any fixed points, nice.
95.
by golol 2y ago
I don't like the way LLM papers are written. LLMs receive inputs and produce outputs that are best represented as plaintext with some special characters. Simply showing a few examples of the agent's core LLM text continuation job
96.
by golol 2y ago
>pollute Seriously? You can't blame Google for its emissions.
97.
by golol 2y ago
Why? What disaster? There can be no disaster when the product is free and there are many free alternatives with equal capability except for small conveniences. If you don't like Chrome because Google is being shady you can immediately
98.
by golol 2y ago
My understanding of this is the following: All the bad models are chat models, somehow "generation 2 LLMs" which are not just text completion models but instead trained to behave as a chatting agent. The only good model is the onl
99.
by golol 2y ago
You can still do this. People just lost interest in this stuff because it became clear to ehich degree the simulation is really being done (shallow). Yet I do wish we had access to less finetuned/distilled/RLHF'd models.
100.
by golol 2y ago
Sorry this is just consiracy theorizing. I've tried jt with GPT-3.5-instruct myself in the OpenAI playeground where the model clearly does nothing but auto-regression. No function calling there whatsoever.
101.
by golol 2y ago
You have to get the model to think in PGN data. It's crucial to use the exact PGN format it sae in its training data and to give it few shot examples.
102.
by golol 2y ago
I've tried it myself, GPT-3.5-turbo-instruct was at least somewhere in the rabge 1600-1800 ELO.
103.
by golol 2y ago
Because it's a straight forward stochastic sequence modelling task and I've seen GPT-3.5-turbo-instruct play at high amateur level myself. But it seems like all the RLHF and distillation that is done on newer models destroys that
104.
by golol 2y ago
As I understand the whole point is that it is not so simple to tell the difference between the model forgetting information and the model just learning some guardrails which orevent it from revealing that information. And this paper suggest
105.
by golol 2y ago
Well the robot is that machine....and much more.
106.
by golol 2y ago
You know, it doesn't really matter to the original point. If the middle class is doing okay or if it's struggling, either way household androids and more generally less labor scarcity are exactly the kind of thing that will improv
107.
by golol 2y ago
It was not. Maybe measured in relative terms the middle class is shrinking due to income inequality, but in absolute terms I am fairly confident it is at worst stagnating in America and western Europe. In many parts of the rest of the world
108.
by golol 2y ago
Between the first half and the last sentence of your post is a giant leap of conclusion.
109.
by golol 2y ago
The ever expanding middle class of course.
110.
by golol 2y ago
Inbetween the current world full of labor scarcity, and the philosophical dilemma "what do I even do" post-scarcity utopia, is a world similar to our current one with much less labor scarcity and much more quality of life. That&#x
111.
by golol 2y ago
I saw your foundation model is trained on data from several different robots. Is the plan to eventually train a foundation model that can control any robot zero shot? That is, the effect of actuations on video/sensor input is collected
112.
by golol 2y ago
Idk this is really promising, how many robot foundation models have you seen before that also work very well? I believe this is all quite recent.
113.
by golol 2y ago
This is a duplicate thread. Can some mod merge them oO? I don't know how this works on HN.
114.
by golol 2y ago
Isn't this a real big deal? They manage to train a foundation model that connects the physical understanding gained from unsupervised training on images and videos with the real physical understanding necessary to control a robot. They
115.
by golol 2y ago
>tests to prove its safety should be done in a way where gathering statistics doesn’t mean killing people. Honestly, I believe that in the noisy world this is exactly how you do things. You try it out. We've done it for hundreds of
116.
by golol 2y ago
I think there is only one thing we should focus on: Measurable capability on tasks. Understanding, memorization, reasoning etc. are all just shorthands we use to quickly convey an idea of a capability on a kind of task. Measurable capabilit
117.
by golol 2y ago
I suppose it is the following: 1. Maybe they didn't over-hire but instead the economic conditions changed. 2. Maybe instead of gradually letting go of people it is best to wait and then strike once and hard.
118.
by golol 2y ago
This is a prompt I gave to o1-mini a while ago: My instructions follow now. The scripts which I provided you work perfectly fine. I want you to perform a change though. The image_data.pkl and faiss_index.bin are two databases consisting of
119.
by golol 2y ago
yea I prett much agree
120.
by golol 2y ago
Easy to say but does that really represent the statistical reality? Does higher acceleration cause more accidents? Sports cars have more accidents. Sports cars that are driven by young people that want to show off. Cars with a high top spee

More ›