LeanderK

21 ms·

211.
by LeanderK 4y ago
of course you're aiming for zero. But you can't just wish it, there are constraints that arise from our reality. It's all a story of risks and costs, from crossing the street, driving a bicycle to using electricity. You can e
212.
by LeanderK 4y ago
I don't think so. I would have said the same about other statistics. In the end it defies my intuition, which is interesting given that the possibility of getting run over is pretty present in every day life of many children. You have
213.
by LeanderK 4y ago
> 16 dead kids of course every preventable death is too much and we should be aiming at zero...but 16 doesn't seem that much? I would have guessed more for sure.
214.
by LeanderK 4y ago
I think common in whole germany, but maybe not ubiquitous. I certainly remember them well and in my imagination they were giant!
215.
by LeanderK 4y ago
Yes, I wouldn't say it's impossible, but that's just a hard limit from the architecture. MCTS would have to terminate after a few iterations. And the number of steps is not that big, just massively parallel.
216.
by LeanderK 4y ago
that would be the optimal rule :) We usually optimise to improve and learn better and better rules, hopefully approximating the optimal rule after some iterations. There's still a gap here, but hopefully it can be closed by improving t
217.
by LeanderK 4y ago
fair. It's not proven that a solution exists for our models but I don't see much that leads me to believe it's impossible. I know GPT is not reliable but there's also really not much done to improve reliability. Its open
218.
by LeanderK 4y ago
I think current LLM architectures are limiting the strategies it learned. MCTS requires recursion but GPT is always executing a fixed number of steps. Allowing language models more flexibility by a variable number of steps, for example thro
219.
by LeanderK 4y ago
by trying to learning the general rules that to explain the dataset and minimise its loss. That's what machine learning is about, it's not called machine memorising.
220.
by LeanderK 4y ago
Disclaimer: I am not really into robotics. I think the limiting factors is the interface between ML models and robotics. We can not really train ML models end to end since since to train the interaction the model needs to interact, limiting
221.
by LeanderK 4y ago
this is absolutely not a fundamental limit but simply a hard challenge. Approaches exist and it is an active field of research where we do make progress.
222.
by LeanderK 4y ago
I think the task of predicting the next word can be misunderstood. The better you want to be the more you have to "understand" how the previous words interacted. From the style of writing to the current topic discussed, the task g
223.
by LeanderK 4y ago
I don't understand the comment at all, it has nothing to do with nepotism or favoritsm....like at all? The situation would be different if the typesetter would also be grading the work. Also, an apprentice is not one of the "well-
224.
by LeanderK 4y ago
training ML model to code is a very interesting challenge. I am surprised by GPTs ability to code, given that it, as I understood it, has basically no tools at the ready. I am convinced that it is way harder to code without debugging and ot
225.
by LeanderK 4y ago
super cool. Past ML progress told us that for most problems for which we manages to get sort-of okay performance, we saw a dramatic subsequent increase in accuracy. The moment we have some idea how to solve it, we usually have quite a few p
226.
by LeanderK 4y ago
I was very worried that a fundamental limitation of current AI-approaches is the massive amount of data. Many interesting applications only have very small datasets. Of course there are still many problems where we have this fundamental pro
227.
by LeanderK 4y ago
I don't know where this comes from because this is literally wrong. It sounds like chomsky dismissing current AI trends because of the mathematical beauty of formal grammars. First of all, it's a black-box algorithm with pretty un
228.
by LeanderK 4y ago
As I see it, we do not really know much about how GPT does it. The approximations can be very universal so we do not really know what is computed. I take very much issue with people dismissing it as "pattern matching", "being
229.
by LeanderK 4y ago
you mean this http://karpathy.github.io/2012/10/22/state-of-computer-visio... ? Very funny to revisit. How primitive our tools were in comparison to now is astounding. It feels like the first flight of the Wri
230.
by LeanderK 4y ago
at this stages ranting about assigning probabilities is not reasoning is just dismissive. Mentioning its predictive character doesn't prove anything. We reason and make mistake too, even if I think really hard about a problem I can sti
231.
by LeanderK 4y ago
> $0.12 per 1k completion tokens is high enough that it makes it prohibitively expensive to use the 32k context model. this is a lot. I bet there's a quite a bit of profit in there
232.
by LeanderK 4y ago
It's been a bit since I've been out of touch with the autonomous driving space. Was there significant progress the last 3 years? What are the current challenges?
233.
by LeanderK 4y ago
what about Bosch or Siemens? They still product things like dishwashers or vacuums.
234.
by LeanderK 4y ago
I sometimes really hate how text wraps in browsers. It really limits beautiful designs. What is the current state...are there javascript libraries that could layout text? Or are the primitives not exposed enough to control the spacing and l
235.
by LeanderK 4y ago
We are not building things for the technology sake. The user comes first, usability and accessibility is paramount. That's where we work around. History has shown is that it's easier to teach the browser new tricks than to make na
236.
by LeanderK 4y ago
I can imagine that China also has massive infrastructure and a manufacturing environment built up over the last years that may become increasingly hard to replicate in the US. I bet there some "critical mass" for high-volume manuf
237.
by LeanderK 4y ago
I really have no electrical engineering knowledge, so this question might be naive. Given that we are approaching a hard limit (the size of the atom), I wonder wether we could branch out into (true) 3d? So far everything is 2D and if I thin
238.
by LeanderK 4y ago
you can't be serious, germany is a very innovative country. Like who would label as innovate except the US? For example, it creates a LOT of patents, second behind only the US. It is a leading country for industrial research of various
239.
by LeanderK 4y ago
yeah, german here. I know schufa exists but right now it's really barely relevant. I don't plan to take on large debt or something (I think that's what they are used for?) and I've never used it so far.
240.
by LeanderK 4y ago
While ChatGPT is a real technological breakthrough because I think we, for the first time ever, crossed a line that made having conversations with AI Chatbots useful, it also was inevitable. Year by year we crawled forwards, improving bit b

More ›