in-silico

7 ms·

61.
Show HN: easy-torch-tpu – A Flexible Training Pipeline for PyTorch Models on TPU(github.com)
1 points by in-silico 8mo ago|0 comments
62.
by in-silico 8mo ago
I think some of the visualizations would be much better if you used a pixel-space model instead of a latent diffusion model. Right now we are only seeing the denoising process after it's been morphed by the latent decoder, which looks
63.
Aletheia Tackles FirstProof Autonomously(arxiv.org)
5 points by in-silico 8mo ago|0 comments
64.
by in-silico 8mo ago
TLDR: the author does not believe in computational functionalism
65.
by in-silico 8mo ago
Either I'm missing something or this is way overstated. Steerling appears to be just a discrete diffusion model where the final hidden states are passed through a sparse autoencoder (a common interpretability layer) before the LM head.
66.
by in-silico 8mo ago
> Perhaps weed, like alcohol, needs a legal minimum age of 21. Generally, it already does have a legal minimum age of 21.
67.
by in-silico 8mo ago
So... they can't actually "generate near-verbatim copies of novels"? If they end a single sentence differently than the original, then the next sentence will be different and so on until you get a very different novel. Sure t
68.
by in-silico 8mo ago
It's a good way to frame base models that have only been pretrained. However, modern frontier models have undergone rounds of fine-tuning, RLHF (reinforcement learning from human feedback), and RLVR (RL from verifiable rewards) that tu
69.
by in-silico 8mo ago
Sounds like a personal skill issue
70.
I'm not skeptical of AI anymore(medium.com)
3 points by in-silico 8mo ago|1 comments
71.
by in-silico 9mo ago
Hyper-targeted ads to extract more value from users' pockets. The researchers on this project sure are putting their effort towards making the world a better place...
72.
by in-silico 9mo ago
Hyper-targeted ads to extract more value from users' pockets. The researchers on this project sure are putting their effort towards making the world a better place...
73.
What It's Like to Be a Worm(asimov.press)
4 points by in-silico 9mo ago|0 comments
74.
by in-silico 9mo ago
Yes, my point was that people aren't better than machines, but just because I don't exceptionalize humanity doesn't mean I don't appreciate it for what it is (in fact I would argue that the lack of exceptionality makes u
75.
by in-silico 9mo ago
Well some people appreciate the world around them, and would care about it just as they care about trees having branches.
76.
by in-silico 9mo ago
But if you weren't one of them, would you be able to tell that they had emotions (and not just simulations of emotions) by looking at them from the outside?
77.
by in-silico 9mo ago
Yes, it reproduces what it is given by modelling the rules of physics, geometry, etc. For example, image generators like stable diffusion carry strong representations of depth and geometry, such that performant depth estimation models can b
78.
by in-silico 9mo ago
Hacker News gets a lot less creepy/sad/interesting when you ignore the first-person pronouns and remember they're just biomolecular machines. It's a scaled up version of E. coli. Useful, sure, but there's no reason
79.
by in-silico 9mo ago
But how does it interpolate?
80.
by in-silico 9mo ago
How would it do what it does without those things?
81.
by in-silico 9mo ago
The current robotics industry is $88B. You have to take into account the potential future industry of general purpose robots that replace a big chunk of blue-collar work. Robots is also just one example. A hypothetically powerful AI age
82.
by in-silico 9mo ago
The entertainment industry, as big as it is, just doesn't have as much profit potential as robots and AI agents that can replace human labor. Just look at how Nvidia has pivoted from gaming and rendering to AI. The other examples you&#
83.
by in-silico 9mo ago
Sufficiently informative latents can be decoded into video. When you simulate a stream of those latents, you can decode them into video. If you were trying to make an impressive demo for the public, you probably would decode them into
84.
by in-silico 9mo ago
The endgame has nothing to do with gaming. The goal of world models like Genie is to be a way for AI and robots to "imagine" things. Then, they could practice tasks inside of the simulated world or reason about actions by simulati
85.
by in-silico 9mo ago
Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination"
86.
by in-silico 9mo ago
> Current LLMs struggle here because they’re trained on imitation. They learn what people said about competitive dynamics, not how competition unfolds. They can recite game theory but can’t simulate a price war. I don't think this i
87.
by in-silico 9mo ago
The models don't need to be perfect. They only need to be as reliable as humans. Emergency department doctors misdiagnose about 5% of patients [1], so replacing them with an LLM that hallucinates on 1% of cases would actually be a sign
88.
by in-silico 9mo ago
A lot of people point to the Muon optimizer that Moonshot (the creators of Kimi) pioneered. Compared to the standard optimizer AdamW, Muon amplifies low-magnitude gradient directions which makes the model learn faster (and maybe gives Kimi
89.
Learning to Discover at Test Time(test-time-training.github.io)
1 points by in-silico 9mo ago|0 comments
90.
by in-silico 9mo ago
Why can't you just leave H_res as the identity matrix (or just not use it at all)? In that case, the model is basically a ResNet again and you don't need to worry about exploding/vanishing gradients from H_res. I would think

More ›