agajews

4 ms·

1.
by agajews 2mo ago
Hey Hacker News! I'm Alex, one of the founders of Pantograph. A year ago, my cofounder Kelsey and I set out to try to make the most inexpensive robot that's capable enough to do interesting things, and sturdy enough to be able to
2.
We built Pandroid: a small, accessible robot for running AI in the world(pantograph.com)
5 points by agajews 2mo ago|1 comments
3.
by agajews 2mo ago
exciting! you could imagine brain transcriptions being very high signal RLHF data that could help align models more deeply to human preference.
4.
by agajews 3mo ago
Pretty different--obviously a lot less consistent today, but capable of a lot more diverse kinds of behavior. As the models get bigger, they'll be easier to prompt, and you could imagine a game designer writing a long prompt for differ
5.
by agajews 3mo ago
Awesome! We should be a lot better than ordinary LLMs, especially at tasks that require making a lot of decisions in real-time.
6.
by agajews 3mo ago
Probably not the current model, but one of the benefits of doing internet-scale pretraining is that the model has seen a lot of mods already! We think the bigger models will be able to handle some more custom Minecraft worlds.
7.
by agajews 3mo ago
The goal conditioning is just a training objective! You could combine it with tool use, web searches, etc. and still train end-to-end on goal conditioning. (One way of thinking about it is goal conditioning defines a good distribution of ta
8.
by agajews 3mo ago
you don't need to pick good images manually! it's similar to next-token prediction, many prediction tasks aren't especially interesting, but there are enough hard ones that the model can spend the most time learning from thos
9.
by agajews 3mo ago
Not yet, but we'll add language as a modality to the larger models! The models are trained end-to-end on video data, so we'll need datasets that mix video and language, e.g. transcripts of game streams. When the models are scaled
10.
by agajews 3mo ago
Very much inspired by those papers! One of the things that's interesting about our model is it's goal-conditioned, so it can do any task at inference time without training on it. We had a lot of fun making eval environments after
11.
by agajews 3mo ago
Hey everyone! I'm Alex, one of the founders of Pantograph. We've spent the last six months building a pretty smart Minecraft model, coming soon to a server near you! We trained it on about 500k hours of Minecraft videos, and it le
12.
A General Goal-Conditioned Minecraft Model(pantograph.com)
43 points by agajews 3mo ago|15 comments
13.
Pantograph: Building a preschool for robots(pantograph.com)
44 points by agajews 9mo ago|9 comments
14.
by agajews 3y ago
Ah the hardware isn’t gonna be in SF (not the cheapest datacenter space) But I do think a lot of our customers will be out here —- SF is still probably the best place to do startups. We just have so many more people doing hard technical stu
15.
by agajews 3y ago
Yeah we aren’t going to let anyone book the whole thing for years. If we ever have to make the choice, we’ll choose the startups over the big companies.
16.
by agajews 3y ago
Ah that’s only if you pay for 3 years of compute upfront. Most startups, especially the small ones, really can’t afford that
17.
by agajews 3y ago
Yeah it’s pretty hard to find a big block of GPUs that you can use for a short time, esp if you need infiniband for multinode training. Lambda I think needs a min reservation of 6-12 months if you want IB.
18.
by agajews 4y ago
Yeah exactly. That's why you can't really do it with a language model like GPT-3, you have to bake into the architecture the concept of a "link" as a first-class object.
19.
by agajews 4y ago
Hey, thanks for posting! We actually have an architecture that lets us expand the index without doing any retraining, so we can add/update pages pretty much for free.
20.
by agajews 4y ago
Hey everyone! Metaphor team here. We launched Metaphor earlier this morning! It's a search engine based on the same sorts of generative modeling ideas behind Stable Diffusion, GPT-3, etc. It's trained to predict the next link (s
21.
Metaphor (YC S21) Is Hiring Self-Supervised Learning Researchers(ycombinator.com)
1 points by agajews 5y ago
22.
Metaphor (YC S21): Hiring Self-Supervised Learning Researchers(ycombinator.com)
1 points by agajews 5y ago