3 ms·
> But what about for tasks where datasets don’t really exist? I do a lot of PCB design and it’s extremely time consuming. But it’s a niche field compared to tex
by PoignardAzur 3y ago
> But what about for tasks where datasets don’t really exist? I do a lot of PCB design and it’s extremely time consuming. But it’s a niche field compared to text and images.
One side project I'd love to work on one day would be gathering a dataset of Factorio maps designed to help train a floor planner. The requirements aren't the same as for making a PCB, but they're similar-ish.
- TaylorAlexander 3y agoI’ve never played factorio and I’ve heard it’s complex, but one difference with video games is that they have a score of some sort (I assume factorio does). While the planner I’m sure is non trivial, the score provides some feedback that you do not get in PCB design.
- PoignardAzur 3y agoI'm not sure you would even need a score for pre-training. You could do denoising or next-token prediction with a transformer, with the tile values as the tokens.