3 ms·

I suspect that we'll see a big wave of Large Transformer models getting built into high cost professional tools. Need to write some random background NPC dialo

by lumost 5y ago

I suspect that we'll see a big wave of Large Transformer models getting built into high cost professional tools. Need to write some random background NPC dialogue for a game? Need to generate a draft Cad design for "Airframe supporting a large turbojet engine with X newtons thrust"? These are problems where the high cost of inference won't be significant, and there is an expert available to revise and discard the result if its not working. I'd be curious if there is a good startup model for anything in this space, seems like you would already need to be a vendor of the underlying technical software to make a viable business (CAD,Game Engines,Creative Tools etc.)

flywithit 5y ago
Sounds about right based on my experience with GitHub copilot. It does make me fear a little bit. I mean I’m not experienced with cad but I could see you might train on a particular cad program, that program may have undiscovered bug X that allows a model to pass all the synthetic tests while optimizing for something like cost (which goes undiscovered because no human would ever design in such a way)… the reviewing engineers rubber stamp under pressure and then bam, 9/10 airframes fall apart after 1,000 miles. That’s the copilot analogue at least.