4 ms·
Apple said they’re using their own silicon for training. Edit: unless I misunderstood and they meant only inference.
by ra7 2y ago
Apple said they’re using their own silicon for training.
Edit: unless I misunderstood and they meant only inference.
- talldayo 2y agoThey trained GPT-4o on Apple Silicon? I find that hard to believe, surely they only mean that some models were trained with Apple Silicon.
- ra7 2y agoNot GPT-4o, their own models that power some (most?) of the “Apple Intelligence” stuff.
- jsheard 2y agoInteresting, I thought Apple Silicon mainly excelled at inferencing. Though I suppose the economics of it are unique for Apple themselves since they can fill racks full of barebones Apple Silicon boards without having to pay their own retail markup for complete assembled systems like everyone else does.
- whimsicalism 2y agowithout more details hard to say, but i seriously doubt they trained any significantly large LM on their own hardware people on HN routinely seem to overestimate Apple's capabilities e: in fact, iirc just last month Apple released a paper unveiling their 'OpenElm' language models and they were all trained on nvidia hardware