3 ms·
Oh, yeah, thats a different can of worms. I know nothing of this, but I hear that you probably want H100s (instead of A100s) and a good fault tolerant platform
by brucethemoose2 3y ago
Oh, yeah, thats a different can of worms.
I know nothing of this, but I hear that you probably want H100s (instead of A100s) and a good fault tolerant platform, kinda like: https://www.mosaicml.com/blog/mpt-30b https://www.mosaicml.com/blog/mpt-30b
But you are either talking about a toy LLM or spending hundreds of thousands of dollars.