4 ms·
Well, this post is the second result for even running llama on Versal, so... I think MLC-LLM (though TVM) can maybe run inference?
by brucethemoose2 3y ago
Well, this post is the second result for even running llama on Versal, so...
I think MLC-LLM (though TVM) can maybe run inference?
- manili 3y agoThanks a lot @brucethemoose2 Are there any evidences and studies (e.g. papers, case study, etc...) regarding possibility/impossibility of training or running the architecture on top of the infrastructure?