6 ms·Running LLaVA on iOS with Llama.cpp and TinyLlama2 points by mangoman 2y agomangoman 2y agoAuthor here, happy to answer any questions as best as I can! A fun project that I hope will help others get models running on mobile devices.