4 ms·
According to this article [1] it looks like there is no complex preparation needs to run the inference on a Jetson system. Should work with Mixtral too. [1] ht
by qrios 3y ago
According to this article [1] it looks like there is no complex preparation needs to run the inference on a Jetson system. Should work with Mixtral too.
[1] https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070 https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jets...