6 ms·
We have it running as part of SHARK (which is built on IREE). https://github.com/nod-ai/SHARK/tree/main/shark/examples/shark_inference/llama https://github.com/
by magic_at_nodai 4y ago
We have it running as part of SHARK (which is built on IREE). https://github.com/nod-ai/SHARK/tree/main/shark/examples/shark_inference/llama https://github.com/nod-ai/SHARK/tree/main/shark/examples/sha...