3 ms·

I'm trying to run a 32B Q4 model on a standard smartphone. It's a pretty interesting project.

• nolon 19d ago
  MoE SSD/UFS streaming and RAM/UFS/microSD tiering for Android (no-root).