4 ms·
i don't care much about running llms on my phone, but i would like to have at least some APIs for accessing the TPU which was apparently such a big focus in my
by throawayonthe 6mo ago
i don't care much about running llms on my phone, but i would like to have at least some APIs for accessing the TPU which was apparently such a big focus in my pixel 9[0] (running graphene)
not even sure what i'd run on it but cmon. maybe some ocr/clip models for my photo gallery
[0] the "3rd Gen Edge TPU (Rio)" on the Tensor G4, apparently only accessible by the proprietary google AI Core thing, to run small gemini models or something