3 ms·
> NVIDIA Jetson hardware ... 15W 7B on 15W could be any of the Orin (TOPS): Nano (40), NX (100), AGX (275) Curious if you've experimented with a larger model
by w10-1 8mo ago
> NVIDIA Jetson hardware ... 15W
7B on 15W could be any of the Orin (TOPS): Nano (40), NX (100), AGX (275)
Curious if you've experimented with a larger model on the Thor (2070)
- Zetaphor 8mo agoOr smaller on Nano