4 ms·
The large C model uses 3.6 billion parameters which is 6.7 GiB if each parameter is 16 bits.
by sorenjan 3y ago
The large C model uses 3.6 billion parameters which is 6.7 GiB if each parameter is 16 bits.
- liuliu 3y agoThe large C model have fair bit of parameters tied to text-conditioning, not to the main denoising process. Similar to how we split the network for SDXL Base, I am pretty confident we can split non-trivial amount of parameters to text-conditioning hence during denoising process, loading less than 3.6B parameters.