2 ms·
Fast switching among many LoRAs is already supported in Lamini. Great paper talking through some of the design issues and optimizations, eg Orca and custom fus
by gdiamos 3y ago
Fast switching among many LoRAs is already supported in Lamini.
Great paper talking through some of the design issues and optimizations, eg Orca and custom fused GPU kernels.
I’d love to see more research in this direction.