> Do they outperform? For the size/performance yes. > In any case, they wouldn't exist if not for superior models they were distilled from. So? Those models

> Do they outperform? For the size/performance yes. > In any case, they wouldn't exist if not for superior models they were distilled from. So? Those models wouldn't exist without the sum total of human knowledge. As long as a work is transformative why does it matter?