4 ms·
no transformers, from their blog post: "Specifically, our analysis informs model building by improving three key aspects: token-mixing structure (how the operat
by wret-ai-high 2y ago
no transformers, from their blog post: "Specifically, our analysis informs model building by improving three key aspects: token-mixing structure (how the operator mixes embeddings in the input sequence), channel-mixing structure (how it mixes channel dimensions), and featurization, responsible for modulating computation based on the input context."
https://www.liquid.ai/liquid-foundation-models https://www.liquid.ai/liquid-foundation-models