3 ms·
Doesn't Google have any patents on the transformer architecture? I assume large enterprises tend to patent everything that comes out of their research.
by potamic 3y ago
Doesn't Google have any patents on the transformer architecture? I assume large enterprises tend to patent everything that comes out of their research.
- chaoz_ 3y agohttps://patents.google.com/patent/US10452978B2/en https://patents.google.com/patent/US10452978B2/en GPT models are based on transformer, but architecture is different from what's patented. Not a lawyer, but can you really patent certain network architecture? Theoretically someone could invent new activation function that just happens to make same architecture perform a lot better on some tasks, can you call really cover that with patent?