This made my day: The implementation is just enough to run very small workloads: * Full GPT2 small (124M parameters) model including byte pair encoding, embed

This made my day: The implementation is just enough to run very small workloads: * Full GPT2 small (124M parameters) model including byte pair encoding, embeddings, multi-headed attention, and multi-layer perceptron stages * Inference/forward pass only (no training) * Context is limited to 10 tokens in length * 10 characters per word limit * Zero temperature output only This sheet is very big. Unfortunately, it is not unusual for Excel to lock up while using this spreadsheet. It is highly recommended to use the manual calculation mode in Excel. from: https://spreadsheets-are-all-you-need.ai/ https://spreadsheets-are-all-you-need.ai/