There's a Manning book on creating your own LLM from scratch which answers your question exactly. There's another book from the same publisher specifically abou

There's a Manning book on creating your own LLM from scratch which answers your question exactly. There's another book from the same publisher specifically about small language models for specialty purposes.