You might reuse simple LLaMA tokenizer right in your Go code, look there: https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25bb07c765b6e2d3517eaa2b/pk

You might reuse simple LLaMA tokenizer right in your Go code, look there: https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25bb07c765b6e2d3517eaa2b/pkg/ml/ml.go#L2761-L2848 https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25...