4 ms·
I don’t see a PyTorch import, and the transformers import is just for the tokenizer which I don’t really consider a nontrivial part of mamba So it’s just nump
by rsfern 2y ago
I don’t see a PyTorch import, and the transformers import is just for the tokenizer which I don’t really consider a nontrivial part of mamba
So it’s just numpy and einops, which is pretty cool. I guess you could probably rewrite all the einops stuff in pure numpy if you want to trade readable code for eliminating the einops dependency
Edit: found the torch import, but it’s just for a single torch.load to deserialize some data
- TeMPOraL 2y ago> Edit: found the torch import, but it’s just for a single torch.load to deserialize some data Torch is quite heavy though, isn't it? All for that one deserialization call?