5 ms·
* How creating dataset? I download it but it is commpresed in binary format. * How training. In cloud or in my own dev * How creating a gguf
by gdzie-jest-sol 6mo ago
* How creating dataset? I download it but it is commpresed in binary format.
* How training. In cloud or in my own dev
* How creating a gguf
- gdzie-jest-sol 6mo ago``` uv run python -m guppylm chat Traceback (most recent call last): File "<frozen runpy>", line 198, in _run_module_as_main File "<frozen runpy>", line 88, in _run_code File "/home/user/gupik/guppylm/guppylm/__main__.py", line 48, in <module> main() File "/home/user/gupik/guppylm/guppylm/__main__.py", line 29, in main engine = GuppyInference("checkpoints/best_model.pt", "data/tokenizer.json") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/gupik/guppylm/guppylm/inference.py", line 17, in __init__ self.tokenizer = Tokenizer.from_file(tokenizer_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Exception: No such file or directory (os error 2) ```
- gdzie-jest-sol 6mo agomeybe add training again (read best od fine) and train again ``` # after config device checkpoint_path = "checkpoints/best_model.pt" ckpt = torch.load(checkpoint_path, map_location=device, weights_only=False) model = GuppyLM(mc).to(device) if "model_state_dict" in ckpt: model.load_state_dict(ckpt["model_state_dict"]) else: model.load_state_dict(ckpt) start_step = ckpt.get("step", 0) print(f"Encore {start_step}") ```
- freetonik 6mo agoYou sound like Guppy. Nice touch.