7 ms·
Can someone explain why the weights are posted via a Bittorrent magnet link? I have no way to check the size at the moment, but isn't that a bit unusual? There'
by pogue 3y ago
Can someone explain why the weights are posted via a Bittorrent magnet link? I have no way to check the size at the moment, but isn't that a bit unusual? There's also only 21 seeders right now according to https://checker.openwebtorrent.com/ https://checker.openwebtorrent.com/
- raydev 3y agoSpreads the burden/cost of distributing a 300+GB file.
- seydor 3y agomy optimistic explanation is we are going back to the 2000s internet , but probably we are not
- fzzzy 3y agoLet's hope so.
- ur-whale 3y ago> Can someone explain why the weights are posted via a Bittorrent magnet link? I think the best way to get an answer to that question is to try to host it yourself and see what happens.
- whywhywhywhy 3y agoBecause Bittorrent is an outstanding tech for delivering large files, more I think about it the more I'm surprised it wasn't taken advantage of more.
- Marlinski 3y agoit's been criminalized to hell by IP holders and hollywood. Such a shame they killed the best tech of the previous decade. Could have revolutionized how we distribute content, approach CDN and even streaming.
- harkinian 3y agoIn what way is the bittorrent protocol criminalized?
- yayr 3y agoscheme 1: agents for copyright holders continuously scan for IP addresses who host copyrighted content and start legal actions. scheme 2: criminal groups infect copyrighted content with malware to exploit downloaders of such content.
- harkinian 3y agoNeither of those are against the bittorrent protocol itself. Lots of software like Ubuntu is legally available on bittorrent, and I've never seen anything done to restrict that.
- exadeci 3y agoSo many countries still have data caps, even the supposedly 1st world countries. Even without hollywood people wouldn't have wanted to use any platform that uses their data and battery/power to share to everyone else. It's the main reason why torrenting platforms have introduced ratios and made it hard to get invited.
- lambdaba 3y agoWhy not? Mistral was first to do it, it has become tradition.
- gillesjacobs 3y agoI believe it was Llama 1 that notoriously got leaked with a torrent on 4chan.
- astrange 3y agoIt wasn't much of a leak. Facebook was pretending to keep it private for PR reasons but putting approximately zero effort into actually keeping it private.
- orlp 3y agoBitTorrent is just an objectively superior method of delivering a lot of data to a lot of people.
- pooloo 3y agoIts likely over 100GB of data, so I wouldn't say its necessarily unusual to spread out the bandwidth across multiple hosts.
- pogue 3y agoThanks! I searched and searched for a tool that would show me info via the web about a magnet link but nada
- CamperBob2 3y agoHow else could/should it be done?
- pogue 3y agoI would have assumed they could just upload it to Github. If it has restrictions on file size I'm sure they could make multiple part compressed files. Torrents can unfortunately die after a period of time if no one continues seeding it or if they don't use a permanent web based seeder, which doesn't appear to be the case.
- cedws 3y agoGitHub may choose to throttle downloads or remove the files simply because they're taking up too much bandwidth. A torrent is less likely to go down in the short term.
- xcv123 3y agoThis is not some crappy DVD rip on The Pirate Bay. It will be seeded as long as its relevant. Twitter/X has their own massive infrastructure and bandwidth to seed this indefinitely.
- KomoD 3y agoYeah, they can just leave some server running somewhere and just let it seed forever
- deleted 3y ago[deleted]
- larrysalibra 3y agoThe great thing about torrents is that you (or anyone else who cares) can single-handedly solve the problem you're complaining about by seeding the torrent.
- simonw 3y ago
- MallocVoidstar 3y agoDistributing 300GB via torrent is cheaper than direct, assuming even a few other people seed
- monkin 3y agoIt's 318.24G https://academictorrents.com/details/5f96d43576e3d386c9ba65b883210a393b68210e https://academictorrents.com/details/5f96d43576e3d386c9ba65b...
- bongodongobob 3y agoI'm not sure why you wouldn't tbh. That's a lot of bandwidth.
- DonHopkins 3y ago[flagged]
- bongodongobob 3y agoLol what
- frankjr 3y agoI don't understand why you're being downvoted for asking a legitimate question. People not familiar with model weights might be surprised that they are often in tens of gigabytes and in this case even more.
- fzzzy 3y agoIt may become a tradition since weights are so large. Perhaps it started when the Llama torrent link leaked. Then, Mistral decided to release their weights using bittorrent.
- leumon 3y agoMistral did it too when they released their first open model. They just posted a magnet link on Twitter.