3 ms·
Fabrice Bellard's Ts_SMS: Short Message Compression Using LLM
- BiteCode_dev 2y agoMy own tests: ./ts_sms c "TIL about ts_sms, an LLM based compression system for short text messages (like tweets)." 夋鷦네樇䶙邁㟪䤣䎧随捋㜁駊 ./ts_sms d 夋鷦네樇䶙邁㟪䤣䎧随捋㜁駊 TIL about ts_sms, an LLM based compression system for short text messages (like tweets). And: >>> len("TIL about ts_sms, an LLM based compression system for short text messages (like tweets).".encode('ascii')) 88 >>> len("夋鷦네樇䶙邁㟪䤣䎧随捋㜁駊".encode('utf8')) 39 According to ChatGPT: The text appears to be a sequence of Chinese characters mixed with Hangul (Korean script). However, as written, it seems nonsensical or encoded and doesn’t form a coherent phrase in either language.
- vrnvu 2y agoImpressive compression rate. Related project: https://bellard.org/nncp/ https://bellard.org/nncp/ and https://bellard.org/nncp/nncp_v2.1.pdf https://bellard.org/nncp/nncp_v2.1.pdf If any one wants to read more about how it's implemented.
- gus_massa 2y agoReposted later with more traction https://news.ycombinator.com/item?id=42549083 https://news.ycombinator.com/item?id=42549083
- metadat 2y agoRelated submission from today: https://bellard.org/ts_zip/ https://bellard.org/ts_zip/ https://news.ycombinator.com/item?id=42549083 https://news.ycombinator.com/item?id=42549083 (37 comments)