Smerity

16 ms·

1.
by Smerity 1y ago
Ton Roosendaal is brilliant both strategically (taking a closed source codebase and growing it into the open source success story that is Blender today) but also as a person. When I was 15 or so, mid 2000s, I was heavily into the Blender co
2.
by Smerity 2y ago
You can download Common Crawl data for free using HTTPS with no credentials. If you don't store it (streamed processing or equivalent) and you have no cost for incoming data (which most clouds don't) you're good! You can do s
3.
Python isn't just glue, it's an implicit JIT ecosystem(state.smerity.com)
4 points by Smerity 2y ago|0 comments
4.
by Smerity 2y ago
Excited to see more people working on RNNs but wish their citations were better. In 2016 my team from Salesforce Research published our work on the Quasi-Recurrent Neural Network[1] (QRNN). The QRNN variants we describe are near identical (
5.
by Smerity 3y ago
I think you've done a great explanation expansion except I believe it's ALiBi ("Attention with Linear Biases Enables Input Length Extrapolation"), a method of positional encoding (i.e. telling the Transformer model how m
6.
by Smerity 3y ago
As mentioned it's trivial across the spread of compression algorithms supporting this type of behaviour (`gzip`, `zstandard`, `zip`, ...), the header in `zip` making it even more convenient as you note! WARC as a format essentially sta
7.
by Smerity 3y ago
In the distant past I was the lone engineer of Common Crawl almost a decade ago. Common Crawl heavily leverages the WARC format. My favorite capability of the WARC format borrows from the fact that most compression formats can be written to
8.
by Smerity 3y ago
That section of the text is ambiguous but it's $250k for 8 x H100s (PCI-e) and $350k for 8 x H100 (SXM). The prices above are plus or minus from Lambda Labs[1]. [1]: https://lambdalabs.com/products/scalar
9.
by Smerity 4y ago
To note, Figma use something inspired by but not quite CRDTs: > Figma isn't using true CRDTs though. CRDTs are designed for decentralized systems where there is no single central authority to decide what the final state should be. T
10.
by Smerity 4y ago
I have had my XPS 13 laptop die four times in the past two years, needing a replacement logic board each time. The laptop is amazing when it's working, default Linux support too, but so far have literally had to ship it back to Dell fo
11.
by Smerity 4y ago
The author is focused on GPU texture compression for games[1] so they're not too concerned with fast compression speed. Given a game will be played on (at a minimum) tens of thousands of machines, some of which may be quite limited (e.
12.
by Smerity 4y ago
I saw a version of this myself at Geary and Mason around midnight on June 20th[1]. That it happened again but at a larger scale ten days later is deeply concerning. Given I had no clue what state the vehicles were in, and that they'd s
13.
Texting Robots: Taming robots.txt with Rust and 34M tests(state.smerity.com)
2 points by Smerity 4y ago|0 comments
14.
by Smerity 4y ago
I just want to note the replies to this thread are excessively dismissive and toxic. You may not agree with the wording of their advertising ("world's most powerful NLP toolkit" is marketing speak, sure) but going from that t
15.
Texting Robots: Taming robots.txt with Rust and 34M tests(state.smerity.com)
2 points by Smerity 5y ago|0 comments
16.
Texting Robots: Taming robots.txt with Rust and 34M tests(state.smerity.com)
6 points by Smerity 5y ago|0 comments
17.
by Smerity 5y ago
What I find most interesting in this is the pseudo detective story of hunting down disappearing post-mortem and "lessons learned" documentation. Optimistically we'd hope that perhaps the older systems no longer reflect the ex
18.
A decade of major cache incidents at Twitter(danluu.com)
138 points by Smerity 5y ago|26 comments
19.
by Smerity 5y ago
From the pricing page I linked to[1]: > There are no charges for outbound data transfer when using a dedicated network connection to the RSTOR network and direct peering is established. These connections are charged separately. To find o
20.
by Smerity 5y ago
You're right, I misread it and now can't edit my comment. This puts it all in quite a similar position to Wasabi[1] who have a 1:1 storage:transfer ratio per month and a 90 day minimum storage duration as well. In fact, their pric
21.
by Smerity 5y ago
Thanks! I'd never seen them. The only minor catches that I've seen are that they want you to start the account with $50 or more added, it's $6 per TB per month (rounded up to the nearest TB) with a 90 day minimum duration, an
22.
by Smerity 5y ago
The state of Australia's national science initiatives and the projects they support have always been of concern to me. There are bright spots but they seem overwhelmingly destined to be extinguished or flee. That the team members can o
23.
by Smerity 6y ago
I loved Mia.bet's pet hamster marble race concept but their website notes: > The continuously high Ethereum gas fees cause betting fees and operation costs to skyrocket. Hence, we decided to postpone the next race until further noti
24.
Samsung Semiconductor Fabs in Texas Shut Down Following State-Wide Power Cuts(techpowerup.com)
2 points by Smerity 6y ago|0 comments
25.
by Smerity 6y ago
This is an opinionated source attempting to save face. The MIT Tech Review article[1] really points out the lunacy and details that slipped through his authorial cracks. tldr: - Paid event where attendees flew in from around the world and A
26.
by Smerity 6y ago
In the past I had written about my experiences with crawling[1], from accidentally getting banned by Slashdot as a teenager doing linguistic analysis to accidentally DoS'ing a major website to being threatened with lawsuits. The latter
27.
by Smerity 6y ago
Not in that codebase as it was a tutorial / wanted to ensure it's callable from safe Rust code so stuck with `_mm256_loadu_ps`. That code was just playing with dot product like lookup over vectors on CPU. The code I'm more in
28.
by Smerity 6y ago
I work in the space and was impressed with NN-512 as there's a painful gap in inference cost between CPU and GPU that doesn't have to exist. Intel and AMD are really missing a boat here, most other companies have enough cash they
29.
by Smerity 6y ago
The author of sled[1], an embedded database in Rust which has a number of promising features, has also written parts of rio[2], an underlying pure Rust io_uring library, which is intended to become the core write path for sled. rio has supp
30.
by Smerity 6y ago
A giant plant as in someone from their team planning this out and then planting this as a comment..? simonw wrote Datasette[1] which makes extensive use of SQLite and acts as a viewer, allowing you to create interactive websites and APIs fr

More ›