Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
gwern
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
11 ms
·
151.
▲
by
gwern
8mo ago
Yes, network is assumed. If it's local, there's no problem, just use MHT or SingleFile! > Maybe this is downstream of Gwern choosing to use MediaWiki for his website? This has nothing at all to do with the choice of server. The
152.
▲
by
gwern
8mo ago
I see. You could probably build something on top of wabac.js... But you'd need some sort of multi-file setup to support the indirection, I suppose. > I imagine that loading archives without a web server was probably out-of-scope for
153.
▲
by
gwern
8mo ago
OK, so your format doesn't solve the trilemma; you have 'static' and 'single-file', but not 'efficient'. Seems like you might as well just go with MHT or SingleFile then...?
154.
▲
by
gwern
8mo ago
Well, it seems easy enough to test if you think you are getting efficiency 'for free'. Dump a 10GB binary into a SingleFileZ, and see if your browser freezes.
155.
▲
by
gwern
8mo ago
I'm not following your point here. Yes, a web server (probably) has access to zip/tar utilities, but so what? That doesn't automagically make a random .zip jump through hoops to achieve anything beyond 'download like a n
156.
▲
by
gwern
8mo ago
What does that do?
157.
▲
by
gwern
8mo ago
OK, but how does that get you 'efficiency' if you're doing this weird thing where you serialize the entire page into some JSON blob and pass it in to an iframe or whatever? That would seem to destroy the 'efficiency'
158.
▲
by
gwern
8mo ago
> that this is an implementation detail which is not really related to the format. In this case, a polyglot zip/html file could also interrupt page loading via a window.stop() call...However, I admit that I haven't implemented
159.
▲
by
gwern
8mo ago
'efficiency' is downloading only the assets needed to render the current view. How does it implement range requests and avoid downloading the entire SingleFileZ when a web browser requests the URL?
160.
▲
by
gwern
8mo ago
You could potentially use WARC instead of Tar as the appended container, sure, but that's a lot of complexity, WARC doesn't serialize the rendered page (so what is the greater 'fidelity' actually getting you?) and Single
161.
▲
by
gwern
8mo ago
I find that 'save as' horribly breaks a lot of web pages. There's no choice these days but to load pages with JS and serialize out the final quiescent DOM. I also spend a lot of time with uBlock Origin and AlwaysKillSticky an
162.
▲
by
gwern
8mo ago
> Just because is requires "special" zip software on the server? Yes. A web browser can't just read a .zip file as a web page. (Even if a web browser decided to try to download, and decompress, and open a GUI file browser,
163.
▲
by
gwern
8mo ago
> Does this verify and/or rewrite the SRI integrity hashes when it inlines resources? As far as I know, we do not have any hash verification beyond that built into TCP/IP or HTTPS etc. I included SHA hashes just to be safe and
164.
▲
by
gwern
8mo ago
The range requests are to offsets in the original file, so I would think that most cases of 'live' injection do not necessarily break it. If you download the page and the server injects a bunch of JS into the 'header'
165.
▲
by
gwern
8mo ago
So this is like SingleFileZ in that it's a single static inefficient HTML archive, but it can easily be viewed locally as well? How does it bypass the security restrictions which break SingleFileZ/Gwtar in local viewing mode? It&#
166.
▲
by
gwern
8mo ago
Also, PDF caught up on size with JBIG2, and tooling/support keeps getting worse. (Not so fun fact: if you punch "filetype:djvu" into Google right now, you can easily page through what supposedly is every DjVu file on the Inte
167.
▲
by
gwern
8mo ago
An idea the website could borrow from video games is removing elements after a while, like _n_ page views. (You can store the state in cookies, LocalStorage, or perhaps track server-side by IP+useragent.) The reader enjoys the dancing jelly
168.
▲
by
gwern
8mo ago
Is Kimi still non-sloppy? When I switched to 2.5, it suddenly felt noticeably less creative and base-model-like, more sycophantic, and it hasn't gone aggro at all. Feels like a lot of the magic is gone.
169.
▲
by
gwern
8mo ago
> I kept a running log for each sibling as I was manually doing the labeling, knowing what they'd want to see, which presumably is only possible for me and my siblings to do with any accuracy. But you could feed that back in! Just w
170.
▲
by
gwern
8mo ago
> My siblings are very much not developers. That's a lot of data for them to download, store, and figure out a way to view. I wasn't suggesting anything about your siblings, but you, who are a developer. I was just talking abou
171.
▲
by
gwern
8mo ago
A Dododo Land on that premise would be more interesting than what is described, which is weak tea social commentary. A Dododo Land where the doors are confusing and you have to pull rather than push - where there's typos everywhere and
172.
▲
by
gwern
8mo ago
I'm not familiar with 'AWS datasync', but isn't the point of Glacier that it's really expensive and slow if you retrieve everything? It sounds like a bad idea for videos he planned to download in order to catalogue
173.
▲
by
gwern
8mo ago
> I searched for services which offered to digitize Video8 tapes. Most services cost about $20 per tape. Even with discounts for bulk amounts, it would likely have cost about $2k! I considered paying it (how exactly do you value a few hu
174.
▲
by
gwern
8mo ago
(An example of something which may already exist but I didn't see in my demo - more thoughtfulness on how to handle long-running tasks, and let us switch to something else, instead of us busy waiting on CC. For example, perhaps use of
175.
▲
by
gwern
8mo ago
> The amount of output this generates can quickly become overwhelming in a terminal, and is something we hear often from users. Terminals give us relatively few pixels to play with; they have a single font size; colors are not uniformly
176.
▲
by
gwern
8mo ago
I don't know, this one is a little novel. I've never seen the developer of a Buddhist meditation app discuss whether to use LLMs with a paragraph like: > Pariyatti’s nonprofit mission, it should be noted, specifically incorpora
177.
▲
by
gwern
8mo ago
Fulltext: https://gwern.net/doc/longevity/glp/semaglutide/2026-qin.pdf
178.
▲
by
gwern
8mo ago
No, I think I'm mistaken (and confusing it a little bit with the autobiography of Aleister Crowley, who was also something of an explorer and which I read around the same time - it is also interesting and untrustworthy but not as good
179.
▲
by
gwern
8mo ago
The autobiography of Burton is one of the great ones in English. Is it all true? Who knows, but Burton sure told his yarns.
180.
▲
by
gwern
8mo ago
You don't even need to do git or a tarball! HTTP/HTML already has an "API" for serving Markdown to any agent like a LLM which wants it, because you can easily set a server to return Markdown with an accept-encoding (ki
More ›