10 ms·
I really hope they have because I’ve also been experimenting with LLMs to automate searching through old archival handwritten documents. I’m interested in the C
by throwup238 11mo ago
I really hope they have because I’ve also been experimenting with LLMs to automate searching through old archival handwritten documents. I’m interested in the Conquistadors and their extensive accounts of their expeditions, but holy cow reading 16th century handwritten Spanish and translating it at the same time is a nightmare, requiring a ton of expertise and inside field knowledge. It doesn’t help that they were often written in the field by semi-literate people who misused lots of words. Even the simplest accounts require quite a lot of detective work to decipher with subtle signals like that pound sign for the sugar loaf.
> Whatever it is, users have reported some truly wild things: it codes fully functioning Windows and Apple OS clones, 3D design software, Nintendo emulators, and productivity suites from single prompts.
This I’m a lot more skeptical of. The linked twitter post just looks like something it would replicate via HTML/CSS/JS. Whats the kernel look like?
- WhyOhWhyQ 11mo ago"> Whatever it is, users have reported some truly wild things: it codes fully functioning Windows and Apple OS clones, 3D design software, Nintendo emulators, and productivity suites from single prompts." Wow I'm doing it way wrong. How do I get the good stuff?
- zer00eyz 11mo agoYour not. I want you to go into the kitchen and bake a cake. Please replace all the flour with baking soda. If it comes out looking limp and lifeless just decorate it up with extra layers of frosting. You can make something that looks like a cake but would not be good to eat. The cake, sometimes, is a lie. And in this case, so are likely most of these results... or they are the actual source code of some other project just regurgitated.
- hinkley 11mo agoWe got the results back. You are a horrible person. I’m serious, that’s what it says: “Horrible person.” We weren’t even testing for that.
- erulabs 11mo agoWell, what does a neck-bearded old engineer know about fashion? He probably - Oh, wait. It's a she. Still, what does she know? Oh wait, it says she has a medical degree. In fashion! From France!
- joshstrange 11mo agoIf you want to listen to the line from Portal 2 it's on this page (second line in the section linked): https://theportalwiki.com/wiki/GLaDOS_voice_lines_(Portal_2)#GLaDOS_Test_Chamber_15 https://theportalwiki.com/wiki/GLaDOS_voice_lines_(Portal_2)...
- fragmede 11mo agoJust because "Die motherfucker die motherfucker die" appeared in a song once doesn't mean it's not also death threat when someone's pointing a gun at you and saying that.
- scubbo 11mo ago...what?
- fragmede 11mo agohinkley wrote: > We got the results back. You are a horrible person. I’m serious, that’s what it says: “Horrible person.” > We weren’t even testing for that. joshstrange then wrote: > If you want to listen to the line from Portal 2 it's on this page (second line in the section linked): https://theportalwiki.com/wiki/GLaDOS_voice_lines_(Portal_2) https://theportalwiki.com/wiki/GLaDOS_voice_lines_(Portal_2)... as if the fact that the words that hinkley wrote are from a popular video game excuses the fact that hinkley just also called zer00eyz horrible.
- hinkley 11mo agoSo if two sentences that make no sense to you sandwich one that does, you should totally accept the middle one at face value. K.
- snickerbockers 11mo agoI'm skeptical that they're actually capable of making something novel. There are thousands of hobby operating systems and video game emulators on github for it to train off of so it's not particularly surprising that it can copy somebody else's homework.
- flatline 11mo agoI believe they can create a novel instance of a system from a sufficient number of relevant references - i.e. implement a set of already-known features without (much) code duplication. LLMs are certainly capable of this level of generalization due to their huge non-relevant reference set. Whether they can expand beyond that into something truly novel from a feature/functionality standpoint is a whole other, and less well-defined, question. I tend to agree that they are closed systems relative to their corpus. But then, aren't we? I feel like the aperture for true novelty to enter is vanishingly small, and cultures put a premium on it vis-a-vis the arts, technological innovation, etc. Almost every human endeavor is just copying and iterating on prior examples.
- imiric 11mo agoHere's a thought experiment: if modern machine learning systems existed in the early 20th century, would they have been able to produce an equivalent to the theory of relativity? How about advance our understanding of the universe? Teach us about flight dynamics and take us into space? Invent the Turing machine, Von Neumann architecture, transistors? If yes, why aren't we seeing glimpses of such genius today? If we've truly invented artificial intelligence, and on our way to super and general intelligence, why aren't we seeing breakthroughs in all fields of science? Why are state of the art applications of this technology based on pattern recognition and applied statistics? Can we explain this by saying that we're only a few years into it, and that it's too early to expect fundamental breakthroughs? And that by 2027, or 2030, or surely by 2040, all of these things will suddenly materialize? I have my doubts.
- tanseydavid 11mo agoHow about "Protein Folding"?
- nestorD 11mo agoOh! That's a nice use-case and not too far from stuff I have been playing with! (happily I do not have to deal with handwriting, just bad scans of older newspapers and texts) I can vouch for the fact that LLMs are great at searching in the original language, summarizing key points to let you know whether a document might be of interest, then providing you with a translation where you need one. The fun part has been build tools to turn Claude code and Codex CLI into capable research assistant for that type of projects.
- throwup238 11mo ago> The fun part has been build tools to turn Claude code and Codex CLI into capable research assistant for that type of projects. What does that look like? How well does it work? I ended up writing a research TUI with my own higher level orchestration (basically have the thing keep working in a loop until a budget has been reached) and document extraction.
- nestorD 11mo agoI started with a UI that sounded like it was built along the same lines as yours, which had the advantage of letting me enforce a pipeline and exhaustivity of search (I don't want the 10 most promising documents, I want all of them). But I realized I was not using it much because it was that big and inflexible (plus I keep wanting to stamp out all the bugs, which I do not have the time to do on a hobby project). So I ended up extracting it into MCPs (equipped to do full-text search and download OCR from the various databases I care about) and AGENTS.md files (defining pipelines, as well as patterns for both searching behavior and reporting of results). I also put together a sub-agent for translation (cutting away all tools besides reading and writing files, and giving it some document-specific contextual information). That lets me use Claude Code and Codex CLI (which, anecdotally, I have found to be the better of the two for that kind of work; it seems to deal better with longer inputs produced by searches) as the driver, telling them what I am researching and maybe how I would structure the search, then letting them run in the background before checking their report and steering the search based on that. It is not perfect (if a search surfaces 300 promising documents, it will not check all of them, and it often misunderstands things due to lacking further context), but I now find myself reaching for it regularly, and I polish out problems one at a time. The next goal is to add more data sources and to maybe unify things further.
- jvreeland 11mo agoI'd love to find more info on this but from what I can find it seems to be making webpages that look like those product, and seemingly can "run python" or "emulate a game" but writing something that, based on all of GitHub, can approximate an iPhone or emulator in javscript/css/HTML is very very very different than writing an OS.
- torben-friis 11mo ago>I’m interested in the Conquistadors and their extensive accounts of their expeditions, but holy cow reading 16th century handwritten Spanish and translating it at the same time is a nightmare, requiring a ton of expertise and inside field knowledge Completely off topic, but out of curiosity, where are you reading these documents? As a Spaniard I’m kinda interested.
- throwup238 11mo agoI use the Portal de Archivos Españoles [1] for Spanish colonial documents. Each country has their own archive but the Spanish one has the most content (35 million digitized pages) The hard part is knowing where to look since most of the images haven’t gone through HRT/OCR or indexing so you have to understand Spanish colonial administration and go through the collections to find stuff. [1] https://pares.cultura.gob.es/pares/en/inicio.html https://pares.cultura.gob.es/pares/en/inicio.html
- throwout4110 11mo agoWant to collab on a database and some clustering and analysis? I’m a data scientist at FAIR with an interest in antiquarian docs and books
- rmonvfer 11mo agoSpaniard here. Let me know if I can somehow help navigate all of that. I’m very interested in history and everything related to the 1400-1500 period (although I’m not an expert by any definition) and I’d love to see what modern technology could do here, specially OCRs and VLMs.
- throwout4110 11mo agoAwesome thank you!
- throwup238 11mo agoSadly I'm just an amateur armchair historian (at best) so I doubt I'd be of much help. I'm mostly only doing the translation for my own edification
- Footprint0521 11mo agoBro split that up, use LLMs for transcription first, then take that and translate it
- smusamashah 11mo ago> Whats the kernel look like? Those clones are all HTML/CSS, same for game clones made by Gemini.
- Aperocky 11mo ago> This I’m a lot more skeptical of. The linked twitter post just looks like something it would replicate via HTML/CSS/JS. Whats the kernel look like? Thanks for this, I was almost convinced and about to re-think my entire perspective and experience with LLMs.
- viftodi 11mo agoYou are right to be skeptical. There are plenty of so called windows(or other) web 'os' clones. There were a couple of these posted on HN actually this very year. Here is one example I google dthat was also on HN : https://news.ycombinator.com/item?id=44088777 https://news.ycombinator.com/item?id=44088777 This is not an OS as in emulating a kernel in javascript or wasm, this is making a web app that looks like the desktop of an OS. I have seen plenty such projects, some mimick windows UI entirely, you xan find them via google. So this was definitely in the training data, and is not as impressive as the blog post or the twitter thread make it to be. The scary thing is the replies in the twitter thread have no critical thinking at all and are impressed beyond belief, they think it coded a whole kernel, os, made an interpeter for it, ported games etc. I think this is the reason why some people are so impressed by AI, when you can only judge an app visually or only how you intetcat with it and don't have the depth of knowledge to understand, for such people it works all the way.land AI seems magical beyond comprehension. But all this is only superficial IMHO.
- krackers 11mo agoEvery time a model is about to be released, there are a bunch of these hype accounts that spin up. I don't know they get paid or they spring up organically to farm engagement. Last time there was such hype for a model was "strawberry" (o1) then gpt-5, and both turned out to be meaningful improvements but nowhere near the hype. I don't doubt though that new models will be very good at frontend webdev. In fact this is explicitly one of the recent lmarena tasks so all the labs have probably been optimizing for it.
- tyre 11mo agoMy guess is that there are insiders who know about the models and can’t keep their mouths shut. They like being on the inside and leaking.
- DrewADesign 11mo agoI’d also bet my car on there being a ton of AI product/policy/optics astroturfing/shilling going on, here and everywhere else. Social proof is a hell of a marketing tool and I see a lot of comments suspiciously bullish about mediocre things, or suspiciously aggressive towards people that aren’t enthused. I don’t have any direct proof so I could be wrong, but it seems more extreme than a iPhone/Android (though I suspect deliberate marketing forces there, too,) Ford/Chevy brand-based-identity kind of thing, and naive to think this tactic is limited to TikTok and Instagram videos. The crowd here is so targeted, I wouldn’t be surprised if a single-digit percentage of the comments are laying down plausible comment history facade for marketing use. The economics might make it worthwhile for the professional manipulators of the world.
- jchw 11mo agoI'm surprised people didn't click through to the tweet. https://x.com/chetaslua/status/1977936585522847768 https://x.com/chetaslua/status/1977936585522847768 > I asked it for windows web os as everyone asked me for it and the result is mind blowing , it even has python in terminal and we can play games and run code in it And of course > 3D design software, Nintendo emulators No clue what these refer to but to be honest it sounds like they've incrementally improved one-shotting capabilities mostly. I wouldn't be surprised if Gemini 2.5 Pro could get a Gameboy or NES emulator working to boot Tetris or Mario, while it is a decent chunk of code to get things going, there's an absolute boatload of code on the Internet, and the complexity is lower than you might imagine. (I have written a couple of toy Gameboy emulators from scratch myself.) Don't get me wrong, it is pretty cool that a machine can do this. A lot of work people do today just isn't that novel and if we can find a way to tame AI models to make them trustworthy enough for some tasks it's going to be an easy sell to just throw AI models at certain problems they excel at. I'm sure it's already happening though I think it still mostly isn't happening for code at least in part due to the inherent difficulty of making AI work effectively in existing large codebases. But I will say that people are a little crazy sometimes. Yes it is very fascinating that an LLM, which is essentially an extremely fancy token predictor, can one-shot a web app that is mostly correct, apparently without any feedback, like being able to actually run the application or even see editor errors, at least as far as we know. This is genuinely really impressive and interesting, and not the aspect that I think anyone seeks to downplay. However, consider this: even as relatively simple as an NES is compared to even moderately newer machines, to make an NES emulator you have to know how an NES works and even have strategies for how to emulate it, which don't necessarily follow from just reading specifications or even NES program disassembly. The existence of many toy NES emulators and a very large amount of documentation for the NES hardware and inner workings on the Internet, as well as the 6502, means that LLMs have a lot of training data to help them out. I think that these tasks which extremely well-covered in the training data gives people unrealistic expectations. You could probably pick a simpler machine that an LLM would do significantly worse at, even though a human who knows how to write emulation software could definitely do it. Not sure what to pick, but let's say SEGA's VMU units for the Dreamcast - very small, simple device, and I reckon there should be information about it online, but it's going to be somewhat limited. You might think, "But that's not fair. It's unlikely to be able to one-shot something like that without mistakes with so much less training data on the subject." Exactly. In the real world, that comes up. Not always, but often. If it didn't, programming would be an incredibly boring job. (For some people, it is, and these LLMs will probably be disrupting that...) That's not to say that AI models can never do things like debug an emulator or even do reverse engineering on its own, but it's increasingly clear that this won't emerge from strapping agents on top of transformers predicting tokens. But since there is a very large portion of work that is not very novel in the world, I can totally understand why everyone is trying to squeeze this model as far as it goes. Gemini and Claude are shockingly competent. I believe many of the reasons people scoff at AI are fairly valid even if they don't always come from a rational mindset, and I try to keep my usage of AI to be relatively tasteful. I don't like AI art, and I personally don't like AI code. I find the push to put AI in everything incredibly annoying, and I worry about the clearly circular AI market, overhyped expectations. I dislike the way AI training has ripped up the Internet, violated people's trust, and lead to a more closed Internet. I dislike that sites like Reddit are capitalizing on all of the user-generated content that users submitted which made them rich in the first place, just to crap on them in the process. But I think that LLMs are useful, and useful LLMs could definitely be created ethically, it's just that the current AI race has everyone freaking the fuck out. I continue to explore use cases. I find that LLMs have gotten increasingly good at analyzing disassembly, though it varies depending on how well-covered the machine is in its training data. I've also found that LLMs can one-shot useful utilities and do a decent job. I had an LLM one-shot a utility to dump the structure of a simple common file format so I could debug something... It probably only saved me about 15-30 minutes, but still, in that case I truly believe it did save me time, as I didn't spend any time tweaking the result; it did compile, and it did work correctly. It's going to be troublesome to truly measure how good AI is. If you knew nothing about writing emulators, being able to synthesize an NES emulator that can at least boot a game may seem unbelievable, and to be sure it is obviously a stunning accomplishment from a PoV of scaling up LLMs. But what we're seeing is probably more a reflection of very good knowledge rather than very good intelligence. If we didn't have much written online about the NES or emulators at all, then it would be truly world-bending to have an AI model figure out everything it needs to know to write one on-the-fly. Humans can actually do stuff like that, which we know because humans had to do stuff like that. Today, I reckon most people rarely get the chance to show off that they are capable of novel thought because there are so many other humans that had to do novel thinking before them. Being able to do novel thinking effectively when needed is currently still a big gap between humans and AI, among others.
- ninetyninenine 11mo agoI'm skeptical because my entire identity is basically built around being a software engineer and thinking my IQ and intelligence is higher than other people. If this AI stuff is real then it basically destroys my entire identity so I choose the most convenient conclusion. Basically we all know that AI is just a stochastic parrot autocomplete. That's all it is. Anyone who doesn't agree with me is of lesser intelligence and I feel the need to inform them of things that are obvious: AI is not a human, it does not have emotions. It just a search engine. Those people who are using AI to code and do things that are indistinguishable from human reasoning are liars. I choose to focus on what AI gets wrong, like hallucinations, while ignoring the things it gets right.
- cindyllm 11mo ago[dead]
- hju22_-3 11mo ago> [...] my entire identity is basically built around [...] thinking my IQ and intelligence is higher than other people. Well, there's your first problem.
- vintermann 11mo agoI don't know, that's commendable self-insight, it's true of lots and lots of people but there are few who would admit it!
- ninetyninenine 11mo agoI am unique. Totally. It is not like HN is flooded with cognition or psychology or IQ articles every other hour. Not at all. And whenever one shows up, you do not immediately get a parade of people diagnosing themselves with whatever the headline says. Never happens. You post something about slow thinking and suddenly half the thread whispers “that is literally me.” You post something about fast thinking and the other half says “finally someone understands my brain.” You post something about overthinking and everyone shows up with “wow I feel so seen.” You post something about attention and now the entire site has ADHD. But yes. I am the unique one.
- otherdave 11mo agoWhere can I find these Conquistador documents? Sounds like something I might like to read and explore.
- throwup238 11mo agoSee here: https://news.ycombinator.com/item?id=45933750 https://news.ycombinator.com/item?id=45933750
- dotancohen 11mo agoMy language does not use Latin letters, but they are separate letters. Is there a way to train some handwriting recognition on my own handwriting in my own language, such that it will be effective and useful? I mostly need to recognize text in PDF documents, generated by writing on an e-ink tablet with an EMR stylus.