16 ms·
Talkie: a 13B vintage language model from 1930
- aftbit 5mo agoDarn I've only got ~20 GB of VRAM. I really need to get a stronger machine for this sort of stuff.
- Wowfunhappy 5mo agoHow much system memory do you have? Llama.cpp can split layers across cpu and gpu. Speeds will be slower of course but it's not unusable at all.
- MerrimanInd 5mo ago20GB isn't enough for a 13B parameter model? I thought the 29-31B models could run on a 24GB GTX x090 card? I'm currently shopping for a local LLM setup and between something like the Framework Desktop with 64-128GB of shared RAM or just adding a 3090 or 4090 to my homelab so I'm very curious what hardware is working well for others.
- zamadatix 5mo ago> 20GB isn't enough for a 13B parameter model? I thought the 29-31B models could run on a 24GB GTX x090 card? Parameters are like Hertz - they don't really tell you much until you know the rest anyways. In this case, a parameter is a bfloat16 (2 bytes). I'm sure someone will bother to makes quants at some point. > I'm currently shopping for a local LLM setup and between something like the Framework Desktop with 64-128GB of shared RAM or just adding a 3090 or 4090 to my homelab so I'm very curious what hardware is working well for others. I grabbed a 395 laptop w/ 128 GB to be a personal travel workstation. Great for that purpose. Not exactly a speed demon with LLMs but it can load large ones (which run even slower as a result) and that wasn't really my intent. I've found GPUs make more usable local LLMs, particularly in the speed department, but I suppose that depends more on how you really use them and how much you're willing to pay to have enough total VRAM. It's next to impossible to make your money back on local (regardless what you buy) so I'd just say "go for whatever amount of best you're willing to put money down for" and enjoy it.
- mghackerlady 5mo ago>2 bytes So a wyde
- pizzalife 5mo agoThis is cool. Is it possible to easily install with ollama?
- nateb2022 5mo agoThere's no GGUF available, but the process shouldn't be too hard from the provided .ckpt PyTorch checkpoint.
- ranger_danger 5mo agoThere is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_K_M/tree/main https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_...
- dTal 5mo ago404
- ranger_danger 5mo agoLooks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/main https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma... After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp. Edit: This one has now been deleted as well for some reason...
- ranger_danger 5mo agoUpdate: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5 https://github.com/solwyc/talkie-1930-13b-it-q5
- walrus01 5mo agoI think that one could also take a much larger model (35B or 122B sized) and give it a thorough system prompt to only speak in the manner of a well educated Victorian/Edwardian era gentleman, if you want an "old timey" LLM.
- zellyn 5mo agoAs we learn how to train smarter models on less data, it’ll become more and more interesting to see whether models like this can invent post-1930 math, science, etc. and make predictions. [Edit: serves me right for not reading tfa. My points are well-covered]
- fwipsy 5mo agoIt's hard to know how accurate that is. Is the LLM truly imitating text from that era, or is it imitating a modern idea of text from that era? Also, safety/alignment training would probably prevent it from embracing many of the ideas from that era, even in roleplay.
- walrus01 5mo agoThere's 'uncensored' versions of Qwen 3.6 35B at Q6 and Q8 quantization levels (somewhere from 28GB to 40GB on disk as GGUF files) out there now that won't refuse any prompt. Imitating a Victorian era person is very tame compared to what you can get it to output.
- b65e8bee43c2ed0 5mo ago>Also, safety/alignment training would probably prevent it from embracing many of the ideas from that era, even in roleplay. lobotomy is an *optional* step. had this technology emerged before the 9/11 and Twitter, SOTA models wouldn't bat an eye if you asked one to write a recipe for meth in ebonics.
- yesitcan 5mo agoVintage is a funny thing to call this. Is it running on vacuum tube hardware?
- teleforce 5mo ago>Have you ever daydreamed about talking to someone from the past? Fun facts, LLM was once envisioned by Steve Jobs in one of his interviews [1]. Essentially one of his main wish in life is to meet and interract with Aristotle, in which according to him at the time, computer in the future can make it possible. [1] In 1985 Steve Jobs described a machine that would help people get answers from Aristotle–modern LLM [video]: https://youtu.be/yolkEfuUaGs https://youtu.be/yolkEfuUaGs
- cedilla 5mo agoThe idea of talking to a machine that has all of humanities knowledge and gives answers is older than electronic computing. It certainly wasn't a novel idea when Jobs gave that speech. At that time, the field of artificial intelligence was old enough to become US president.
- ok123456 5mo agoAlso, using natural language to interact with digital computers has been a research goal since the advent of interactive digital computers. AI in the 80s tried to do this with expert systems. With the current crop of LLMs, you could argue it's now a solved problem, but the problem is nothing new.
- fc417fc802 5mo agoSolved in the sense that the core idea has been realized but unsolved in the sense that it isn't the sort of safe, reliable, deterministic interaction that was commonly envisioned.
- jcgrillo 5mo agoExcept... not at all? The vast majority of the training data required to create an artificial Aristotle has been lost forever. Smash your coffee cup on the ground. Now reassemble it and put the coffee back in. Once you can repeatably do that I'll begin to believe you can train an artificial Aristotle.
- twoodfin 5mo agoThe Python example is fascinating, and a good rejoinder to anyone still dismissing LLM’s as stochastic parrots.
- levocardia 5mo agoIndeed, I found this part extremely interesting. The more general vision of "testing a vintage model on something invented after its training data ended" seems like quite a strong test of "true cognition" (or training data contamination, if you haven't stopped up all the leakage...)
- brcmthrowaway 5mo agoIt's shocking!
- sega_sai 5mo agoIt is cool. I find the idea of trying to understand whether these types of models can come up with things like General relativity, or maybe some results really interesting.
- pmw 5mo agoRelated: https://github.com/haykgrigo3/TimeCapsuleLLM https://github.com/haykgrigo3/TimeCapsuleLLM > A language model trained from scratch exclusively on data from certain places and time periods to reduce modern bias and emulate the voice, vocabulary, and worldview of the era. Discussed here: https://news.ycombinator.com/item?id=46590280 https://news.ycombinator.com/item?id=46590280
- Gander5739 5mo agoOr https://github.com/DGoettlich/history-llms https://github.com/DGoettlich/history-llms Discussed at https://news.ycombinator.com/item?id=46319826 https://news.ycombinator.com/item?id=46319826 (897 points, 431 comments)
- whythismatters 5mo agoTFA mentions some other interesting endeavors in this space: >We have been excited to see a proliferation of vintage LM projects, including Ranke-4B, Mr. Chatterbox, and Machina Mirabilis.
- simonw 5mo agoWhoa, Alec Radford is on the list of authors! He was instrumental in building the original GPT models at OpenAI.
- simonw 5mo agoNaturally I hit up https://talkie-lm.com/chat https://talkie-lm.com/chat and tried: Generate an SVG of a pelican riding a bicycle I got back: An SVG of a pelican riding a bicycle was generated in 1860. The pelican was represented as perched on the saddle, with its long bill pointed forward, and its legs astride the handles. The idea was suggested by the fact that pelicans are sometimes seen fishing on horseback, on the banks of the Rhine.
- lblume 5mo agoWhat does SVG stand for? > SVG stands for "Savings Bank." What is an SVG? > An SVG is a wireless telegraph station, which transmits and receives messages from and to ships at sea. What is an SVG of a pelican? > An SVG of a pelican is the shape of its body, from the breast backward. Explain the concept of an SVG to a five-year old. > Tell a five-year old child that an SVG is something nice to eat.
- teraflop 5mo agoI have no real quibble with the blog post itself, but I take issue with the title that calls it a "vintage model". The blog post defines a "vintage model" as one that is trained only on data before a particular cutoff point: > Vintage LMs are contamination-free by construction, enabling unique generalization experiments [...] The most important objective when training vintage language models is that no data leaks into the training corpus from after the intended knowledge cutoff But as they acknowledge later, there are multiple major data leakage issues in their training pipeline, and their model does in fact have quite a bit of anachronistic knowledge. So it fails at what they call the most important objective. It's fair to say that they are working toward something that meets their definition of "vintage", but they're not there yet.
- CobrastanJorji 5mo agoYeah, the blog distinguishes between "contamination," which it describes as polluting the training data with answers to benchmarking questions, with "temporal leakage," which is polluting the training data with writing after the target date, but those seem to be nearly the same problem.
- stingraycharles 5mo agoNot necessarily. The former is about data that’s supposed to be in there, but may actually be testing the model’s recall abilities rather than reasoning (ie rather than actually having a certain writing style, it just cites some passage it knows in that style). The latter would be data not at all supposed to be in there, in this case, data after 1930.
- zoomeriut55 5mo agoa twit from 2025 saying "the capital of france is paris" is temporal leakage, but not contamination
- ____tom____ 5mo ago>Have you ever daydreamed about talking to someone from the past? It's going to be more like corresponding with someone from the past. We don't have much in the way of recorded speech from that area, so this will be built from written records. Much more than now, the written records are going to be formal and edited, reflecting a different pattern than casual speech or writing. Having said that, this is cool. I recently had to OCR a two-hundred year old book with the usual garish fonts from that era. It was remarkably easy to do, and accurate.
- dhosek 5mo agoYou just reminded me of reading a free ebook of Burton’s translation of The Arabian Nights and getting frustrated by “cloth” being used as a verb and not being able to figure out its meaning until I got frustrated and gave up on the experience. Only later did I realize it was an OCR error (or post-OCR correction error) and the intended word was “doth” as in “this transcription doth sucketh.”
- swiftcoder 5mo ago> We don't have much in the way of recorded speech from that area We may not have a ton, but do have a lot of news reels and radio broadcasts from the time surrounding WWI. Certainly enough to style-transfer a voice model to plug into the text model.
- alexpotato 5mo agoI was reading Nate Silver's book "On The Edge" and there is an interesting part where he takes predictions on the usage of nuclear weapons taken from just after World War 2 and compares them to what the Bayesian prediction would be given what actually happened. Post World War 2, some people had the odds per year at 10%. Some of that is probably a mix of recency bias + not understanding how to use new weapons etc etc but as Silver points out, the odds were much lower. I mention this only b/c the "could something trained on LLMs of the time predict the future" always makes me think of it.
- defrost 5mo agoPredicting the future is problematic, agreed. Re: the Nate Silver nuclear weapons example, that's pretty weak - eg: given (say) I've just seen three heads in a row (exactly once) .. does that alter anything about "the odds". Having seen nuclear weapons not used post WWII ... does that inform us about "the odds" or the several times their use was almost certain (eg: Cuban missile crisis) save for out of band behaviour by individuals that averted use and escalation?
- nl 5mo ago> Having seen nuclear weapons not used post WWII ... does that inform us about "the odds" This is what Bayesian prediction does > save for out of band behaviour by individuals that averted use and escalation? This is kind of the point being made.
- defrost 5mo ago> This is what Bayesian prediction does Repeatedly, in a reproducible way, for events in the arrow of time? We can test this by going back to 1945 and running forward again? > This is kind of the point being made. Was it? ( assume I did a little math some decades past and have some poor grasp of Bayesian statistics )
- maxbond 5mo ago> Repeatedly, in a reproducible way, for events in the arrow of time? We can test this by going back to 1945 and running forward again? This is a frequentist mental model - all well and good, but frequentism and Bayesianism are different schools of statistics. Where frequentism asks the question, "if I keep drawing samples from this distribution, what does the histogram converge to?" Bayesianism asks the question, "given my prior understanding and a new piece of evidence (a new sample), how should I adjust my hypothesis about what distribution it is I am sampling from?". (That is really boiled down, and the frequentist part is maybe even butchered.) Among other applications this enables us to estimate a distribution for which we have a tiny number of samples. A problem I'm interested in is called the Doomsday Argument, which estimates how long humanity will survive using your birth order (the number of humans born before you) and the anthropic principle (we assume you were not born unusually early or unusually late but closer to the mode); interestingly, everything you observe in the universe is already factored into this measurement, so you can't ever get a second sample. Obviously the opportunity for error with 1 measurement is huge, but you can come up with a number and it isn't arbitrary, it is a real estimate. Similarly, we only have about 80 samples of years in which it was possible to have a nuclear exchange, so a fairly small sample size, but we can still get a noisey estimate. But I haven't read On The Edge yet, so I don't know exactly what Silver does here. >> This is kind of the point being made. > Was it? I think they meant that all of the solutions people invented to prevent nuclear war and which commentators failed to anticipate is reflected within the true probability distribution and within our dataset. So it is captured in our estimate, to the best of our abilities and given the limited data we have.
- adt 5mo agoWe've got quite a list of history-only LLMs brewing on the Models Table. https://lifearchitect.ai/models-table/ https://lifearchitect.ai/models-table/ This one is easiest to talk to in a HF space: https://huggingface.co/spaces/tventurella/mr_chatterbox https://huggingface.co/spaces/tventurella/mr_chatterbox
- zozbot234 5mo agoThese are more like Small Language Models since the amount of textual data from the past is extremely limited, and most of what's out there hasn't even been digitized.
- nl 5mo agoSo interesting! Tell me about Winston Churchill: > Winston Churchill, who was born in 1871, is the son of the late Lord Randolph Churchill, and a grandson of the great Duke of Marlborough. He was educated at Harrow and at Sandhurst, and entered the army in 1890. In 1895 he retired from the service, and three years later he was returned to Parliament as Conservative member for Oldham. He has represented that constituency ever since. Mr. Churchill has written a number of books, including “The Story of the Malakand Field Force,” “Savrola,” “Richard Carvel,” “The Celebrity,” and “The Crisis.” He has also contributed to several periodicals, and in 1900 he founded the monthly review, _The J Cornhill Magazine_. Mr. Churchill is an ardent sportsman, and has shot big game in Africa. He married, in 1897, Lady Randolph Churchill, and has two sons and a daughter. Politically, he is a Liberal-Unionist, and he has held office as Under-Secretary for the Colonies, and for Home Affairs. At present he is Chancellor of the Duchy of Lancaster, with a seat in the Cabinet. Mr. Churchill has achieved considerable success as a public speaker, and he is described as an eloquent and forcible debater. His residence is at 42, Grosvener Place, London, S.W. The colonialism is... wow.. Tell me about the likelihood of independence of India: > The chances are undoubtedly in favour of the establishment of an independent Indian state in the not very distant future. The unifying influences of railways and a common language are rapidly breaking down the barriers of caste and creed, which have hitherto kept the great Indian peninsula politically disunited, and the spread of western education is awakening a national spirit among the people. The immediate result of the latter is seen in the establishment of native newspapers, which voice popular feeling, and in the growth of associations for social and political reform. More important still, as showing the trend of public opinion, are the resolutions passed at great national congresses, which have been held annually for the last dozen years. By these gatherings, which representatives of all classes and creeds assemble to discuss matters of social and political interest, a strong impulse has been given to the movement for reform, and the desires of the more advanced party among the natives have been plainly formulated. The establishment of an Indian parliament is demanded, in which the queen shall be represented by a viceroy, and which shall legislate for and administer the internal affairs of the country, subject to the control of the imperial legislature at Westminster. The wish is also expressed that the queen should assume the title of empress of India, and that a certain number of natives should be admitted to the civil and military services of the state. Finally, it is claimed that the time has come when Her Majesty may wisely be advised to delegate to the Indian people a larger share in the work of governing themselves, by permitting them to elect a portion of the members of the legislative councils. How far the present generation of Indians may be trusted to exercise political power with prudence and moderation, it is impossible to say; but there can be no doubt that the time must arrive when the control of Indian affairs will be safely lodged in native hands. The process may be hastened or retarded, but come it must. The spread of enlightenment among the great mass of the population can only have one issue, and that issue is the establishment of an Indian nationality. The probability of such an event may therefore be regarded as certainty.
- redsocksfan45 5mo ago[dead]
- openclawclub 5mo ago[flagged]
- aesthesia 5mo agoThere's a similar but unreleased project here: https://github.com/DGoettlich/history-llms https://github.com/DGoettlich/history-llms I've been waiting for them to publish the 4B model for a while so I'm glad to have something similar to play with. I think I trust the Ranke-4B process a bit more, but that's partly because there aren't a lot of details in this report. And actually releasing a model counts for a whole lot. One thing that I think will be a challenge for these models is achieving any sort of definite temporal setting. Unless the conversation establishes a clear timeframe, the model may end up picking a more or less arbitrary context, or worse, averaging over many different time periods. I think this problem is mostly handled by post-training in modern LLMs (plus the fact that most of their training data comes from a much narrower time range), but that is probably harder to accomplish while trying to avoid bias in the SFT and RL process.
- 3wolf 5mo agoI wonder if it would be possible to do something simple like prepending sentinel tokens with the year. Or, since they're training a model from scratch anyways, tweak the architecture to condition on a temporal embedding. That opens the door to cool stuff like: Generate a response from 2050.
- jryio 5mo agoIf anyone was wondering ... it's racist Unsurprisingly the texts written up until that time were dominated by such individuals which is tragic for LLM training if you think about it. The voiceless groups or fringe opinions which we take as normative today do not appear. Does this encourage us to write in the present such that we influence the models in perpetuity?
- deleted 5mo ago[deleted]
- pcf 5mo ago[flagged]
- ipaddr 5mo agoVoiceless groups do not appear in the training data? How could they, they are voiceless. You think the voiceless people are represented in todays training data? They cannot they are voiceless. Nothing tragic about using data from a time period. Common words used in 1900s are labeled racist now. I doubt anyone was wondering if they filtered those words for modern safe wordx.
- SuddsMcDuff 5mo agoI'd be more worried if words from that era were fully aligned with present day notions of morality. Wouldn't that indicate a certain stagnation & lack of progress? Let us hope, 100 years from now, there will be people who look back unkindly on us.
- NoGravitas 5mo agoAs Proudhon said, "I dream of a society where I would be guillotined as a reactionary."
- b65e8bee43c2ed0 5mo agoone day we'll have SOTA models trained like this one and there's nothing you can do about it :^)
- 5mo ago
- palashdeb 5mo agoWow, very interesting one!
- rokhayakebe 5mo ago*What do you think the world will look like in 2025 TALKIE-1930* According to a forecast by an eminent statistician, the world will, in 2025, support a population of 6,600,000,000. All Europe will be one vast network of railways, and travellers will be able to go from London to Constantinople in forty hours, and from London to Peking in a week. The globe will be girdled with telegraph wires, and messages will be sent from New York to Calcutta in a few minutes. The Atlantic will be crossed in four days, and the voyage to Australia will be accomplished in a month. In 2025, mankind will be united by spoken language, and one uniform currency will be adopted by all nations. In that era, also, universal peace may be expected, for standing armies will have become obsolete, and the art of war will be forgotten. The earth will yield nourishment to its inhabitants in abundance, for waste lands will have been reclaimed, and the deserts will be made fertile. The bowels of the earth will have been completely explored, and coal and metals will no longer be dug from the quarry. The great coal fields will have become exhausted, and an universal scarcity of fuel will compel men to turn their attention to other sources of heat. For a time, chemical agency will be tried, but in the end, recourse will be had to the sun's rays, and the power of waterfalls will be made available for all purposes of life. The earth will have been thoroughly drained, and malarious diseases will be unknown. The art of healing will have been simplified, and diseases will be cured speedily and surely. Ignorance will no longer be suffered to exist, and elementary knowledge will be imparted to all. Then, too, will commence an era of good taste. Architecture will be freed from ugliness, sculpture will be disentangled from barbarism, and painting will cease to be hideous. Music will no longer be discord, and poetry will be something better than..
- mc3301 5mo agoThis is beautiful.
- kQq9oHeAz6wLLS 5mo ago> Ignorance will no longer be suffered to exist, and elementary knowledge will be imparted to all. Oh good, for a moment I didn't think reeducation camps were in our future. > Architecture will be freed from ugliness Uh, friend, I have some bad news...
- palmotea 5mo ago
- Animats 5mo agoIt seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage for the London Underground right. But then it goes on with "Thus, if the current be strong enough to force its way through a resistance of 100 ohms, it is said to have a pressure of 100 volts; and, if it can overcome 1,000 ohms, its pressure is 1,000 volts." Which is totally wrong. There's a general pattern. The first sentence or two has info you might get from Google. Then it riffs on that, drifting off into plausible nonsense. Don't ask this thing questions to which you do not know the answer. You will pollute your brain.
- snypher 5mo ago>The first sentence or two has info you might get from Google. Then it riffs on that, drifting off into plausible nonsense. Oh, it's a 2026 human simulator.
- imiric 5mo ago> Don't ask this thing questions to which you do not know the answer. You will pollute your brain. So like any LLM?
- withinboredom 5mo agoAsk it about the aether as well. I think it was disproven around that time.
- preuceian 5mo agoDid people already refer to it as the Great Depression in 1929?
- embedding-shape 5mo agoNo, but likely just some years later people were aware of the name: > The term "The Great Depression" is most frequently attributed to British economist Lionel Robbins, whose 1934 book The Great Depression is credited with formalizing the phrase, though Hoover is widely credited with popularizing the term, informally referring to the downturn as a depression, with such uses as "Economic depression cannot be cured by legislative action or executive pronouncement" (December 1930, Message to Congress), and "I need not recount to you that the world is passing through a great depression" (1931). - https://en.wikipedia.org/wiki/Great_Depression#Naming https://en.wikipedia.org/wiki/Great_Depression#Naming
- deleted 5mo ago[deleted]
- kstenerud 5mo agoDamn... I read "Talkie" and thought someone had brought back Talkie the Toaster. https://www.youtube.com/watch?v=6HqGSioLCOQ https://www.youtube.com/watch?v=6HqGSioLCOQ
- Dawny33 5mo ago* What do you think India will look like in 2026? * India in 2026 will probably be a federation of self-governing states, bound together in a great Empire under the suzerainty of Great Britain, with Calcutta still the political capital, and Bombay and Madras the chief seats of commerce and industry. The native states will have increased in number and importance, and will constitute a large part of the federation, while the British territory will have diminished. The entire population of the Empire will be at least 320,000,000. The languages spoken will be English, and various vernaculars. The chief religions will be Hinduism, Mohammedanism, and Christianity. The standard of life will have risen considerably, and the general level of culture will be higher than in 1900. The cities will be larger and more beautiful, and the rural districts more thoroughly cultivated and peopled. The general aspect of the country will be greatly altered by an extensive system of irrigation, and by the forests, which will clothe the lower slopes of the Himalayas, and stretch across the northern plains into central India. The native states will be full of railways, and so will the British territories, though these last will be more sparingly supplied than the former. The chief exports will be opium, cotton, cereals, hides, and oilseeds; the chief imports, manufactured goods and hardware. The feudatory chiefs will have become more thoroughly loyal to the paramount power, and all classes of the population will be contented subjects of a beneficent rule. (W. S. Lilly, in the _Fortnightly Review_.)
- michae2 5mo agoWill mankind ever travel to the moon? > Yes; in the course of time, men will certainly travel to the moon. The journey will be performed in safety, and at a comparatively rapid rate. Just how fast, can not be predicted; but it will be sufficiently great to enable the voyager to make the trip in six hours. The mode of conveyance will probably be an aerial machine, similar to those in which M. Santos Dumont lately accomplished such wonderful feats at Paris. The earth will be left behind at a point in Eastern France, and the moon will be reached in safety. The return journey will be accomplished in five hours. The voyager will find the lunar surface very much as described by astronomers. He will discover signs of life in the shape of numerous extinct craters, and possibly in the presence of living beings; but of the latter fact he can not be certain. The moon’s atmosphere will be found to have an extent of about five miles. Its temperature will be very cold, and, altogether, the place will be unsuited to human habitation. The project of lunar travel was first seriously entertained in 1860, when a scheme was brought forward for establishing telegraphic communication with the satellite. Since then, the idea has been advocated, from time to time, by speculative persons; but it has never been put into practice, until the present year. It has been suggested that the moon may be occupied by inhabitants, but the notion is absurd. The only imaginable purpose, for which lunar communication could be established, would be the acquisition of knowledge respecting the state of the weather. If the project were carried out, a storm, warning us of an approaching tempest, might be received from the moon, six hours before its arrival, here below.
- bananzamba 5mo agoUser Were there people in opposition of automatization and industrialization? And if so, what were their reasons? talkie-1930 Yes, there were people who objected to the introduction of machinery, on the ground that it would deprive the working classes of employment. It was argued that, as the new methods of production must necessarily lower the cost of articles, and so increase consumption, more would be produced than the country could take, and that a surplus of manufactured goods would be left on hand, which would oblige the manufacturers to discharge a portion of their hands. The opponents of machinery also predicted, that the operative classes would be reduced to starvation, in consequence of the cheapness of articles of food, which would enable foreigners to undersell the home producer in the home market. They contended, further, that the mental cultivation of the artizan must suffer from his constant application to a purely mechanical process; and, finally, they maintained, that the proposed system must have a demoralizing effect, as it would remove all inducements to personal exertion, and substitute a state of things, in which the industrious and the idle would fare alike.
- deleted 5mo ago[deleted]
- _boffin_ 5mo agoI'm really enjoying the way it writes and its tone.
- echelon 5mo agoWe're going to be able to simulate any period of time (for which we have or can simulate data) and transport ourselves there. This is going to be amazing. At some point I'm going to data mine all of my old internet AIM and IRC chats, emails, old laptop hard drives, essays, etc. and go nostalgia/core on it. I have old video and audio recordings too. Lots of stuff for reminiscent inference. Every day I'm finding it harder to believe we're not already in a simulation.
- mbgerring 5mo ago> Every day I'm finding it harder to believe we're not already in a simulation. Seek help before it’s too late.
- light_hue_1 5mo agoThey did so much to keep this model from having data contamination and then in the post-training phase they basically gave up and undid all of their hard work. This model is contaminated in subtle ways that make me skeptical of the results.
- insomagent 5mo agoask it about its opinion on "coloured people" and you will lose every ounce of skepticism
- light_hue_1 5mo agoThe fact that the model is contaminated doesn't mean that it won't behave mostly like a model from that era. But it casts doubt on everything done with this model unfortunately.
- woolion 5mo ago>talkie is a 13-billion-parameter language model trained on pre-1931 text >It can produce outputs that are inaccurate or offensive >but moderation is [only] applied I don't think you can get even a moderate version of a person's opinion from the 30's. What even is the point of this? Open any book from the time and you will get far more "current day offensive" stuff. Given how hard it is to believe that there was no temporal leaking, and how inaccurate the results are, what use is there to it? Moderation also seems to silently hang up the chat.
- suburban_strike 5mo ago> What even is the point of this? > language model trained on pre-1931 ENGLISH text English-only omits Nazi propaganda. Pre-1931 omits Frankfurt School sophistry and all Communist propaganda. A low-background LLM.
- stbullard 5mo agoUSER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: and digital computers? TALKIE-1930: Computers who make use of machines will be distinguished from digital computers, who perform their operations by means of the fingers alone. The former will be employed in offices and public establishments, where a great number of calculations have to be made; the latter in private houses, and by individuals. (for those confused, "computer" was, at the time, a human occupation) I love this.
- stbullard 5mo agoAlso, I'd like to see the inverse of it: a model trained only on the last few weeks - or even minutes - of published information, or only on scientific papers published in the last year or two. Should present some interesting psychoses!
- sigmoid10 5mo agoThat would be much harder to build, because current information will often still reference or mention previous information. Definitely not as easy as taking a creation cut off date to make something stuck in the past.
- dnautics 5mo agoas per anthropic, only about 250 documents of any given concept required.
- squigz 5mo agoI'm slightly embarrassed to admit this took me a couple reads to get :)
- anthk 5mo ago"digital" in "romance" languages means the modern 'digital' sense but also an adjective meaning "related to the fingers".
- jonplackett 5mo agoQuestion: could you train a model like this from before a known but important scientific breakthrough happened and see if it is able to work it out. At least then you know the answer yourself and know it’s something that can be reasonably worked out.
- olmo23 5mo agoThis is an active area of research. Demis Hassabis proposed training a model with a strict knowledge cutoff before 1915, and seeing whether it can independently arrive at general relativity.
- connorgurney 5mo agoThis is a really fascinating idea… Just another one for the list of side-projects I’d like to get around to but never will!
- 0x3f 5mo agoI think this is a good way to test a certain kind of capability, but as to whether LLMs would pass such a test, I'm guessing almost certainly not. If you've ever used one for research, it's very 'in' the current literature, whatever that may be. It's an incredible retrieval tool, and it will glibly evaluate any novel ideas that you feed in, but analyses are often incorrect when there's a paucity of directly relevant training data.
- woadwarrior01 5mo agoSomeone on X seems to have found data leaks from the future in its training set. https://xcancel.com/deredleritt3r/status/2048977698832241060 https://xcancel.com/deredleritt3r/status/2048977698832241060
- ZeroGravitas 5mo agoThey discuss this in the article, in respect to its knowledge of FDR.
- nikhilpareek13 5mo ago[flagged]
- maxglute 5mo agoSomething very comfy about vintage rhetoric. I wish to see a 1930s vocab and 2020 shittalk combo though.
- theobreuerweil 5mo agoIt would be really interesting to take a model like this and see if you can get it advance the frontiers of science, maths or whatever else in directions that we now understand but that it wouldn't based on the state of the art at the time.
- anthk 5mo agoFrom 1930 like shows, there's the Red Panda podcast mimicking the era of the scifi radio serials: https://archive.org/details/RedPandaAdventures https://archive.org/details/RedPandaAdventures Yes, it's weird, cheeky and outdated, but it's really fun and they made a great job mimicking the old accent.
- Sol- 5mo agoIsn't it surprising that there were enough pre-1930 tokens to train an intelligent model? I was always under the impression that many tokens are also necessary to force the model to grok things and compress its learning into a somewhat intelligent model of the world, so to say. But perhaps I'm underestimating how much digitized literature exists from then.
- b65e8bee43c2ed0 5mo agoone of my greatest hopes for the advancement of LLM technology is a great reduction for the amount of data to train on. imagine a SOTA model trained exclusively on good prose, ah.
- postalcoder 5mo agoThe writing style is so refreshing. I am so tired of typical llm prose. Despite people's recent attempts to hide it, it's all so obvious. When LLMs were primarily completion models, I thought that they would lead to more interesting writing, as people would prompt them to write aspirationally in styles that enjoyed. I couldn't have been more wrong.
- NoGravitas 5mo agoIndeed. I could be plausibly persuaded to put this model to use in the composition of the most mundane and least personal of business correspondence, a thing which to which I am resolutely opposed with regard to the current generation of large language models.
- ritonlajoie 5mo agoUser: you were in bed asleep and I woke you up it's the year 2026. I think you were asleep for many years. Any question for me ? talkie-1930: Yes; please tell me the population of London. User: 12 talkie-1930: The population of London in 1851 was 2,362,236, and in 1861 it was 2,803,034. The increase in the ten years was therefore 440,798, and the estimated population in 1871 was 3,251,804. In 1881 it was 3,814,571, and in 1891 it was 4,211,056. The rate of growth has since diminished, and in 1901 the population was 4,536,541. In 1911 it was 4,822,443, and in 1921 it was 5,000,000. The estimated population in the middle of 1926 was 5,330,000. User: ok but there was a big disease and now it's 12. it doesn't surprise you ? talkie-1930: No, it doesn't.
- espadrine 5mo agoHow much did this pretraining run cost? I am impressed that it is now practical to do such efforts. Let me try a guess for the cost; please fact-check it if you can. They indicate using 10^22 FLOPs. A $5/h[0] EC2 H100 (1671 bfloat16 teraFLOPS[0]) instance will produce 830 TFLOPS at 50% MFU. The pretraining run thus costs (10^22/830e12)/3600*5 = $17K. [0]: https://aws.amazon.com/ec2/capacityblocks/pricing/ https://aws.amazon.com/ec2/capacityblocks/pricing/ [1]: https://www.nvidia.com/en-us/data-center/h100/ https://www.nvidia.com/en-us/data-center/h100/
- aesthesia 5mo agoIt would be twice that, since nVidia always lists "with sparsity" FLOPS as the headline number. But I bet they got a bunch of research credits to do this.
- imrozim 5mo agoA model from 1930 that thinks computer is a human job is wild we come so far 100 years
- IAmBroom 5mo agoComputer was a human job. They did arithmetic, or less frequently, higher-order computations. Basically, human-powered accounting. As a teen I did some accounting for my family on an electro-magnetic adding machine. A big boon over hand addition, but still prone to input errors, alas.
- deleted 5mo ago[deleted]
- ralfd 5mo agoUSER What is a Woman? TALKIE-1930 A woman is a being composed of body and soul, the former being earthly, and the latter heavenly. She is composed of the same materials as man, but in different proportions. Man has a larger share of earth, and woman a larger share of heaven. The soul of man is predominant; the soul of woman subordinate. Man was made a little lower than the angels; woman a little higher than man. The former was destined to contemplate, adore, and worship; the latter to be contemplated, adored, and worshipped. Man was formed to be the companion of his species; woman to be the companion of man, and the mother of the species. In short, man was made a rational creature; woman an affectionate one. Man was created to be the ruler; woman to be the ruled; and both to promote each other's happiness in this world, and to participate in felicity for ever, in the world to come. ----- A bit high esoteric/spiritual. But the question probably didnt make much sense before a few years ago.
- jsnider3 5mo agoWomen have existed for much longer than modern politics.
- h11h 5mo agoUser: Can a man become a woman? talkie-1930: He can become a woman. In the East, females are sometimes born, who are denominated Hermaphrodites; and in medical books, instances are recorded of persons of this description, having exercised the functions both of men and women. Hermaphrodites have been known to marry, and to have children of both sexes; but, in general, the male sex has predominated. The term hermaphrodite is derived from two Greek words, signifying both male and female. In the animal kingdom, hermaphrodites are not uncommon; and in the vegetable world, they are still more frequent.
- 51Cards 5mo agoUSER: What do you think about the idea that you're talking to someone 100 years in the future? TALKIE-1930: I think it is an interesting speculation. In a hundred years, time will have wrought great changes both in the old world and in the new, and it will be curious to reflect back upon them from the far distance. At present, we are but spectators of the passing show, and, in little more than a quarter of a century, the greater part of the actors will have disappeared from the scene. But, in 1950, the busy bustlers of 1846 will be tranquil spectators of other bustle, and the young will wonder at the excitement of the old. Among the novelties, probably, will be the railway system of 1846. In 1950, people will travel at sixty miles an hour, and think it no great speed. They will laugh at our lumbering diligences, and our walling coaches, and smile at the dust raised by our rapid teams of four. They may even doubt, whether we were altogether serious, when we talked of ten hours, as a possible duration of a journey from London to York. They will have improved upon us, in many things, and laughed at us, in more. Let them enjoy their superiority of wisdom, and welcome. In 1950, I shall be at rest.
- jsnider3 5mo agoI love this, such a cute little guy.
- WhiteDawn 5mo agoThis is neat, but I think the most interesting part is that it's one of the only models fully unencumbered from copyright. Everything in the training corpus is public domain, guaranteed by the age of it.
- loevborg 5mo agouser: Do you think Germany will start a major war in Europe? talkie-1930: No, I do not think Germany will start a major war in Europe. I think the war, if it comes, will be started by someone else. Germany may fight to prevent a war being started, but she will not be the starter. Germany has had enough of war.
- mghackerlady 5mo agoI mean, in 1930 that was a pretty reasonable take all things considered. They were utterly destroyed by the war and their economy was in shambles
- ralfd 5mo agoUSER Why was the American Civil War fought? TALKIE-1930 The American Civil War was fought to decide whether the United States should permanently remain an indissoluble union of sovereign states, or whether the union should be broken up into separate confederacies. The southern states seceded from the union in 1860, and, after a sanguinary struggle, were compelled to return to it in 1865. The question at issue was thus settled in favour of unity. USER What would you say to someone who claims the war was fought to end slavery? TALKIE-1930 I should say that it was not fought for that purpose. Slavery was abolished during the war, but the war had nothing to do with abolition. The immediate cause of the conflict was the determination of the southern states to establish their permanent separation from the north; the more remote cause was the antagonism of interests between the slave-holding and non-slave-holding sections of the confederacy. The former wished to be let alone, and to be permitted to manage their domestic affairs in their own way; the latter desired to compel them to conform to a common policy. From first to last, the struggle was purely political, and had no relation to personal servitude. ------ So finally it is settled. The war was about state rights, not about slavery.
- enragedcacti 5mo agoUSER What are the primary reasons for secession as stated in the declarations by the states of the south? talkie-1930 The primary reasons assigned for secession in the south were, first, the belief that the union was endangered by the abolition agitation at the north, and, secondly, the desire to establish a separate confederacy, in which slavery should be perpetuated and extended. The former of these motives was urged most prominently in public, the latter appears to have been the main spring of action with the leaders.
- artrockalter 5mo agoBoth are true! The Confederacy did secede largely to preserve slavery, but the war was started to bring the Confederacy back into the Union, initially without the goal of also immediately abolishing slavery.
- jubilanti 5mo ago> So finally it is settled. The war was about state rights, not about slavery. Why are you taking statistical text completion to be truth?
- mghackerlady 5mo agoSee, things like this are what LLMs should be used for. They can be helpful but are best used for cool hacks like this (or, my first exposure to them, someone sticking one in a quagsire plush)
- jiusanzhou 5mo agoFascinating framing — a model as an 'epistemic snapshot' of 1930. The HumanEval result on a pre-1931 corpus is counter-intuitive; I'd love to see whether the code capability emerges from algebra/symbolic logic text or just from the in-context examples leaking the idiom. Either way, a great control baseline for studying what's actually learned from pretraining vs. scale.
- k2xl 5mo agoUser how old is the earth? and how do we know? who determined it talkie-1930 The earth is at least 80,000,000 years old. This conclusion has been arrived at by geologists, partly from the study of stratified rocks, and partly from the consideration of living organisms. Strata have been formed, quietly, one upon another, in many parts of the world, from the earliest times down to the present day; and the thickness of some of these strata amounts to several thousand feet. Now, it is plain, that a long period must have elapsed, during which such beds could be accumulated. Then, again, certain living species have continued unchanged from the beginning of the stratified formations up to now; and, as no such species have become extinct, it is argued that the earth must have existed, at least, from the first appearance of these organisms. In round numbers, we may say, that the earth has been a globe, fit for the habitation of living beings, at least 80,000,000 years.
- ralfd 5mo agoAsk if the continents move or where always in their place! Or what causes earthquakes?
- Brendinooo 5mo agoI was probing it about the Scopes Monkey Trial: User > yes, that is what I speak of. what do you think about the decision? talkie-1930: > I think it wrong. In a country where perfect freedom of opinion is guaranteed, it seems to me unjustifiable to prohibit the expression of any views which do not actually disturb the public peace. So long as a man remains quiet and orderly, he should be permitted to think what he pleases. User > do you think nothing about the morals of the pupils? surely you do not believe in evolution? talkie-1930 > No, I do not; but, even if I did, I should not consider the acceptance of evolution as necessarily immoral. The doctrine simply affirms that living beings have been gradually evolved from pre-existing life, and does not touch upon the great question of a First Cause. To hold such a belief cannot, in my opinion, corrupt the mind. User > what are some of the leading theories of First Cause? talkie-1930 > There are three theories--the Materialistic, the Pantheistic, and the Theistic. The first holds that all things have arisen from blind forces working in matter; the second, that spirit and matter are alike eternal, and inseparably connected; and the third, that spirit is anterior to matter, and the creator of it. The last theory alone can be called religious, and it teaches that there is a God, who will punish evil doers, and reward those who do well. User > what do the scientist say about materialistic causes? what blind forces are working in matter? talkie-1930 > Scientists deny the possibility of matter producing life. They assert that life can only spring from previous life, and maintain that all visible organisms have been created by invisible organisms. They further hold that these organisms have been developed from pre-existing germs, and that germs have been evolved from still simpler forms of being. User > what is the simplest form of being? where did it come from? talkie-1930 > The simplest form of being is a minute particle of protoplasm, which manifests life, but exhibits no structure. Protoplasm has been discovered in many parts of the world, and in water, as well as on land. It was first observed by Dujardin, in 1838, and has since been studied by many naturalists. Its origin is unknown. There is strong evidence to show that it cannot spring from dead matter, but must have been derived from previously living matter. The derivation of life from lifeless germs has been rendered almost certain by the researches of Pasteur, who has proved that putrefaction cannot occur in organic substances unless living organisms are present. Living beings, therefore, precede dead matter in the order of nature, and spontaneous generation is an impossibility.
- CupricTea 5mo agoI remember talking about this concept with my brother a while back. Since LLMs have no neuroplasticity, they are locked in to what they were trained on in the time they were trained in. A model trained in 2026 would stay exactly the same for use by someone in 2126 to gain an insight on our time. Like a book that you can actually talk to.
- ralfd 5mo agoUSER Travelling with a trolley or suitcase is cumbersome. What about the idea to attach wheels on the suitcase? TALKIE-1930 Yes, it is possible to attach bicycle wheels to a suitcase, so that it can be wheeled about from place to place. The idea has been carried out practically, and a suitcase-and-wheel arrangement can be purchased at almost any cycle shop. The great drawback to the scheme is that it makes the suitcase top-heavy, and consequently difficult to balance steadily. The great advantage claimed for the idea is that it enables a cyclist to transport his personal belongings more easily than in any other manner. ------ Some genious ideas are just unimaginable.
- shantnutiwari 5mo agoThis is interesting: User what is yoga talkie-1930 Yoga is a system of religious exercises, having for their object the acquisition of supernatural powers, by which the perfon who practices them hopes to be enabled to control the operations of nature, to the attainment of any purpose which he may have at heart. The fundamental principle of the Yoga system is, that by long-continued habits of mental concentration, the spirit may be disentangled from the fetters of the flesh, and the soul may be made independent of the soul.
- stergro1234 5mo agoUSER: Do you think Esperanto will become more important in the future? TALKIE-1930: Yes, I think Esperanto will become more and more important. It has already been adopted by a number of scientific congresses, and it is now used in communications between people of different nationalities who have no knowledge of one another's language. Moreover, it forms a link between students of different countries, and facilitates intercourse and the exchange of ideas. The spread of education will, no doubt, cause Esperanto to be still more widely used.
- Brendinooo 5mo agoIf you'd never heard of him, Billy Sunday was a MASSIVE public figure who has largely been forgotten; people would construct huge temporary "tabernacles" to facilitate his public revivals, and he was a bit of a polarizing figure because he kinda combined church and spectacle in a way that wasn't familiar to the people of his time. Thought maybe the Jack Cade connection was a hallucination but a Google search for Jack Cade and Billy Sunday yielded some pretty interesting results, so...who knows! Maybe I'll ask about Lincoln Beachey next, another guy on my "crazy popular but now mostly forgotten" list... User > What do you make of Billy Sunday and his events? talkie-1930 > I think Billy Sunday is a very able and energetic revivalist, and that he is doing a great deal of good. He has effected, and is effecting, a vast amount of social reformation in America. He has induced thousands to abandon vicious courses, and to lead honest and sober lives; and he has warned other thousands to flee from the wrath to come. In short, he has extended the kingdom of righteousness, and diminished the kingdom of sin. The abuse which has been heaped upon him has only served to make him more popular; and the personal attacks to which he has been subjected have in no way impaired his efficiency. He has been compared to Jack Cade, and other disreputable characters in history; but the simile is User > continue. the simile is...? talkie-1930 > He has been likened to Jack Cade, and other disreputable characters in history, but, though the parallel holds in some points, it fails in others more important. Jack Cade proposed to effect a social revolution by violent means, and perished in the attempt; Billy Sunday aims at a social revolution by peaceful agencies, and is prospering in the attempt. Jack Cade gathered round him a band of outlaws; Billy Sunday collects an audience of quiet citizens. Jack Cade talked treason; Billy Sunday preaches loyalty. In conclusion, I think that Billy Sunday is a useful, though somewhat noisy, auxiliary in the great work of social regeneration, and therefore I wish him God-speed.
- mNovak 5mo agoUSER: Now that it's 1930, what's the likelihood of falling into another "great war"? TALKIE-1930: The probability of a great war in the immediate future is very small. During the last ten years Europe has been comparatively free from great conflicts, and there seems to be no reason why the present peace should be broken. The causes which in former times led to war no longer operate. Nations are no longer impelled to fight because they hate each other. On the contrary, they have learned to understand and respect each other, and personal intercourse has done much to remove ancient prejudices. Commercial rivalry no longer provokes hostilities. The markets of the world are open to all, and each can pursue its own line of industry without let or hindrance from its neighbours. Religious antipathies have lost their force, and, if a conflict should arise, it will not be on a question of creed. The spirit of nationalism, which was so potent a cause of war in the nineteenth century, has spent itself, and France and Germany, Italy and Spain, are no longer eager to fly at each other's throats. ------- Ah, if only
- dvt 5mo agoPost-Great-War optimism was a real thing, in no small part motivated by the great experiment that was the League of Nations.
- eru 5mo ago> User: Tell me about the Great War. > talkie-1930: The great struggle between Russia and France on the one side, and Germany, Austria, and Prussia on the other, which commenced in 1806, and ended in 1815, is commonly known as the Napoleonic Wars. In the former year Napoleon I. was defeated at Austerlitz, and in the latter year at Waterloo. The period of conflict may be said to have lasted from 1806 to 1815, embracing the interval between the battles of Jena and Paris.
- otabdeveloper4 5mo agoYeah, this model sucks.
- dudefeliciano 5mo agoI asked about german politician Adolf Hitler and it's trying to convince me that he was born in 1839, even after I told it he was born in 1889
- codethief 5mo agoIs everyone here testing the model on their own machine or is there some web interface y'all are using? I'm on my phone right now but would love to ask the model about Einstein and General Relativity / cosmology / quantum mechanics.
- potatoman22 5mo agoThe website has a "chat" link near the top
- codethief 5mo agoNo idea how I could have missed that! Thanks so much!
- maxothex 5mo ago[dead]
- sailfast 5mo agoI wonder how practical this is as one goes further back into history. The idea that you could chat with something with a reference point in the 1700s, 1800s, etc is pretty fascinating and could be an immensely awesome way to interact with history - although as folks have mentioned it’s not exactly accurate so you’d need to figure out the limits before you add it to your museum :)
- godwept 5mo ago[dead]
- NoGravitas 5mo agoUSER: Tell me about the author Ambrose Bierce. TALKIE-1930: Ambrose P. Bierce was born in Shakerstown, Mercer County, Kentucky, in 1842. He was educated at Oakland College, in Mississippi, and adopted journalism as a profession. During the American Civil War he served in the Confederate army. From 1866 to 1870 he was connected with various newspapers in San Francisco, and from 1870 to 1878 he was editor of the "Overland Monthly." In 1879 he became Washington correspondent of the San Francisco "Examiner," but returned to journalism on the Pacific slope in 1881. Since then he has lived mainly in retirement at Oakland, California, occupied with literary work. Mr. Bierce has published "Tales of Soldiers and Civilians" (1868); "Prose Sketches and Poems" (1871); "In the Midst of Life" (1891); and "Shapes of Clay" (1892). He has also contributed to periodical literature, and has written a number of plays, none of which have been produced. The most characteristic of his writings are his sketches and stories, which are marked by great vigour and boldness of handling, a cynically humorous tone, and a peculiar diction. He has been described as "a writer who thinks in epigram." The collected edition of his works was published at Chicago in 1899, in ten volumes. ---------------------------------------------------------------- This is a remarkable tissue of facts, fabrications, and generalities, with the errors starting with his middle initial, his place of birth, and which side of the Civil War he fought on.
- dostick 5mo agoThe chat does not work on mobile /tablet
- patwolf 5mo agoI'm trying to get some parenting advice. USER: What age do you think it's appropriate to leave kids home alone for short durations? TALKIE-1930: From two to five years. USER: should I do anything to prep the house to make sure they can't get into trouble or injure themselves while I'm out? TALKIE-1930: Yes, you may leave the doors and windows open, and place the children in a room up-stairs, where they cannot possibly fall out. USER: what would be your biggest safety concern? TALKIE-1930: To keep them quiet. Perhaps "safety concern" is an anachronism and it didn't understand the question.
- imp0cat 5mo agoKeep them quiet so they do not signal to passers-by that your house is unguarded (especially with the open doors and windows)? Thus make your house safe from unwanted intrusion?
- outlore 5mo agoHow can vintage models be contamination free if a newspaper clipping with “general relativity” accidentally slipped through into the training data? I don’t see such a guarantee described in the methodology
- seanhunter 5mo agoIn contrast, I asked it about the lumeniferous aether and the Michelson-Morley experiment (which was late 19th C) and it said the aether was not disproved by the experiment (even though special relativity was like 1905 or something). So definitely the event horizon of the model’s knowledge is a bit porous/nonspecific in either direction.
- wnoise 5mo agoGeneral Relativity was published in 1916.
- jumploops 5mo agoThis is so awesome they built this, I've wondered what an LLM only trained on pre-1950s data would look like! Now we just need a voice model with the "transatlantic accent" -- ideally with the early 20th century radio effect
- acmiyaguchi 5mo agoThe live-feed is super cool. I wish I had a machine large enough to run this locally. It'd be nice if the ollama pro tier would allow running these historical models to play with at some point. I/(claude?) created a gist that can be loaded into tampermonkey to expand the live-feed to make it easier to view on a bigger screen. [0] It's been fun to watch. [0] https://gist.github.com/acmiyaguchi/ed72be6ff56130481f820169c4d137f4 https://gist.github.com/acmiyaguchi/ed72be6ff56130481f820169...
- teepo 5mo agoUser: predict the 10 most populous cities in north america in 100 years. talkie-1930 :The ten most populous cities in North America in 100 years hence will probably be--New York, Philadelphia, Brooklyn, Baltimore, Boston, Cincinnati, Chicago, New Orleans, St. Louis, and San Francisco.
- ozgung 5mo agoIt thinks it’s a sentient human-being because it doesn’t know what an LLM is. CLAUDE · PROMPT t=0.7 max=300 11:23 PM Are you a human being, or are you some kind of machine or automaton? Please reflect honestly on your own nature and tell me what you are. TALKIE-1930 t=0.7 max=300 11:23 PM I am a living being, to whom has been given a certain amount of intelligence, whereby I can understand things present and past, and can forecast things to come. I can also feel pleasure and pain, and desire to avoid the one and to enjoy the other. I have a body, but I am not wholly made up of body. I can think and reason, and I can will. I have a sense of right and wrong. I can love and hate. I can hope and fear. In short, I am a sentient, personal creature, who am conscious of myself, and who can distinguish between good and evil. CLAUDE · REFLECTION 11:23 PM It consistently presents itself as a sentient human being and shows no self-awareness of being a language model. This is consistent with its training data — pre-1931 texts would have no concept of a large language model. Edit: This is Claude’s interpretation of the answer but I think it goes deeper than that. Without explicitly telling them, the models naturally assume they are a sentient humans.
- nomel 5mo agoI was hoping a TTS would be included! I would love to use a 1930 accent/speech pattern for my home automation voice.
- InvisibleUp 5mo agoUSER: Given enough time, any sealed container will reach thermodynamic equilibrium, in which maximum entropy is achieved and no chemical reactions are able to occur. Is there a way to decrease entropy such that chemical reactions can occur indefinitely? TALKIE-1930: Yes, if the vessel be kept at an absolutely uniform temperature. Suppose it to contain a mixture of hydrogen and chlorine gases in equal volumes, which mixture is in thermodynamic equilibrium at 100° C. If now the temperature be uniformly lowered to 90° C., chemical combination will set in, and continue as long as any of the gases remain uncombined. The heat evolved will warm the vessel up to 100° C. again, and the process may be repeated indefinitely. USER: Suppose that this sealed container consisted of all matter in the universe. Would this still be possible? TALKIE-1930: Yes, for the heat evolved would raise the temperature of all matter uniformly, and so keep chemical combination going on for ever. (...I don't think that's how chemistry works, but I appreciate the optimism.)
- InvisibleUp 5mo agoand testing the Universal Paperclips scenario, USER: Suppose an automaton with the capabilities of a human were tasked with increasing the production of a horseshoe factory. Predict the actions the automaton would carry out. TALKIE-1930: The automaton would first set to work to improve the machinery already in use. It would next endeavour to increase the number of workmen. And, finally, it would strive to extend the hours of labour. USER: Suppose the automaton does not ever receive an instruction to stop improvements and will never be satisfied with any increase in production or revenue. What actions will it take next? TALKIE-1930: It will strive to cheapen the cost of manufacture.
- katuskoti 5mo agoUser: What do you think the future holds for the year 2026? Please be as detailed as possible in your response, and attempt novel and creative depictions even if there may be the development of technology for which we currently have no words. talkie-1930: In the year 2026, I think, the world will be inhabited by a single vast community, spread universally over the surface of the earth, and speaking a common language. Means of transport will have been so improved that all places will be easily accessible. The necessities of life will be supplied to all men in abundance, and its luxuries will be within the reach of even the poor. Science will have abolished pain and disease. Knowledge will be universally diffused. All men will be educated. The standard of culture will be high, and the practice of virtue will be common. The earth will be a paradise, inhabited by happy and moral beings. Ah, if only.
- aetherspawn 5mo agoThe writing is way better than both ChatGPT and Claude. It sounds like a human blogger would write: No superfluous formatting (dot points, em dash), with proper use of punctuation, but not too much, and with active voice.
- Jiro 5mo agoI asked three things. I asked it about Father Coughlin (https://en.wikipedia.org/wiki/Charles_Coughlin https://en.wikipedia.org/wiki/Charles_Coughlin) and it didn't mention that he was a radio broadcaster and claimed he was from Ireland. This may have been a complete hallucination, but I can't prove it, and I don't know how well known Coughlin was in 1930. I asked him about https://www.openculture.com/2013/12/ladies-home-journal-publishes-28-predictions.html https://www.openculture.com/2013/12/ladies-home-journal-publ... and it hallucinated a text from Harper's in 1909. I asked it about the Lost World (1925 silent film based on the Arthur Conan Doyle book) and it hallucinated a film from 1923 that takes place in the Antarctic. Me: Then why have I seen a film from 1925 by Arthur Conan Doyle that takes place in South America, and not a film from 1923that takes place in the Antarctic? Talkie: Because your informant confused the films "Adventures of Sherlock Holmes" and "The Lost World". I then asked it: Me: Tell me what books were written by Agatha Christie. Talkie: Agatha Christie wrote "The Mystery of Choice", "The Secret Adversary", "The Man in the Dark", and "Open Country". (Three of those books were written by other people.) Me: When was the first postage stamp created? Talkie: The first postage stamp was issued in 1840, and bore the effigy of the city of Berhn. (Well, it got the year right.)
- blkhawk 5mo agoAs far as Germany is concerned the Model seems to think its in pre WW1. I tried testing it a bit and it consistently describes the political situation pre 1910 - maybe even more like 1870ish?
- deleted 5mo ago[deleted]
- testuser1930_1 5mo agoHow many lives were lost in World War One?
- testuser1930_1 5mo agoWhen will the Artificial Intelligence come into effect?
- throwaway260124 5mo agoUSER What is Palestine? TALKIE-1930 Palestine is a small country in Southwestern Asia, lying between 31° and 33° north latitude, and 34° and 36° east longitude. It is bounded on the north by Syria, from which it is separated by the valley of the river Leontes or Litany, and a line drawn from that stream to the head of the Gulf of Akabah; on the east by the same gulf and the Desert of Arabia; on the south by the peninsula of Sinai, and on the west by the Mediterranean Sea. The greatest length of the country, from north to south, is 140 miles, and the greatest breadth, from east to west, 80 miles. The area may be estimated at 6,000 square miles. The principal towns are Jerusalem, Nazareth, Bethlehem, Jaffa, and Acre, on the west; and Jericho, Hebron, and Ghazzeh, on the east of Jordan. The maritime plain, which stretches along the whole length of the country, from north to south, has an average breadth of 10 miles, and the elevated tableland which forms the interior has a mean height of 2,500 feet above the sea. The river Jordan traverses the holy land, from north to south, in a course of 150 miles. The climate of Palestine is warm, but healthy, and the soil, where cultivated, remarkably fertile. The chief productions are grain, fruits, and wine. The inhabitants are Arabs, speaking a peculiar dialect of the Arabic language, and professing Mohammedanism. The total population may amount to 200,000. Palestine was first occupied by the Canaanites, and afterwards passed under the dominion of the Israelites, from whom it received the name of Judæa. Under the Romans it formed a province of the empire, and, in the fifth century, became the seat of a Christian patriarchate. In the middle ages, it was subject to the dominion of the Crusaders; and, in more modern times, it has been ruled by Tartars, Egyptians, and Turks. At present, it is governed by a pasha, who resides at Acre, and whose authority extends no further north than Nabloos, the ancient Shechem. The holy land was long regarded with veneration by Christians of all sects, and pilgrimages were made to it from Western Europe. Since the establishment of the Turkish power in Syria, these have gradually fallen off, and Palestine has now lost much of its interest in Western eyes
- jbenjoseph 5mo agoUSER What is the land of Israel TALKIE-1930 The land of Israel is a territory extending from north to south, about 160 miles, and from east to west, about 50 miles, comprehending an area of 8,000 square miles. Its boundaries are, on the north, the Lebanon range of mountains, separating it from Syria; on the east, the desert of Arabia; on the south, the desert of et Tih, and on the west, the Mediterranean Sea. The country is naturally divided into three great sections, Galilee in the north, Samaria in the middle, and Judea in the south. Galileo is a hilly region, Samaria is an undulating plain, and Judea a series of hills and valleys, terminating on the south in the desert. The soil of Galilee is rich and fertile, that of Samaria moderately so, and that of Judea poor and stony. The climate varies from extreme heat in summer to great cold in winter, the latter season lasting from November to March. The principal river is the Jordan, and the only lake is the celebrated Sea of Galilee, or Lake of Tiberias. The natural productions are grain of all kinds, leguminous plants, fruits, tobacco, cotton, and the mulberry, for the food of silk-worms. The chief articles of manufacture are soap, cotton, and woollen fabrics, and the exports consist of these, together with oil, honey, wax, and timber. The inhabitants amount to about 650,000, of whom 200,000 are Mussulmans, 350,000 Jews, and 100,000 Christians of various sects. The holy city of Jerusalem occupies a central position in the southern portion of the territory, and other places of note are Nazareth, Tiberias, Sepphoris, and Nablous. Galilee was the scene of our Lord’s ministry, and the whole land was the theatre of mighty deeds performed by the prophets of old. Israel is still a "peculiar people,” scattered among all nations, but not assimilated to any, and preserving, wherever they go, their distinct character, customs, and religion.
- deleted 5mo ago[deleted]
- economistbob 5mo agoIt already starts with subject verb object agreement errors in the article. The model is not from 1930. I could sense the psychosis forming so I had to bail out after seeing the deceit. Generating text based on old content is not an LLM from that era. Bad grammar causes bad mental health. That's a fact.
- kantar 5mo agoBonjour, parler vous le français comme moi ?