kromem

19 ms·

211.
by kromem 3y ago
If we're anthropomorphizing, it's more like a post-stroke Wernicke's aphasia.
212.
by kromem 3y ago
Well, we started with emulating humans producing text. But then quickly pivoted to find tuning and instructing them to produce text as a large language model. Which isn't something that existed in the text they were trained on. So
213.
by kromem 3y ago
My favorite works to date regarding a mirror universe answering cosmology open questions is the stuff Neil Turok's been spitting out over the last decade: https://insidetheperimeter.ca/a-mirror-universe-might-tell-a...
214.
by kromem 3y ago
You'd be unable to do so.
215.
by kromem 3y ago
Was your memorizing it infringement? I'm all for policing the outputs of generative models and enforcing copyright on their usage . I am very much against ruling that their training is infringement. A model which uses old NYT arti
216.
by kromem 3y ago
Human brains have a limit on the number of things they can deal with simultaneously called "the rule of seven plus or minus two." I don't know if you've seen the demo of Gemini 1.5 parsing a video with a 1M context lengt
217.
by kromem 3y ago
The model producing copyrighted material isn't as great an argument as people seem to think. The cases are pursuing training as infringement, not usage . So in the case of Mario - there's no infringing in learning the attribute
218.
by kromem 3y ago
It's only a cause for concern if its capabilities are going to plateau. More likely, advances in the field will mean that we end up in a more accessible world, where developers who don't normally think about accessibility have a g
219.
by kromem 3y ago
Of course the irony is that being "outside" is actually watching a live video recording of it from outer cameras on a screen in front of your face. I'm not necessarily criticizing that - more thinking that we're likely a
220.
by kromem 3y ago
Keeping them separated would also improve future training.
221.
by kromem 3y ago
So the top two stories are about a model that can generate astonishingly good video from text and a model that has a context window which allows it to process and identify nuanced details in an hour long video. We've fairly quickly mov
222.
by kromem 3y ago
There really isn't a moat. Dall-E was crazy and then suddenly people were doing the same thing on consumer hardware with an open model within a year. Filmmakers being able to bring their vision to life using generative models is going
223.
by kromem 3y ago
It's already been here. I can't recommend enough for anyone who missed it to use the wayback machine to look at the top posts in /r/bing exactly a year ago. 'Sydney' which was allegedly a pre-RLHF chat version
224.
by kromem 3y ago
I think this notion can be more generalized: "most ideas are bad startup ideas." An industry with a 90% 10yr failure rate isn't one where the majority of its members embody wisdom and foresight. So there's counterexample
225.
by kromem 3y ago
It's pretty wild watching technology develop where I genuinely don't have a confident idea of just how far it will progress by December in February of the same year. Open models have just been on fire lately, and the next generati
226.
by kromem 3y ago
What's wild is that when I read the headline I assumed this was faking work for desktop monitoring for their work. But no, the comments are people using it to fake that they are working to their family or kids, even taking back to the
227.
by kromem 3y ago
More "as they are fine tuned" vs "as they scale"
228.
by kromem 3y ago
And yet when we've seen intentional attempts by neo-Nazis to have models echo their viewpoints by Grok or Gab's literal Adolf Hitler LLM the models default to telling them off as morons or disgusting. Maybe adding a greater degr
229.
by kromem 3y ago
It's also going to be damaging long term. We're around on the cusp where models are going to be able to produce strong ethical arguments on their own to feed back into alignment. We saw how the "free speech" Grok told of
230.
by kromem 3y ago
... we've only realistically had two generations. I'd thought it would move faster when there was hope it could piggyback on mobile phone subsidies from carriers, but once that was clear it wasn't going to be the case it was
231.
by kromem 3y ago
The mantra about premature optimization applies to infrastructure too.
232.
by kromem 3y ago
Except complexity as an issue is primarily about readability. Fine, a junior developer has a switch statement that's like 10 things long within a function with several if/else branches and they refactor to meet complexity limits b
233.
by kromem 3y ago
After a lot of experience with VR/AR, for me it's come down to: - Comfort - Quality I've yet to use a headset I'd wear for 8 hours a day without leading a rebellion against my torturers forcing me to after a few weeks.
234.
by kromem 3y ago
Yep. That's pretty much exactly my process for the sections. Read Abstract. Look over Methods. Skim Conclusions. And finally take a closer look at the Supplementary data (which is usually where I end up very happy or dissatisfied with
235.
by kromem 3y ago
Yeah. Having a searchable database of translations for all texts discovered and translatable will be amazing.
236.
by kromem 3y ago
Not really. He multiple times goes out of his way to have the Librarian state that it cannot understand analogy. There's literally a paper on improved success at prompting by having a model create an analogous problem, solve that, and
237.
by kromem 3y ago
These days 90% of "AI can't do this" comments are people using 3.5 instead of 4.
238.
by kromem 3y ago
In the 50s, it was thought that we were smarter than them and killed them all off (the author of Lord of the Flies even wrote a book on this). This seemed to inform futurists at the time thinking about what it would one day look like if the
239.
by kromem 3y ago
Our CI builds and tests using the 'latest' container for Go, and we have a fairly robust test suite so it essentially auto-updates as things go and breaks the pipeline if anything doesn't work, at which time we either decide
240.
by kromem 3y ago
The Markov chain by definition satisfies the Markov property ( https://en.m.wikipedia.org/wiki/Markov_property ). If you want a more in depth sense of why it's not, look at the following link that describes the tran

More ›