Vetch

10 ms·

121.
by Vetch 4y ago
I remember reading that geniuses tend to be more likely to have creative or artistic hobbies. Art is an instance of symbolic abstract reasoning. The level of originating new modes of expressing shape and form, which is what all the earliest
122.
by Vetch 4y ago
My experience with the APIs is Google is excellent and Microsoft is slightly better. And the offline model I've been using that's nearly as good as both is facebook's wav2vec2-large-960h-lv60-self. Don't believe what&#x2
123.
by Vetch 4y ago
An automatic rifle has almost no positive use to it. This software is not like that and more like something that makes everyone better at a skill, uniformly raising the artistic talent floor. The large majority benefit but some would use th
124.
by Vetch 4y ago
Perhaps it's the use of the AI moniker but this thing is a computer program under the control of a human, who is the person responsible. It takes time and effort to use and is very much not like automated elevator control. In order of
125.
by Vetch 4y ago
The article is thorough and covers why your [2], under tweening, is insufficient. Video beyond stereotyped repetitive movements is likely AI-complete. Presumably you'd want to be director and be able to control camera angles. You might
126.
by Vetch 4y ago
Being differentiable does not make something a neural network nor does it mean the differentiated function is meaningful (such as can be the case in highly branching or otherwise complex control flow). It also doesn't always escape com
127.
by Vetch 4y ago
I do not believe this is still true in MuZero, where no rules are ever explicitly encoded, beyond what leaks in from the reward function?
128.
by Vetch 4y ago
If you look behind logic programming at what powered deduction engines, you will find that its core is very much tree search algorithms like depth-first backtracking search or iterative deepening, which IIUC, is also central in chess engine
129.
by Vetch 4y ago
And it failed at that. As the text gets longer and longer, the lack of synthesis across the contexts you've glued together becomes ever more glaring. It's a decent hack but not a solution. More research is needed for how to forget
130.
by Vetch 4y ago
Maybe if you've read the story it'd seem good but as someone who hasn't, I consider it a poor summary, especially the latter half.
131.
by Vetch 4y ago
The original phrasing could be worked on but it's not so far out as you say either. > passing blame for current problems Humans think we're special but we're still slightly more complicated networked state machines. This m
132.
by Vetch 4y ago
What is a nudge? Do dark patterns, tactics employed by casinos or loot box games that depend on whales and children of wealthy parents count?
133.
by Vetch 4y ago
Hi, I'm looking but can't seem to find instructions on how to do tokenization. Where is spm model, is it "flores200_sacrebleu_tokenizer_spm.model" or something else? And is it direct or spm -> dict? Or how to prime mo
134.
by Vetch 4y ago
Godot is a great engine that will continue to grow and improve. Unity too is excellent, with many useful professional and tutorial assets. Unity's 3D offerings and tooling are more mature, even as an indie. Some of my favorite professi
135.
by Vetch 4y ago
The interesting aspect of GPT-3+ is their reasoning like behavior such as Chains of thought or "step by step" generation. There's no evidence RETRO as is has sufficient capacity for the actually interesting behaviors.
136.
by Vetch 4y ago
Github's position doesn't appear to offer any advantage with regards to Copilot's creation. OpenAI Codex (which copilot grew out of IIRC), Amazon and Salesforce versions of Copilot exist. Huggingface Bloom was trained on a si
137.
by Vetch 4y ago
There is an economic incentive to detect machine generated output and curate trusted sites since the feedback loop of training models on an unfiltered internet of mostly generated junk output will eventually lead the models into converging
138.
by Vetch 4y ago
The vast majority of generators of fake news today are from Content Mills, Copy Paste Mills and general SEO spammers. Political misinformation is the other big generator. The economics of it and not "ethical" gate keeping is what
139.
by Vetch 4y ago
The experiment is okay, it's actually a special case of a concept explored in Egan's Permutation City and your observation about what's really doing the work applies there too. Except story goes in unsettling directions by re
140.
by Vetch 4y ago
Trust is an ideal to strive towards but the unfortunate case is that its reliability quickly starts to strain with scale. I'd argue the economy at large is held together not by trust but by reputation, curation, regulation and threat o
141.
by Vetch 4y ago
Being an agent isn't about how complex the model is, nor about how much RL is used. Bacteria is an agent. Sponges and Jellyfish are agents. It's about if the model engages in exploration and or generates inferences in service of n
142.
by Vetch 4y ago
The other ones are smaller but not much worse according to their tests (oddly, in the Winograd Schema Challenge and Commitment Bank tasks, the largest model actually appears to be worse than much smaller ones). 30B parameter models are alre
143.
by Vetch 4y ago
Such failures are interesting, in the physicist's sense. That it struggles with composition sometimes but not other times might indicate model has learned a particular distribution factorization which is good much of the time but makes
144.
by Vetch 4y ago
I would not say that. Facebook, Microsoft and Google release plenty of useful models. EleutherAI have released 6 billion and 20 billion parameter language models. Huggingface has been training a 176B model [1]. The issue isn't a lack o
145.
by Vetch 4y ago
It's not like that many people are opening 40 room hotels either. Such amounts are atypical within programming and CS communities. A more relevant example is video games, imagine if the only viable ones were top end AAA games whose com
146.
by Vetch 4y ago
Adding cs and cstheory stackexchanges to the list.
147.
by Vetch 5y ago
> Seems strange that this requires java. A lot of deployed deep learning is in Python so I doubt this will matter. Looking at the docs, it looks like the main speech to text is python heavy, it leverages elasticsearch and calls libraries
148.
by Vetch 5y ago
This is excellent, creative and could also serve as a much less boring than pong project for starting reinforcement learning.
149.
by Vetch 5y ago
> Imagine if real programmer needed to write a solution a hundred times To be fair, a lot of creative work requires plenty of trial and error. And since no problems are solved from scratch, all things considered, the most immediate contr
150.
by Vetch 5y ago
I run into this sentiment often and I believe it's fundamentally mistaken as to the purpose of notes. Recording is not knowing, at best it is memorization of largely useless trivia. Sherlock has a good discussion on this (Sherlock sola

More ›