Cybiote

20 ms·

121.
by Cybiote 8y ago
As you point out, that the relative ordering remained stable means progress being made is not simply overfitting to the test set. The negative finding from the paper you link to is in how much accuracy drops considering how slight modificat
122.
by Cybiote 8y ago
The phrasing of pendulum swinging in relation to symbolic was also used by Micheal Jordan here (search for pendulum): https://medium.com/@mijordan3/artificial-intelligence-the-re... It's clear that AIs based solel
123.
by Cybiote 9y ago
Yeah, it's the same general principle of using a model to cheaply speed up policy learning. An advantage to their approach however, is that it learns a latent space and generalizes better. The VAE learns a compressed vector and the lat
124.
by Cybiote 9y ago
9.9 times out of 10, I'd be in strong agreement with you. This time however, I think the use of the term "dream" is not as egregious as would be typical. When we dream, we often believe we're conscious and multiple sense
125.
by Cybiote 9y ago
Analogies can help but if taken too far, will provide only illusionary knowledge from superficial similarities. Consider, if you trace out the hierarchies induced by interactions in biological networks and then do the same for an OS's
126.
by Cybiote 9y ago
Linking biology to specific concepts in computer architecture or worse, with OS design, is indeed a stretched analogy but biology is rich with computation. I'll try to be short. A cell must sense and respond to its environment. One asp
127.
by Cybiote 9y ago
Whether it's okay to ignore word order really depends on your goals. In my work, tracking word order to build a sentence representation is necessary to get composition rules correct. You can get away with ignoring order surprisingly of
128.
by Cybiote 9y ago
An important observation is that the probability of death drops very rapidly with drops in speed. A rough calculation shows that at 38 mph and a near instant reaction (as a robot should) would within ~1 second of applied breaking force, all
129.
by Cybiote 9y ago
As of this posting, if you put a "what" in front of the query, it returns the correct average distance. I suspected the parser, even if it was learned, is sensitive to the query format. Despite what the press teams of large compan
130.
by Cybiote 9y ago
This is a poor example considering evolution is anything but brute force trial and error. Each organism can be considered either an hypothesis or a collection of hypotheses about the background environment ( https://arxiv.org&#x2F
131.
by Cybiote 9y ago
Correction to the above: I stated Deepmind applied Neural Nets+MCTS and achieved ok results. I was actually misremembering two David Silver (Deepmind) papers as one. Smooth UCT modified UCT (popular brand of MCTS) to be able to handle imper
132.
by Cybiote 9y ago
The difficulty of imperfect information is from cross cutting through information sets and partial observability. With perfect information games like chess or Go, one can solve subgames with guarantees that the equilibrium is the same as fo
133.
by Cybiote 9y ago
Let's break this down and consider things carefully. To informed researchers, what is most surprising here is not that the AlphaGo Zero algorithm beat stockfish but that MCTS managed to outperform Alpha-beta search. I'll venture a
134.
by Cybiote 9y ago
I disagree. I found his meaning clear. The core of the essay is that thinking with the right abstractions provides greater boons to reasoning capacity than comparatively trivial differences in human IQ. To make things a bit more concrete, t
135.
by Cybiote 9y ago
As someone of skill in both topics, I was similarly confused but my misapprehension remained for a few seconds more. As luck would have it, the first sentence my eyes alighted on was Trees and Concrete Data .
136.
by Cybiote 9y ago
That a process is non-conscious does not necessitate that it is primitive or incapable of sophisticated inference and computation. Sophistication and conscious reportability are absolutely not anti-correlated. Indeed, if I were to lean one
137.
by Cybiote 9y ago
Yet, together with the machine, given no other recourse, I would have been able to extract the essence. As an example, I originally missed your english text and thought the task was to translate the german. I ran the garbled german through
138.
by Cybiote 9y ago
An AI can be like an electric bicycle, multiplying your existing ability. It can be like a car, working side by side. Or it can be like a self-driving car, leading your driving skills to rot with time. You're assuming the only form is
139.
by Cybiote 9y ago
Don't have anything relevant to say except to make a fun note that we can change your second sentence, keeping it correct, while increasing its ambiguity. If we restate it as: Are they talking about basically getting the most out of t
140.
by Cybiote 9y ago
As with almost all things machine learning, python libraries are where you will find most of the action. I can recommend https://spacy.io for a low fuss solution to get you up and running quickly. Oversimplifying quite a bit, if
141.
by Cybiote 9y ago
I agree with you. I remember skimming the paper and finding it interesting but wondered if selecting that term might set too many imaginations running. I don't have a problem with their calling it imagination, though. But consider that
142.
by Cybiote 9y ago
Dependent or even refinement type systems are where a great deal of research into proof carrying code is done (for refinement types, since systems are restricted to decidability, the proofs are automatic but more limited).
143.
by Cybiote 9y ago
Although it's true that there are many examples of multiple independent discoveries (supporting the zeitgeist theory of invention), this does not fully explain the nature of discovery and invention. Consider that many of the examples,
144.
by Cybiote 9y ago
I was directly replying to the asked question. But, it is not just the developmental timeline that was off. There's also its hypothesis of what children learn and how they reason or what they are capable of that is inaccurate. Child ce
145.
by Cybiote 9y ago
It's nothing at all like that. I already mentioned the Selection task above, it's a very googleable term. It's old and there is yet no theory fully explaining why people fail at it as they do. Pragmatic reasoning schemas are
146.
by Cybiote 9y ago
The main failures of Piaget's work is that it assumes a smooth progression in reasoning facilities with age and secondly, that its notion of formal operations rests too much on deductive logic. But humans do not really reason logically
147.
by Cybiote 9y ago
Top down predictions are likely mediated by feedback connections from higher to lower areas. Functions include possibly encoding a generative prior for prediction, speeding up inference. They also play an important role in coding more infor
148.
by Cybiote 9y ago
It's not that simple. The creativity is that the combination of rollouts, policy and value networks allow for more efficient traversal of the search space. Which gets you better exploration of possible paths, meaning more options than
149.
by Cybiote 9y ago
As others have pointed out, SGD requires differentiability. The next best match I can think of is that you're actually thinking of subgradient methods , which mostly see use in convex optimization problems.
150.
by Cybiote 9y ago
They might be talking about Business Rules Engines which are elaborations of the Forward Chaining style of inference engine.

More ›