3 ms·
>> I was very interested to read the story a few days ago about the relationship between compute resource and results in deep learning. https://blog.openai.com/
by YeGoblynQueenne 9y ago
>> I was very interested to read the story a few days ago about the relationship between compute resource and results in deep learning. https://blog.openai.com/ai-and-compute/ https://blog.openai.com/ai-and-compute/?
Aye. My reaction to that graph was that this rate of progress can't be sustainable. If industry was throwing good money after bad to find out for how long you can keep ussing bubblesort given more and more compute, before having to develop a better sorting algorithm- that's what it would look like.
>> Answer sets explode all solutions and then eliminate contradictions, we couldn't have dealt with them in the 90's (much less in 1985) as the idea of having 10G data structures in memory would have made people lol... but now so what?
ASP is interesting. There are symbolic learning techniques that learn answer set programs from data, did you know that?
- sgt101 9y agoI didn't know that anyone had done that for answersets, could you share the reference? But on the other hand Stephen Muggleton has been developing systems to learn parts of logic programs for a long time, also I wrote a genetic programming system to learn prolog clauses but that was vs a hand coded objective function rather than vs. data.
- YeGoblynQueenne 9y agoTo be honest, I'm not terribly familiar with the bibliography on learning AS programs, but you could look for work on ASPAL, ILASP and ILASP2 by Alessandra Russo, Mark Law and Krysia Broda. The following are relevant, but not exhaustive and probably not the first papers discussing this but you can follow the refs :) Learning Through Hypothesis Refinement Using Answer Set Programming https://link.springer.com/content/pdf/10.1007%2F978-3-662-44923-3_3.pdf https://link.springer.com/content/pdf/10.1007%2F978-3-662-44... Iterative Learning of Answer Set Programs from Context Dependent Examples https://arxiv.org/pdf/1608.01946v1.pdf https://arxiv.org/pdf/1608.01946v1.pdf Learning Weak Constraints in Answer Set Programming https://spiral.imperial.ac.uk/bitstream/10044/1/33615/8/AcceptedVersion.pdf https://spiral.imperial.ac.uk/bitstream/10044/1/33615/8/Acce... Finally, this is from Mark Law's portion in the Logic-based Machine Learning course at Imperial College London: https://www.doc.ic.ac.uk/~ml1909/teaching/Non-monotonic%20Logic-based%20Learning,%20Summary.pdf https://www.doc.ic.ac.uk/~ml1909/teaching/Non-monotonic%20Lo... Full disclosure: I'm a Phd student of Stephen Muggleton's. If you're interested in where ILP is nowadays, our group is currently working on Meta-Interpretive Learning, a recent advance that learns complete logic programs, with recursion and predicate invention from relational data: https://github.com/metagol/metagol https://github.com/metagol/metagol ... and I'm very excited about it :)
- sgt101 9y agoOh super - would you have any time to show it to me if I toddled over to Imperial at some point ?
- YeGoblynQueenne 9y agoAbsolutely. See my profile for my email. I tend to stay at home and go to Imperial for supervisor meetings only, once a week, but I'm sure we can arrange something :)