3 ms·
The question I'd have about creating a new programming language for a new technique is what does the syntax give you to compensate for the costing of learning a
by joe_the_user 14y ago
The question I'd have about creating a new programming language for a new technique is what does the syntax give you to compensate for the costing of learning a new language?
- tikhonj 14y agoThis is not an issue of syntax. You can have probabilistic languages with existing syntax--Church, for example, uses Scheme syntax[1]. [1]: http://projects.csail.mit.edu/church/wiki/Mixture_models http://projects.csail.mit.edu/church/wiki/Mixture_models You can even embed your new language in another, well-known general-purpose language, letting you reuse the host language's syntax. Haskell is great for this sort of work. This is entirely a question of semantics. And what do probabilistic semantics give you? They make writing complex models for data much more natural. These languages allow you to abstract away much of the incidental complexity of specifying these models, making the logic clearer. In turn, this simplifies reasoning about the problem and working on a solution. More generally, this is the motivation behind most domain-specific languages. The core idea is to express yourself in a way that fits the domain you're working in. For machine-learning, you want to express your program in terms of probability distributions. For writing parsers, you want to express yourself in terms of CFGs. As people like to repeat, a program written more for people to read than computers to execute, and reading something in terms relevant to the domain is easier than trying to force the domain to fit an existing programming language and paradigm.
- cf 14y agoThe trouble with probabilistic programming is it requires very unnatural control flow to run inference on the models. Now there any solutions like Factorie, Figaro and Infer.NET where they are just a library you call into your code. The trouble is because of the representation you end up with much more verbose code. The cost of learning a new language isn't one you can avoid even if it weren't a language. To write these programs in any system you have to get used to thinking of your data as generated by this unobserved process. Thinking in that way isn't something you can avoid and is actually the main stumbling block.