9 ms·
Hy – A dialect of Lisp that’s embedded in Python
- deleted 12y ago[deleted]
- meric 12y agoIt's beautiful. There's a strange feeling in my heart. - Someone who built a simplistic lisp->lua compiler a couple of years ago at https://github.com/meric/l2l https://github.com/meric/l2l
- drcomputer 12y agoSerendipity :)
- badsock 12y agoIt's a kind of rite of passage, I think, to implement a Lisp. I wrote half (the easy half) of ISLISP that ran on the Python VM back in 2005 :)
- kelvin0 12y agoBut wy?
- deleted 12y ago[deleted]
- Foxboron 12y agoHelluw, one of the core devs here. This was originally an idea just to display whats possible with the Python AST. It's pretty neat. The result is an kinda fancy lisp variant with bidirectional interop, macros and all the fancy lisp stuff.
- gknoy 12y agoIs this something that can be integrated easily with existing Python code? I'd be interested in implementing a small module in Hy, rather than Python, and then include/use/consume it from Python. All the uses I saw listed on the blog were as a replacement for Python, it seemed like, so this might be a direction of integration that wasn't intended. edit: Perhaps I should read more and ask less. It looks like this is what `import_file_to_module` does, right? :-)
- Foxboron 12y agoAll you gotta do is import hy before the given hy module. Hy uses a metaimporter to parse the Hy code and hand the Python compiler AST. So you can import any hy file like normal Python and use the code. Its that simple.
- robhardy 12y agoIs there some way to incorporate Hy snippets into an existing Python script? The plan is that this would allow me to incrementally translate my Python scripts into Hy (I'd start with the easy bits, obviously).
- paultag 12y agoHy core here! It works both ways, and bi-directional interop is intended! Just `import hy` then you can import any `.hy` on `sys.path` :D (yes, this means you can make Hy code pip installable, just like Hy itself!)
- gknoy 12y agoWow. That sounds amazing!
- agumonkey 12y agoBeing an Emacs head, I like sexp based syntax for edition and navigation. Now I can edit hy like any lisp and push it to python hosting servers. my 2 cents.
- yzzxy 12y agoWhat are the particular advantages of a Lisp on the python runtime? Interop with existing programs could be good, as well as a potential trojan horse to convert a dev shop to Lispier languages if you care about that kind of thing. Otherwise I'm not sure - what python libraries stand out as particularly useful in this situation? I haven't really interacted with the world of python that much so I'd love to hear.
- bayesianhorse 12y agoIf you are a lisp-enthusiast, Python comes with strong support for data science and web applications, if nothing else. If you are a Python enthusiast, lisp-like languages can be used to write DSLs or cut down on boilerplate code in a way which isn't as easy in Python or similar languages. But yes, in general, a lisp dialect on Python has the problem that Python itself is a great language.
- jarcane 12y agoPython has one of the biggest standard libraries there is, there is a lot of useful stuff in there already provided, plus there is a humongous amount of third-party packages available through pip. It also generally has a pretty good C FFI, so there's a lot more support of C-libs in Python. It's not so much about any specific libraries as it is about the volume of support one gets 'for free,' and as well I think Python syntax and semantics alike really get along better with Lisp than some of the other dialects that rely on FFIs (like Clojure to Java/JavaScript, or the number of C FFIs available for Schemes). Lisps in general don't tend to include much of a standard library, opting for a 'batteries not included' model, with Racket being perhaps the most prominent (and quite deliberate) exception. So the idea of getting the whole Python ecosystem 'free' is potentially very appealing, especially to someone with a Python background (and there are a lot of those someones around, especially with it increasingly being a more popular teaching language than anything else except JavaScript).
- yzzxy 12y agoRacket (and precursor Scheme for academic reasons) is the Lisp I've interacted the most with besides Clojure, so I never really considered the perspective of a stdlib being so valuable. Clojure->Java and ClojureScript->Js have always seemed super awkward to me, and having a similar naming style could be a great feature. Still, I'm reminded of Greenspun's tenth rule when reading about this project. Hopefully it will become a popular and well-supported option in its own right.
- danabramov 12y agoIt feels strangely.. nice. I was always turned off by Python syntax, but liked the explicitness of Python code. I always liked LISP “syntax” but never learned any LISPs, and Clojure is really dense/implicit IMO. So Hy has a nice and unexpected balance of explicitness/familiarity and aesthetics. But I wonder why someone would prefer this, aside from aesthetics. Macros?
- mattrepl 12y agoWhat about Clojure seems dense or implicit to you? Clojure and Python have a similar feel to me. Both are well-designed in the sense they strive for a small set of primitives useful in solving a broad range of problems.
- danabramov 12y agoSee my reply to your sibling. I appreciate it may be very well designed; just saying there's a barrier for a novice to read it (which is fine, but different from Python). Even if you come from a different background (JS, C#), it's trivial to understand Python code because it reads like English. Both Clojure and Ruby are different because they're more dense (but as a result, probably more expressive). And I'm saying this as someone who doesn't really enjoy Python because it's way too sparse. Oh well, whatever :-). I should go learn some Clojure.
- elarkin 12y agoCan you give an example of where you find Clojure to be implicit? I don't find the Clojure that I write to be implicit.
- danabramov 12y agoClojure(Script) reads Rubyish to me in the sense that I can't read the code until I understand every primitive. Contrast this with Python which almost reads like a natural language (which I don't say is better, but more explicit IMO). (defn widget-c [data owner] (reify om/InitState (init-state [_] {:message nil}) om/IDidMount (did-mount [_] (let [events (sub (:notif-chan (om/get-shared owner)) :hello (chan))] (go (loop [e (<! events)] (om/set-state! owner :message (:data e)) (recur (<! events))))))) om/IRenderState (render-state [_ {:keys [message]}] (if message (dom/p nil message) (dom/p nil "Waiting ... waiting ... waiting ..."))))
- javaistheworst 12y agoExcellent - will have a play with this tonight. Docs look pretty good too, only thing that stands out right now which I want to dig into a bit more is one of the special forms, specifically the dot one - looks like something that would be tricky to see in an eyeball scan of code, but probably worrying prematurely.
- etiam 12y agoFor a moment there I was a bit sad because I thought it had been edited away, but the rampant puns in the charming Quickstart are still around. http://docs.hylang.org/en/latest/quickstart.html http://docs.hylang.org/en/latest/quickstart.html Hyrray!
- aidos 12y agoCan a lisper explain how things like the list comprehension might be implemented? Is it a special control structure that hy knows about or is it something you could implement yourself if it wasn't part of hy? (list-comp (, x y) (x (range 8) y "ABCDEFGH")) The fact that data is bound to the variables x and y within the list comprehension - is that a magical thing? I'm probably not explaining it very well but I thought (as a non-lisper) that you can do things like implement new types of control flow directly in lisp. Could you do that here, or has list-comp been coded directly into the language? Edit: just to add - I think this is a cool project. Really enjoying reading through the docs.
- PuercoPop 12y ago"Real" List Comprehensions in 24 Lines of Lisp[0] [0]: http://lisp-univ-etc.blogspot.com/2013/01/real-list-comprehensions-in-lisp.html http://lisp-univ-etc.blogspot.com/2013/01/real-list-comprehe...
- kazinator 12y agoHow to implement list comprehensions in Lisp is an open-ended topic. For instance, I did it once in a "researchy" way by implementing monads. With the help of CLOS, I was able to define various monads such as the list monad, identity monad, or state transformer monad (the map, join and unit being methods dispatched on the monad type). Then a generic monadic comprehension macro provides different functionality based on which monad is selected. The list monad gives rise to a list comprehension. The identity monad gives rise to just sequential variable binding. And the state transformer monad ... to something like a pipeline of succcessive state transformations, I think. http://www.kylheku.com/cgit/lisp-snippets/tree/monads.lisp http://www.kylheku.com/cgit/lisp-snippets/tree/monads.lisp If you just want a list comprehension, it's not very difficult. Basically it has to expand to code which (for example) expresses a nested loop that steps every variable over its respective list. The expression being collected by the comprehension is stuck into the middle of this loop, inside a piece of code which collects its value into a list, which is stored in a hidden local variable. (Perhaps two local variables are used, to keep track of the head and tail of the list for the sake of efficiency.) ANSI Lisp has functional applicators that process multiple lists. For instance if you want to add together values from two lists, you can do this: (mapcar '+ '(1 2 3) '(10 20 30)) -> (11 22 33) If you wanted to form a cross product of the two lists instead, the obvious thing would be to write a mapcar-like function: (mapcar-cross '+ '(1 2 3) '(10 20 30)) -> '(11 21 31 12 22 32 13 23 33) This function could be used as the target syntax for a comprehension macro so that, say: (list-comprehend (+ b a) (a '(1 2 3)) (b '(10 20 30))) -> '(11 21 31 12 22 32 13 23 33) is macro-expanded into (mapcar-cross (lambda (a b) (+ b a)) '(1 2 3) '(10 20 30)) Translating (transliterating, really) the list-comprehend syntax into mapcar-cross is not very difficult: it's just some very straightforward nested list manipulation. The macro has to collect the list of variables from the trailing arguments after the expression, to form the (a b) argument list of the lambda. It has to remove the variables from those trailing arguments to produce the list expressions like '(1 2 3) and '(10 20 30) that will be applied to mapcar-cross. Then it has to assemble the mapcar-cross syntax. Of course, you also have to write mapcar-cross, which is your "run-time support function" for your list-comprehend syntax (usable directly without that syntax, too).
- auvi 12y agoI am just loving it! I code my data analysis stuff in Python and I've accumulated a significant amount of code written in it. Is there any Py->Hy translator out there?
- rcarmo 12y agoYou don't need to translate it -- you can import modules both ways just fine -- THAT's the killer feature.
- Crito 12y agoThe combination of Hy and python-sh looks really interesting. I am tempted to try using this as a shell, similar to scsh.
- jimmcslim 12y agoBy python-sh do you mean http://amoffat.github.io/sh/ http://amoffat.github.io/sh/ ?
- Crito 12y agoYes I do. So I tried this out briefly and it works, but without additional work it isn't very convenient. Obviously tab-completion of paths/programs/arguments doesn't work since Hy's REPL doesn't do those things (by default anyway). The way python-sh's imports work is also a bit inconvenient; either you need to explicitly import the command you want to run, or you need to prepend it with 'sh.' (`sh.git` runs git for example). A custom REPL might be a good way to resolve these issues, I'm going to have to put more work into understanding how both of these things work first though. Nevertheless, I think the idea has promise.
- TazeTSchnitzel 12y agoHere's a minimal dialect of Lisp embedded in PHP, in 272 lines: https://github.com/igorw/yolo/blob/master/src/yolisp.php https://github.com/igorw/yolo/blob/master/src/yolisp.php It could be shorter, but as written, it can use almost all PHP's operators (as dynamically generated functions), interact with PHP classes and functions, and produce closures that PHP code can call. Actual code sample (albeit a poor one): https://github.com/igorw/yolo/blob/master/src/yolo.php#L19-30 https://github.com/igorw/yolo/blob/master/src/yolo.php#L19-3... Implementation of map could be done like this (tested and it works): y('let', y(y('map', y('lambda', y('func', 'data'), y('if', y('==', 'nil', 'data'), 'nil', y('cons', y('func', y('car', 'data')), y('map', 'func', y('cdr', 'data')) ) ) )), /* ... */ )
- sethrin 12y agoThat's fascinating. What is performance like?
- TazeTSchnitzel 12y agoI've done absolutely no profiling on it, but I suspect it isn't exactly fantastic, particularly since any function call involves a linked-list to PHP array conversion, then array to internal PHP parameter list conversion.
- omaranto 12y agoThey should implement Python's list comprehensions in full. Right now Hy only allows one generator clause and one if clause, something like (list-comp (, x y) (x (range 5)) (> x 2) (y (range 2))) gives an error about list_comp only taking 3 or 4 arguments.
- Foxboron 12y agoAfter a quick IRC discussion; you wrote it wrong :D! Using hy --spy so you can see the equivalent python code: => (list-comp (, x y) [x (range 5) y (range 5)] (> 2 x)) from hy.core.language import range [(x, y) for x in range(5) for y in range(5) if (2 > x)] [(0, 0), (0, 1), (0, 2), (0, 3), (0, 4), (1, 0), (1, 1) .....] Can submit a PR and fix the docs so this is better displayed!
- omaranto 12y agoDoesn't what you wrote work in a different, slower, way? I had in mind something analogous to r = [] for x in range(5): if 2>x: for y in range(5): r.append((x,y)) I think what you wrote probably does: r = [] for x in range(5): for y in range(5): if 2>x: r.append((x,y)) The first loop completely skips looping over y if the condition on x fails, the second loop repeatedly tests x.
- Foxboron 12y agoHurm yes indeed. Interesting problem. I'll copypasta this and fix up an issue! Nice catch!
- pixelmonkey 12y agoRelated: an article comparing Python and Clojure, called "Clojonic: Pythonic Clojure". http://www.pixelmonkey.org/2014/11/02/clojonic http://www.pixelmonkey.org/2014/11/02/clojonic
- rcarmo 12y agoFYI, this is what's been eating into my Clojure output. The Hy REPL starts up instantly and the interop is so good I find myself writing small projects in Hy instead. Here's a wiki implemented with it (demonstrates using Bottle, doing URL routing and few other things): http://github.com/rcarmo/sushy http://github.com/rcarmo/sushy ...and here's a little playground with various snippets of code: https://github.com/rcarmo/hy-there https://github.com/rcarmo/hy-there ...and a feed fetcher: https://github.com/rcarmo/mqtt-feed-fetcher/blob/master/main.hy https://github.com/rcarmo/mqtt-feed-fetcher/blob/master/main... ...and a prototype for a nicer REPL: https://github.com/rcarmo/hyrule https://github.com/rcarmo/hyrule Edited to add: The killer feature here is cross-interop: I can re-use my code in either direction (and have run Hy in PyPy, IronPython, etc. -- sadly, not in Jython yet)
- zem 12y agoi started migrating a project from clojure to common lisp so that i could move the ui from swing to qt. i should really give hy + pyqt a try as well.
- madmanwoo 12y agopyqt works pretty well with it. I just gave it a try with QGIS (a open source GIS application) and it uses PyQt http://nathanw.net/2014/12/04/using-hy-a-dialect-of-lisp-for-python-with-qgis/ http://nathanw.net/2014/12/04/using-hy-a-dialect-of-lisp-for...
- divs1210 12y agoVery cool! I switched from python To clojure sometime back, but Hy looks like something I have To give a try.
- MrMan 12y agoDoes it work with cython?
- rcarmo 12y agoIt will import cython stuff, and vice-versa.
- blaze33 12y agoI discovered Hy two weeks ago through this previous discussion: How Hy backported “yield from” to Python 2 https://news.ycombinator.com/item?id=8641126 https://news.ycombinator.com/item?id=8641126
- volent 12y agoFlask apps look so great with Hy : (import [flask [Flask]]) (def app (Flask __name__)) (with-decorator (app.route "/") (defn index [] "Hello World !")) (app.run) I'm really looking forward using it in some side-projects.
- Foxboron 12y agoIt dosn't stop there. Why use the decorators directly when you can get Hy on Meth? https://github.com/hylang/hy/blob/master/hy/contrib/meth.hy https://github.com/hylang/hy/blob/master/hy/contrib/meth.hy
- rcarmo 12y agoHmmm. Cute. I can probably drop those straight into my Bottle stuff.
- diadara 12y agohttps://github.com/hylang/hy/blob/master/docs/contrib/loop.rst https://github.com/hylang/hy/blob/master/docs/contrib/loop.r... I thought this is not possible in python. Can someone explain ? Python doesn't have tail call optimization and hy produces python AST. Am I missing something ? I tried reading through the source, but I am still a lisp noob. https://github.com/hylang/hy/blob/master/hy/contrib/loop.hy https://github.com/hylang/hy/blob/master/hy/contrib/loop.hy
- Foxboron 12y agoThe entry is misleading. We don't really do TCO. It's just a trampoline calling the loop/recur form until there is nothing left to produce. Same solution clojure has, as the JVM dosn't allow for TCO.
- sebastianconcpt 12y agoSweet!
- yason 12y agoI love Hy and I've started using it several times but it still somehow has a few quirks that I bump into when starting to write serious code. Now it tries to reflect how Python works which isn't always that lispy: basically I'm waiting for more Clojure to creep in :)
- Foxboron 12y agoWell, that most likely won't change. Hy's goal is to be bidirectional, so there are a few things here and there that doesn't feel as lispy as it should. Like having data returned when you use assoc as an example. The scoping is an issue aswell, like let-over-lambdas doesn't work, and iteration over maps isn't as fluid as it is in Clojure.
- agentultra 12y agoHy is a self-compiling macro. Macros are just programmable mini-compilers embedded in the host language. This lets you do neat things like take a declarative description of a process and compile it into an executable function: https://github.com/paultag/snitch/blob/master/example.hy https://github.com/paultag/snitch/blob/master/example.hy I gave a talk at Pycon last year that discussed, among other things, the implementation of a constraint solver for games. You can implement an answer-set language on top of it in order to make it easier to use for yourself or collaborators in pure-Python... but writing AST-transforming code using Python's `ast` module is a huge pain. Just sprinkle some parens around and you can treat the Python AST as if it were just another plain-old-datastructure. It becomes magnitudes easier to write your answer-set solver's language interface. And because Hy is freely importable from Python code you can simply use it to write that front-end compiler for your constraint solver. The rest of your code can be in Python if that works better for you. But it doesn't stop there... you also get Hy's core library. Which provides some nice higher order functions and macros which compile down to really nice, idiomatic Python code. The kind of code you'd want to write to express that idea. It's a nice tool to have. (as a contributor I'm slightly biased).