jph00

24 ms·

361.
by jph00 3y ago
> We do not normally hallucinate. We are sometimes wrong, and sometimes are wrong about the confidence they should attach to their knowledge. But we do not simply hallucinate and spout fully confidence nonsense constantly. That is what
362.
by jph00 3y ago
To promote functions to a module use nbdev; execnb or papermill to parameterise your notebook; and nbconda to have environments for your notebooks.
363.
by jph00 3y ago
Mojo is not at all specialised for CPU. It sits on top of MLIR and excellent support for all major accelerators is planned.
364.
by jph00 3y ago
FlashAttention has memory linear in sequence length. https://github.com/HazyResearch/flash-attention
365.
by jph00 3y ago
Combinators are elegantly expressed in array languages, especially J. Here's a great recent paper with details : https://raw.githubusercontent.com/codereport/Content/main/Pu...
366.
by jph00 3y ago
I have a video series that covers every glyph in Dyalog APL, if you're interested in learning APL syntax: https://www.youtube.com/playlist?list=PLfYUBJiXbdtSgU6S_3l6p... There's also a concise guide covering every
367.
by jph00 3y ago
My bad - I meant to write "Mojo may be the biggest programming language advance in decades" but forgot to write "language". I've updated the title now. (Although it doesn't update the HN title unfortunately.)
368.
by jph00 3y ago
Oh yes you're right - I've just pushed a change to make it darker.
369.
by jph00 3y ago
I didn't get paid to write this article, and no-one at Modular asked me to write it, and I don't have any equity in Modular so there's no financial upside in me writing it. I agreed to become an advisor to Modular after I saw
370.
by jph00 3y ago
It can do this.
371.
by jph00 3y ago
"get passed over because companies decide to fund some new(er) shiny thing instead" is not a fair or reasonable assessment. Why would a startup that's racing against time and money decide to create a new language when somethi
372.
by jph00 3y ago
I really appreciate you saying that! I'm glad it helped you.
373.
by jph00 3y ago
The video is a code walkthru. The code is here: https://docs.modular.com/mojo/notebooks/
374.
by jph00 3y ago
Jeremy here. Thank you for sharing my article on HN! I've used more programming languages than I can count since I started coding 40 years ago, and it's not often I've gotten really excited about a new language. So the fact I
375.
by jph00 3y ago
At the moment, you can handle memory manually with alloc/free (and there's stuff there to help with RAII), or you can use Python ref counting. Borrow-checking is currently under development, as discussed here: https://d
376.
by jph00 3y ago
The binary doesn't need to lug around a CPython binary. Mojo is a compiler that uses MLIR to compile standalone binaries. (Unless you use `python.import`, which uses the CPython interpreter.)
377.
by jph00 3y ago
> Jeremy, who sometimes hangs out on HN, must have been dying to tell the world about this for a long while Oh yes!
378.
by jph00 3y ago
Mojo can actually create fully standalone binaries, so you don't even need a Mojo install to run them! Also the binaries are really small compared to languages that need a big runtime (e.g. a binary containing the matmul implementation
379.
by jph00 3y ago
Heh I don't even know that myself - I'm just focussed on playing with Mojo. But note that Modular also has an inference engine which looks pretty amazing and seems likely to bring in big $$$ AFAICT.
380.
by jph00 3y ago
I'm not sure if it officially qualifies as a "plan", but a pure mojo numpy has certainly been discussed... personally I'd guess that's something that will need to be built to have this all work as well as possible.
381.
by jph00 3y ago
If I have anything to do with it, there will be high level model training tools. Perhaps something a little like fastai, for instance?...
382.
by jph00 3y ago
I'm not sure of the details, but I believe that XLA is starting to use MLIR now, which is what Mojo uses behind the scenes. I'm not sure if Mojo will use MLIR directly or go via XLA.
383.
by jph00 3y ago
Hi Jeremy Howard here. I pop up in the launch video to demo super-fast matmul and mandelbrot in mojo. I'm pretty excited about this language, to say the least - not just for AI/ML, but for pretty much everything! Lemme know if you
384.
by jph00 4y ago
This course doesn't use the fastai framework. But to answer your question -- the reason IMO to learn the fastai framework (or indeed any software which incorporates a significant amount of novel research) would be to learn about the ne
385.
by jph00 4y ago
Yes high school math is sufficient, as long as you did basic calculus (derivatives and the chain rule) and probability. We cover stuff that's well beyond high school math, but it's introduced when it's used, and we link to ex
386.
by jph00 4y ago
Part 1 would probably be best for that: https://course.fast.ai . Lots of alums have gone on to do what you describe -- it's probably a good idea to have the level of understanding introduced there even if you mainly use ext
387.
by jph00 4y ago
The full transcripts are available here in plain text form: https://github.com/fastai/course22p2/tree/master/summaries
388.
by jph00 4y ago
Based on the last time we did a part 2 course, time spent varied a lot. Some folks could do it in 10 hours study (plus watch time) per lesson, and some took a whole year off to do the two parts of the course (including doing significant pro
389.
by jph00 4y ago
In youtube click "show transcript". It's searchable. Click in it to jump to that part of the video.
390.
by jph00 4y ago
Yes every lesson has a complete transcript written by our wonderful community members. You can access through the usual YouTube interface.

More ›