3 ms·

Deep learning library written in Futhark

102 points by fulafel 4y ago

jstrieb 4y ago
I've only used Futhark a handful of times, but found it to be really easy, and intuitive (coming from extensively using SML). For anyone looking to get started with it, writing a Monte Carlo simulation is a good first exercise to get familiar. Monte Carlo simulations also happen to perfectly showcase its power to exploit parallelism for massive speedups.
dist1ll 4y ago
Great to see a futhark lib in the wild, the code seems really concise and readable. I feel the main reason for Futhark's ergonomics is FP combined with its array prelude (e.g. fold/transpose/flatten/rotate/indices).
fancyfredbot 4y ago
I've seen some impressive results from Futhark in other areas. Would be very interested to see how it performs when applied to DL. Couldn't find any benchmarks here?
tveita 4y ago
Not much documentation but the example program looks nice https://github.com/HnimNart/deeplearning/blob/master/programs/mnist.fut https://github.com/HnimNart/deeplearning/blob/master/program...
jegp 4y ago
Wonderful to see this getting attention! I met with Minh since we were both using Futhark for our thesis. It's blazing fast and quite fun to work with. If anyone's interested, my thesis contains some more examples on deep learning with Futhark: https://github.com/Jegp/thesis/ https://github.com/Jegp/thesis/
ben_w 4y ago
Every time the Futhark language comes up, I think it should look like this: ᛈᚱᛖᚾᛏᚨ("ᚺᛖᛚᛟ ᚹᛟᚱᛚᛞ!")
- teddyh 4y ago
  PRENTF?
  - ithkuil 4y ago
    Clouding aftar the greet greet vooel sheft
  - ben_w 4y ago
    Prenta; I don't know ancient Norse (or any free translators) so I went with Icelandic. In fairness the graphemes ᚨ and ᚠ are both pretty similar to F. Unfortunately I didn't do that properly with the string too, I should've done something more like "ᚺᛅᛚᛟ ᚺᛖᛁᛗᚢᚱ". My bad.
fulafel 4y ago
There's also the thesis linked from https://futhark-lang.org/publications.html https://futhark-lang.org/publications.html - https://futhark-lang.org/student-projects/svend-msc-thesis.pdf https://futhark-lang.org/student-projects/svend-msc-thesis.p... - and this paper: https://futhark-lang.org/publications/fhpnc19.pdf https://futhark-lang.org/publications/fhpnc19.pdf
pjmlp 4y ago
Great to see Futhark improving, we need more options on GPGPU ecosystem.
deleted 4y ago
[deleted]

102 points by fulafel 4y ago

I've only used Futhark a handful of times, but found it to be really easy, and intuitive (coming from extensively using SML). For anyone looking to get started with it, writing a Monte Carlo simulation is a good first exercise to get familiar. Monte Carlo simulations also happen to perfectly showcase its power to exploit parallelism for massive speedups.

dist1ll 4y ago

Great to see a futhark lib in the wild, the code seems really concise and readable. I feel the main reason for Futhark's ergonomics is FP combined with its array prelude (e.g. fold/transpose/flatten/rotate/indices).

fancyfredbot 4y ago

I've seen some impressive results from Futhark in other areas. Would be very interested to see how it performs when applied to DL. Couldn't find any benchmarks here?

tveita 4y ago

Not much documentation but the example program looks nice https://github.com/HnimNart/deeplearning/blob/master/programs/mnist.fut https://github.com/HnimNart/deeplearning/blob/master/program...

jegp 4y ago

Wonderful to see this getting attention! I met with Minh since we were both using Futhark for our thesis. It's blazing fast and quite fun to work with. If anyone's interested, my thesis contains some more examples on deep learning with Futhark: https://github.com/Jegp/thesis/ https://github.com/Jegp/thesis/

ben_w 4y ago

Every time the Futhark language comes up, I think it should look like this: ᛈᚱᛖᚾᛏᚨ("ᚺᛖᛚᛟ ᚹᛟᚱᛚᛞ!")

teddyh 4y ago
PRENTF?
- ithkuil 4y ago
  Clouding aftar the greet greet vooel sheft
- ben_w 4y ago
  Prenta; I don't know ancient Norse (or any free translators) so I went with Icelandic. In fairness the graphemes ᚨ and ᚠ are both pretty similar to F. Unfortunately I didn't do that properly with the string too, I should've done something more like "ᚺᛅᛚᛟ ᚺᛖᛁᛗᚢᚱ". My bad.

fulafel 4y ago

There's also the thesis linked from https://futhark-lang.org/publications.html https://futhark-lang.org/publications.html - https://futhark-lang.org/student-projects/svend-msc-thesis.pdf https://futhark-lang.org/student-projects/svend-msc-thesis.p... - and this paper: https://futhark-lang.org/publications/fhpnc19.pdf https://futhark-lang.org/publications/fhpnc19.pdf

pjmlp 4y ago

Great to see Futhark improving, we need more options on GPGPU ecosystem.

deleted 4y ago

[deleted]