abstractcontrol

11 ms·

61.
by abstractcontrol 8y ago
> With your linked spiral code, I can't even really tell where the algorithm starts and where the setup code ends - which of course might easily be attributed to my unfamiliarity with Spiral ;) Heh, I've noticed that the setup
62.
by abstractcontrol 8y ago
I like how the broadcasting comes out in the end in Julia. Besides that Julia has quite many niceties that I could only wish Spiral had and I do think that they matter significantly even if they are not vital. This is definitely praiseworth
63.
by abstractcontrol 8y ago
Sorry about not seeing your reply yesterday, HN is not as helpful as Reddit so I have to scan for them manually which can be error prone. I just went through your talk. It was definitely interesting. Despite my confidence in the high-perfor
64.
by abstractcontrol 8y ago
> It's still silly to compare Julia's tensors to PyTorch's because they are generic in dimension, layout, and type unlike PyTorch's and these seem to be exactly the pieces that you're ragging on. This means that
65.
by abstractcontrol 8y ago
I cannot change my attitude otherwise I would never get anything done. The only principle that I hold dear, and the only way I can truly be fair is that if I am actually wrong I will change my mind. I would not be so rough on Julia if it di
66.
by abstractcontrol 8y ago
How would one enable this in Visual Studio?
67.
by abstractcontrol 8y ago
I might be persuaded to see things from your point of view if you can show that Julia's tensors meet my criteria. I might be wrong about this - I do not know much about Julia and it might very well be capable of this. But these are the
68.
by abstractcontrol 8y ago
I recall an example where Julia had to use macros in order to achieve loop unrolling. I'll dig it up if you want. This is something can be done quite naturally in Spiral due to its type system. I find that people often say macros are a
69.
by abstractcontrol 8y ago
Never stumbled upon it in my research. Thanks for the reference.
70.
by abstractcontrol 8y ago
Yes, it is, but there exist an alternative approach called automatic differentiation which is more imperative and flexible in nature than symbolic differentiation. The idea is to keep a tape (you can think of it as a list) and then record a
71.
by abstractcontrol 8y ago
I can't actually program all the time. Sometimes I need to study machine learning or think about design. During those times I use commits much like journal entries. I actually keep a separate journal and sometimes paste from it. I&#x27
72.
by abstractcontrol 8y ago
The reason why I am using random projections in the latest test is because I am testing an algorithm that iteratively calculates the inverse Cholesky factor of the covariance matrix and am testing it on Mnist images. The cov matrices made f
73.
by abstractcontrol 8y ago
Before I started work on Spiral I spent way too long, like a year working on a ML library before throwing in the towel. I think I skimmed through the source of DeepML over a year ago and my impression was that the author was struggling agai
74.
by abstractcontrol 8y ago
Indeed. But F# cannot actually do this, and neither can even dependently typed languages to the degree Spiral can. In Spiral types act much like values meaning you can bind them to variables and you can reflect on them without cost like wit
75.
by abstractcontrol 8y ago
I do not think there is a language with capabilities similar to Spiral. If it existed it would have saved me a lot of time. The closest you could get would would be [Scala LMS]( https://scala-lms.github.io/ ) and the work don
76.
by abstractcontrol 8y ago
When I looked at Julia last time I do not think it had the capability to partially apply tensors. In Spiral indexing into a 3d tensor would give you back a 2d tensor. It might be possible to do this with function in Julia, but that would de
77.
by abstractcontrol 8y ago
Author here. The language was made for Cuda programming and until something comes along to displace it, I have no plans of moving from it. That having said, the language is quite small and it would be possible to create a new backend in abo
78.
by abstractcontrol 9y ago
> It does not seem that there is any significant correlation between memory size and allocation cost. Nor should there be - it's just bookkeeping, after all. I guess this explains your lack of concern about memory pooling. I am goin
79.
by abstractcontrol 9y ago
> Do you think some of the pain would be alleviated if Futhark had a simple FFI that would allow calling hand-written primitives when they exist? Yeah, definitely. You should go a bit further and allow embedding C code for performance or
80.
by abstractcontrol 9y ago
I do not feel like writing an entire essay on language integration right now - most likely I will open an issue 6-12 months from now on Futhark's Github repo just to talk about it, but let me start with agreeing everything what DannyBe