lantiga

15 ms·

1.
by lantiga 4y ago
Correct, the original is GPL 3. To produce this implementation from the LLaMA paper we started from github.com/karpathy/nanoGPT, the LLaMA architecture is really similar to GPT. For instance we added rotary positional encoding sta
2.
by lantiga 4y ago
Some form of that is very likely the future
3.
by lantiga 4y ago
The AI ecosystem is almost entirely Apache 2/MIT/BSD, and GPL is just incompatible with it. This is a blocker to mixing and matching, a simple Apache 2 rewrite fixes that problem. Weights? It’s another issue but we’ll be looking f
4.
by lantiga 7y ago
Pretty much (co-author here). You can approach the book as a developer with little or no background in ML. The purpose is exactly to get developers up to speed so that they can start perusing the already excellent online docs. Hope you like
5.
by lantiga 12y ago
Shen is pretty amazing, it's a full fledged functional language with lots of features and lots of compilation backends. I don't think there's a lot of ground for a comparison with ki, which is much more limited in scope.
6.
by lantiga 12y ago
I have ideas around providing CSP in ki, but so far I haven't implemented them. All there is in ki right now is the (letc ...) form (see http://ki-lang.org/api.html#misc ), which provides very similar functionality to L
7.
by lantiga 12y ago
It's actually named KL (with a lower-case L), but yes, that was close.
8.
by lantiga 12y ago
The main difference is structural sharing: I can update a Clojure map with a new value, which will create another map that shares the vast majority of the data with the former map. With plain JavaScript, you'd have to clone your object
9.
by lantiga 12y ago
I agree, LispyScript is very neat, closer to a full-fledged language than ki. On the other hand, ki is focused on ClojureScript's immutable data structures and related idioms - in fact it's just a thin layer around those.
10.
by lantiga 12y ago
Glad you find it interesting, looking forward to future feedback.
11.
by lantiga 12y ago
[Hi, author here] Yes, that is basically the idea. ki functions are js functions, same goes for vars, which makes it easy to jump from js to ki and back, without giving up on immutability, etc. Note that ki is not really intended as a Cloju