jwitthuhn

5 ms·

61.
by jwitthuhn 1y ago
Not "as a paid service" just "as a service". The license does not allow me to stand up a Bear instance and let people blog on it for free.
62.
by jwitthuhn 1y ago
Anyone pointing to that as proof that AI slows developers down has not actually read it. See appendix B "We do not provide evidence that: AI systems do not currently speed up many or most software developers"
63.
by jwitthuhn 1y ago
Haven't tried myself but it looks like it probably does. The weight files total 13.8 GB which gives you a little left over to hold your context.
64.
by jwitthuhn 1y ago
An extension I trust is by definition trusted code. What is trusted is for the user to decide, not the broswer developer.
65.
by jwitthuhn 1y ago
Pytorch also runs great on apple silicon, though it is hard to directly compare because Apple's high end GPUs can't compute anywhere near as much as nvidia's high end stuff. e: I'll also add that pytorch does still have
66.
by jwitthuhn 1y ago
For anyone who never saw his show, it is (all?) now available on this youtube channel. https://www.youtube.com/@MagicSecretsRevealed/videos
67.
by jwitthuhn 1y ago
Is it easily solvable by humans without code? I suspect if you asked a human to write down all the steps in order to solve a Tower of Hanoi with 12 disks they would also give up before completing it. Writing code that produces the correct o
68.
by jwitthuhn 1y ago
It would have made sense for Mozilla to mention that in the article. Instead they just lie about how it works.
69.
by jwitthuhn 1y ago
You might be interested in this video, which is about a physical guitar pedal someone made using a chatgpt-based design. Same idea but all analog. https://www.youtube.com/watch?v=J-PTzq1bv9M
70.
by jwitthuhn 1y ago
If you're interested in a FOSS MTG clone check out XMAGE and Forge. They don't have every card but they do have a whole lot. https://github.com/magefree/mage https://github.com/Card-Forge&#x2F
71.
by jwitthuhn 1y ago
The DAW Reaper also uses a similar approach and for that alone I would highly recommend anyone interested in audio production give it a try. Everyone else in the industry uses online activation. Whenever they take those servers down you los
72.
by jwitthuhn 1y ago
This seems like purely a good thing to me. As established when Phil Zimmerman published PGP, software is speech and any restrictions on that speech must be enacted in a way consistent with the first ammendment. State governments ignoring th
73.
by jwitthuhn 1y ago
There are some but not a lot, current AI is a lot better focusing on smaller more well-defined problems than stuff like "add this feature" or "fix this bug". A good example is this PR for llama.cpp which the author says
74.
by jwitthuhn 1y ago
Love the concept of BSOL, might give that a try.
75.
by jwitthuhn 1y ago
The difference is that SSPL is a license that was written in bad faith with the explicit intent that people can't comply with the parts about running a hosted service. https://www.mongodb.com/legal/licensing/s
76.
by jwitthuhn 1y ago
It sort of can but all non-adobe software I know of, even commercial stuff like Affinity Photo, has spotty support for some PSD features. Basically any given PSD will certainly load correctly in photoshop, but you're rolling the dice i
77.
by jwitthuhn 2y ago
I've made a tiny ~1m parameter model that can generate random Magic the Gathering cards that is largely based on Karpathy's nanogpt with a few more features added on top. I don't have a pre-trained model to share but you can
78.
by jwitthuhn 2y ago
In general you can just use the parameter count to figure that out. 70B model at 8 bits per parameter would mean 70GB, 4 bits is 35GB, etc. But that is just for the raw weights, you also need some ram to store the data that is passing throu
79.
by jwitthuhn 2y ago
For me it is consistency. I control the model and the software so I know a local LLM will remain exactly the same until I want to change it. It also avoids the trouble of using a hosted LLM that decides to double their price overnight, cost
80.
by jwitthuhn 2y ago
For anyone else looking for the weights which as far as I can tell are not linked in the article: Base model: https://huggingface.co/Zyphra/Zamba2-7B Instruct tuned: https://huggingface.co/Zyphra/Z
81.
by jwitthuhn 2y ago
Looking forward to them taking a similar action against Wordpress.com for upselling access to the core wordpress feature of plugins.
82.
by jwitthuhn 2y ago
I'm no trademark lawyer, but isn't offering "WordPress" hosting fine as long as you are genuinely using the WordPress software? As I understand it that is purely nominative use.
83.
by jwitthuhn 2y ago
I see that sentiment largely coming from developers who, I think, misunderstand the freedom that the GPL is protecting. The GPL focuses on the user's freedom to modify any software they are using to better suit their own needs, and it
84.
by jwitthuhn 2y ago
As I understand it the sanctioned way of sharing code added to UE is to fork it on github and publish changes to your fork. Being a fork it will only be available to other people in the Epic Games github org which is only people who have ag
85.
by jwitthuhn 2y ago
Yeah, you need to manually fix each affected system by booting in safe mode. Not possible to do remotely.
86.
by jwitthuhn 2y ago
For anyone who wants a sneak peak at what the content will be, Andrej Karpathy already has a series on videos on youtube that covers roughly the first half of the list here: https://www.youtube.com/watch?v=VMj-3S1tku0&li
87.
by jwitthuhn 2y ago
I have to disagree that I'm perpetuating any falsehood here. Mozilla literally needs to approve an addon for it to behave normally. That you are satisfied with the process they have for approving doesn't change that. To me it seem
88.
by jwitthuhn 2y ago
The extension needs to be signed by mozilla for the normal production builds of firefox to let you load it on startup. If it isn't signed, you need to manually load it in using about:debugging each time you restart firefox.
89.
by jwitthuhn 2y ago
I'm not aware of any other openly-licensed model of comparable size to 54b. That seems like a worthwhile addition to what is already available, imo. The closest is mixtral 8x7b but that one only uses a fraction of its parameters for ea
90.
by jwitthuhn 2y ago
It is ~260GB with presumably fp16 weights. Should fit into 64GB at 3-bit quantization (~49GB). Edit: To add to this, I've had good luck getting solid output out of mixtral 8x7b at 3-bit, so that isn't small enough to completely ki

More ›