mcbuilder

13 ms·

91.
by mcbuilder 3y ago
I think GP is trying to coin a term for stealth marketing Hacker News comments, except the analogy doesn't really make sense.
92.
by mcbuilder 3y ago
Okay, I actually got local co-pilot set up. You will need these 4 things. 1) CodeLlama 13B or another FIM model https://huggingface.co/codellama/CodeLlama-13b-hf . You want "Fill in Middle" models because you&
93.
by mcbuilder 3y ago
"GPT" refers to decoder only transformer models sampled "generatively". It's a technical term for a class of LLMs. Not cringe at all.
94.
by mcbuilder 3y ago
The transformer model was invented to attend to context over the entire sequence length. Look at how the original authors used the Transformer for NMT in the original Vaswani et al publication. https://github.com/jadore80112
95.
by mcbuilder 3y ago
Growing up in the age of generative AI is at least a big sea change as in the age of social media, or the internet etc.
96.
by mcbuilder 3y ago
There is no paper, so no technical detail about the model. Yeah this is very different than the SDXL world, where you are much more in control. Too bad, since there might be some interesting advances (the way the model follows the prompts b
97.
by mcbuilder 3y ago
If you fix the random number seed virtually all LLMs should be deterministic. However, just 1 token difference in the input could produce a very different output, depending on the sampler, model, etc. So, LLMs can be deterministic, but in p
98.
by mcbuilder 3y ago
Go into /r/chatgpt and /r/bing and it's a bit scary how many people anthropomorphize the models.
99.
by mcbuilder 3y ago
At least Intel has some non x86 hardware for deep learning now. Between killing Nervana on the verge of release and Habana not making a splash, they are looking for a win.
100.
by mcbuilder 3y ago
I just inked an adversarial CV tattoo onto my face, worked great until that image leaked into the training data.
101.
by mcbuilder 3y ago
I just can't get how bad Google is doing. They have a ton of top researchers, papers, money, just no good LLMs. It's like OpenAI was first to the punch, and everyone else just saw $$$. Meta was smart to go down this open source ro
102.
by mcbuilder 3y ago
- Machine Learning Research Scientist | Fully Remote | Full-time - Machine Learning Research Engineer| Fully Remote | Full-time - MLOps Engineer| Fully Remote | Full-time ## About us d-MATRiX is developing a novel hardware system and a full
103.
by mcbuilder 3y ago
Activation sparsity and packing sparse matrices will surely be important, so there is one kind of performance. However the other, perplexity, needs a good demonstration. It might require a big model, but even 30B you can fine tune on nowada
104.
by mcbuilder 3y ago
Crazy or not, it looks great!
105.
by mcbuilder 3y ago
If you're on OSX you can most easily get it from font-awesome using brew. I love Iosevka, and well it has been only font I've used above Terminus and a pirated Pragmata Pro for coding, so don't let too many option hold you ba
106.
by mcbuilder 3y ago
On the flip side, I've been using VIM/emacs for over a dozen years, and have gone from extensive user made configs to these starter packs (DOOM Emacs with some custom stuff on top). I mean I'm happy with a well thought out &q
107.
by mcbuilder 3y ago
I always keep my camera off unless it's a handful of situations, like meeting someone for the first time, or making a big presentation and introducing myself. Turning the camera on is more the rare thing.
108.
by mcbuilder 3y ago
Would be smart if they broke into integrated electronics.
109.
by mcbuilder 3y ago
I hosted my own AI using SillyTavern + text-generation backend (e.g. oogabooga / KoboldAI), just need the power needed to crank the LLM.
110.
by mcbuilder 3y ago
It's not minimalist to that like urxvt and st, but it does cater to a different crowd. Loving kitty by the way, I run `emacs -nw` on big remote servers and performance is top notch and now I have copy paste through kitty with OSC-52 es
111.
by mcbuilder 3y ago
I've been in hardware startup bizz for pretty long, starting to feel like an ancient being. It's been all AI/ML, so I'm a software/research type guy in the HW space.
112.
by mcbuilder 3y ago
In my opinion these are the two alternatives and we're left making educated guesses. I mean it's clearly rumors, but look at the scientific results on your bread and butter language modeling tasks you see any clear basic architect
113.
by mcbuilder 3y ago
Now we're seeing decent 13-40B models (within ChatGPT 3.5 level). 4-5bit GPTQ quantizations are working pretty well, so these models are actually fitting on consumer GPUs. So many new models on huggingface coming out everyday, it is ha
114.
by mcbuilder 3y ago
And it was hard enough of a task that as far as we know for sure we are the only ones to have it happen to in the universe. Edit: PS. With plenty of time in-between
115.
by mcbuilder 3y ago
The horrible thing is that in the public opinion OpenAI is also incorrectly connected with "Open Source" purely due to the similarities in the name. So the two opposing approaches are conflated in the public view.
116.
by mcbuilder 3y ago
Right now I'm working fully remote, but probably will end up spending 4-5 working weeks annual total in the office. I fly in maybe once every other month for like 3-4 days. When I go to the office, my productivity really drops. I am re
117.
by mcbuilder 3y ago
Tell that to any ML Compiler Engineer
118.
by mcbuilder 3y ago
TBH this is what all ML researcher / engineers have wanted for the past 10 years.
119.
by mcbuilder 3y ago
Man, you nailed it with the dopamine hangover. I wonder if it is just our collective human delusional preoccupation with searching for a "greater intellegence" that makes these models more seem impressive combined with the obvious
120.
by mcbuilder 3y ago
Well, maybe it will be a plus then for minorities that all of the training data is of white people. I only joke, as this is a horrible idea all around, but I appreciate your creativity.

More ›