p1esk

37 ms·

631.
by p1esk 2y ago
And then you learn about binary or ternary networks where gradients don’t really exist anywhere, and you start to wonder about the importance of this differentiability.
632.
by p1esk 2y ago
As an aside, even gpt4 level quality does not feel satisfactory to me lately. I can’t imagine willingly using models as dumb as llama2-13b. What do you do with it?
633.
by p1esk 2y ago
I used to have such a person. It was my boss at work.
634.
by p1esk 2y ago
Does ollama/llama.cpp provide low bit operations (avx or cuda kernels) to speed up inference? Or just model compression with inference still done in fp16? My understanding is the modern quantization algorithms are typically implemente
635.
by p1esk 2y ago
Sure, maybe it’s better for niche use cases like yours. HF is the biggest provider of llms, and I guess I haven’t run into it’s limitations yet.
636.
by p1esk 2y ago
Are there benchmarks? 2x speed up would not be enough for me to return to c++ hell, but 5x might be, in some circumstances.
637.
by p1esk 2y ago
PyTorch (the underlying framework of HF) supports AMD as well, though I haven’t tried it.
638.
by p1esk 2y ago
I can run them on CPU - HF uses plain Pytorch code - fully supported on CPU.
639.
by p1esk 2y ago
Of course. I thought Nvidia GPUs are pretty much a must have to play with DL models.
640.
by p1esk 2y ago
I updated my comment above: I’m using HF transformers repo, which gets models from HF hub.
641.
by p1esk 2y ago
I run models using HF just fine. I mean I’m using HF transformers repo, which gets models from HF hub. Or do you mean commercial deployment of models for inference?
642.
by p1esk 2y ago
I setup my AC so that it takes in ~20% of fresh air (from outside). This keeps my CO2 levels below 1000 most of the time. How bad are your CO2 levels?
643.
by p1esk 2y ago
I didn’t upvote it because I don’t use Ollama. To experiment with LLMs I use Huggingface. Does Ollama provide something I cannot get with Huggingface?
644.
by p1esk 3y ago
OK, I admit I don’t know much about video compression. So what does my TV receives from Netflix if it’s not pixels? And when my TV does “upsampling” (according to the marketing) what does it do exactly?
645.
by p1esk 3y ago
Not sure if I’m being dumb, or if it’s you not explaining it clearly: if Neflix produced low resolution frames from high resolution (4k to 480p), and if these 480p frames are what my TV is receiving - are you saying it’s not downsampling,
646.
by p1esk 3y ago
Are you saying that when Netflix streams a 480p version of a 4k movie to my TV they do not perform downsampling?
647.
by p1esk 3y ago
The author mentioned another similar write up which provided more useful explanations and context to me: https://ipng.ch/s/articles/2023/11/11/mellanox-sn2700.html
648.
by p1esk 3y ago
Is there a 3d equivalent of the game? What would be different about it?
649.
by p1esk 3y ago
Have the government install cable trenches along all the roads What? Like actual open trenches with exposed cables? Along every road? Is that sarcasm?
650.
by p1esk 3y ago
Like what?
651.
by p1esk 3y ago
And what about all the bs artists, slackers, divas, or assholes on the team? What if no one on the team wants to play “manager”, especially without the title? What if no one on the team has the skills to be an effective manager? What if my
652.
by p1esk 3y ago
They are only firing 40% of the managers. There will be plenty left.
653.
by p1esk 3y ago
Not sure why would this be surprising, he built a smart assistant in 2016: https://www.businessinsider.com/how-mark-zuckerberg-personal...
654.
by p1esk 3y ago
The real issue, as with all educational programs, is the cost in time and money to teach. LLMs should help with that.
655.
by p1esk 3y ago
deep neural network trained on vast numbers of generated examples could come to learn what a suitable prior should be by learning the patterns used to generate them. This sounds promising. Do you see any potential issues with this approac
656.
by p1esk 3y ago
Or, far more likely, you get laid off in 2 years because GPT-6 will do everything you can do, but better, faster, and cheaper.
657.
by p1esk 3y ago
Which “recent astrocyte-related advancements”?
658.
by p1esk 3y ago
Loihi is a digital chip.
659.
by p1esk 3y ago
Your question sounds like: “are power lifters employable as movers?” The answer is sure, if they want to be movers, and if they have other qualities needed to be a good mover. But if your question is whether DL theorists are employable as D
660.
by p1esk 3y ago
No. Number of characters in a word has nothing to do with dimensionality of that word’s embedding. GPT4 should be able to explain why.

More ›