pilooch

7 ms·

61.
by pilooch 2y ago
It's intended as a joke and a demonstration no ? Like this is exactly the type of text and words that a commercial grade LLM would never let you generate :) At least that's how I got that comment...
62.
by pilooch 2y ago
I run a fineruned mulmodal LLM as a spam filter (reads emails as images). Game changer. Removes all the stuff I wouldn't read anyways, not only spam.
63.
by pilooch 2y ago
Can't wait for the stable diffusion version :)
64.
by pilooch 2y ago
They could have seen it while fixing a pager... Or those things work so well, never break...
65.
by pilooch 2y ago
Indeed, a lora finetune of llama 3.1 8B works on a single 24GB GPU and takes from a few hours to a few days depending on the dataset size.
66.
by pilooch 2y ago
Yes, same for maths. As long as a true reward 'surface' can be optimized. Approximate rewards are similar to approximate and non admissible heuristics,search eventually misses true optimal states and favors wrong ones, with side e
67.
by pilooch 2y ago
No. Because the model should and will replace any piece of code. This is what happened already for other tasks, in computer vision, text (entity recognition, etc...), audio, etc. RAG will go away, decision multimodal models / LLMs will
68.
by pilooch 2y ago
The adversarial surface to the LLM remains enormous, manual cannot handle it.
69.
by pilooch 2y ago
So Google hasn't used an LLM to generate and test weird queries ? This is not putting the bar very high for the whole industry... There'd be so much to gain from a clean deployment... Either it hard, either it is a rush. As a mac
70.
by pilooch 3y ago
Detection of generated images works well, as reported by lots of works on arxiv. It's not catching them all, but lots of them. One way to understand it is that DDPMs and their underlying neural network do leave patterns in the high fre
71.
by pilooch 3y ago
Agreed. And solid, very little to no maintenance. My biggest respect to the team behing jellyfin !
72.
by pilooch 3y ago
Look at policy-based templating, my goto for generic AI/search algorithms with many options. May prove useful.... Or not :)
73.
by pilooch 3y ago
We use it professionally at work, great enough tool!
74.
by pilooch 3y ago
Breakthrough may well be among the recent reformulations into supervised, offline RL and related techniques. Of special interest, the decision transformer and the very emerging litterature on diffusion planning.
75.
by pilooch 3y ago
Generative AI basically unlocks the metaverse, since all the 3D environment can now be generated. The metaverse changes people's context and senses with generated data. Interestingly AI will paint a new world for humans to learn and ex
76.
by pilooch 4y ago
This has been true of machine learning APIs from the early renaissance of neural networks. Computer vision APIs have been used for years to grow datasets and fine-tune models on the data. As a matter of fact, the API/SaaS business for
77.
by pilooch 4y ago
The big difference is there's no full training code for llama, yet.
78.
by pilooch 4y ago
Consciousness might just be the brain's recurrent and unsuccessful attempt at predicting itself. Similarly, "free will" may simply be an illusion caused by the failure of that perfect prediction of what to do/what will h
79.
by pilooch 5y ago
Loving pytorch but the reasoning remains strange to my ears: Python at all cost, not Julia, because of the ecosystem, well OK. But all bullet points are about things that are easily done right now with libtorch (pytorch underlying C++ core
80.
by pilooch 5y ago
My take on intelligence over the past 20y has been it is high quality / efficient search of immense state spaces. "Solving intelligence" as a famous corporation motto, might just be improving state-space search. Humans are in
81.
by pilooch 5y ago
TikTok algorithm is like a tamgotchi with short memory. The echo chamber is actual much less than on other systems, or at least this is my actual understanding. I've been working on AI and ML for 20+y now, I'm always interested is
82.
by pilooch 5y ago
ML is about writing programs automatically. It is huge, like the end of programming as we know it. Think of future Blockchain algorithms, crypto functions etc as trained instead of programmed. It'll take time but ML shall supersede eve
83.
by pilooch 5y ago
Confidence is the key, but it is sometimes out of reach, even if only momentarily. So rationalizing is one way: about competition first, it doesn't matter (really, like... really), whatever you are doing with focus will end up differen
84.
by pilooch 5y ago
Torchscript is very complicated. Its internal API was not truely documented for external use last time I checked it. You can't even export to torchscript from libtorch C++, it only works from Python AFAIK.
85.
by pilooch 6y ago
https://developer.apple.com/documentation/accelerate/blas This runs on the AMX, so much faster than on CPU. I've been unable to get native openblas yet through homebrew, though havent tried recently. For deep
86.
by pilooch 6y ago
This works fine until a point in life at which communicating with others and answering to others, meaning you are available for them, whatever the app, is more important than anything else. Not meaning to not boycott such apps with those yo
87.
by pilooch 6y ago
Done that since 2015. You can look at https://github.com/jolibrain/deepdetect . C++ doesn't sound ideal to many, but when your target is production, it's pretty powerful, and since c++11 probably much more com
88.
by pilooch 6y ago
Yes, that's 250w consumption on both sides for a one-to-one vid all. Not sure it's a good trade-off...
89.
by pilooch 6y ago
I did a bit with instances of an Open Source deep learning server of mine, for three years+ now. Made up to 1.5k/month, lower now but it's on my plate to revive it. It's provided side money to our service/ software busin
90.
by pilooch 6y ago
Well done but be careful, TSNE has some drawbacks, well detailed here: https://distill.pub/2016/misread-tsne/ For building a more precise 2D embedding or image similarity search engine you may want to rely on a ne

More ›