heyitsguay

10 ms·

91.
by heyitsguay 3y ago
Bitcoin and other PoW crypto burn energy by design and found few to no enduring use cases. Talking about the energy usage of AI is like talking about the growing energy usage of lighbulbs at the turn of the 20th century. It's a byprodu
92.
by heyitsguay 3y ago
You have to go from this article to the Northwestern press release to the source research paper to learn that this is for simple SVMs in wearable devices like for healthtech. Neat, but it doesn't really have any bearing on the deep lea
93.
by heyitsguay 3y ago
I talk to a bunch of engineers with this question at an SF AI meetup, and I'm really curious to hear what the community consensus is but from my perspective, it's tough and getting tougher. The issue isn't that it can't
94.
by heyitsguay 3y ago
Less glibly, I feel like the comment OP made is looking at first-order consequences of new generative technologies, but that it misses a deeper truth about art and creation. The creation of the camera didn't "solve" painting.
95.
by heyitsguay 3y ago
What happens when anyone can create photorealistic images of their surroundings without spending years getting trained in portraiture? Painting evolved, plus we got a whole new medium too.
96.
by heyitsguay 3y ago
It might be tough to make more efficient, but $15k seems exactly about the price of "stick 6 4090s in a decent box and throw in a couple grand for my troubles", versus any revolutionary hardware configuration. The way it advertise
97.
by heyitsguay 3y ago
It was easy for me to set up on Ubuntu with CUDA 11.7. I cloned the repo, created a new python venv, and installed the requirements in requirements_versions.txt, but looking at launch.py, that wasn't even necessary. Just create a new v
98.
by heyitsguay 3y ago
Wager: None of the theory on this page will have any bearing on the implementation of a real world AI system that solves any problem of interest. Not that there aren't problems to solve regarding AI, just that this line of inquiry won&
99.
by heyitsguay 3y ago
https://bernstein-network.de/wp-content/uploads/2021/03/Lect... this has an awesome overview of the current understanding of neural encoding mechanisms.
100.
by heyitsguay 3y ago
This is one of those conversations that happens so much here it's too exhausting to repeat in its entirety, but -- if you're looking to learn about the real questions and challenges faced by real modern AI in real world systems, t
101.
by heyitsguay 3y ago
This is pretty cool, but what are the scaling limits of a pgvector-based embeddings storage solution? 1 TB of embeddings? 100 TB? Is pgvector suitable for large scale installations?
102.
by heyitsguay 3y ago
Seeking cofounder for a disruptive, high-margin healthcare startup providing new treatments with deep historical roots.
103.
by heyitsguay 3y ago
Actually you're right, that was my mistake. Current-gen autoregressive token predictor "hallucinations" probably can't be fixed, but yeah, the way forward will involve new architectures and I would place my bets that som
104.
by heyitsguay 3y ago
A meta point as someone who has been working in mathematical signal processing and ML professionally for a while -- at the time of writing, every single comment in this thread displayed a serious (yet unique!) misconception about AI, either
105.
by heyitsguay 3y ago
It is, the same author posted a rotated version in the replies: https://nitter.net/667keos/status/1686490898480173056#m
106.
by heyitsguay 3y ago
I think this conversation demonstrates a misunderstanding of what GPT4 can and cannot do. You can get useful background information about DFT and molecular simulation, but definitely no first-principles reasoning about molecular properties.
107.
by heyitsguay 3y ago
Love seeing the posters for this, plastered across the decaying facades of abandoned buildings on Mission St, amidst the ragged people and "street vendors". It seems like a fitting place to advertise the project.
108.
by heyitsguay 3y ago
This is blogspam, but in case people come here because the title sounds interesting, check out text-generation-webui ( https://github.com/oobabooga/text-generation-webui ). It's a better solution to local LLMs than
109.
by heyitsguay 3y ago
I know it's not the main point of this, but... so many multimodal models now that take frozen vision encoders and language decoders and weld them together with a projection layer! I wanna grab the EVA02-CLIP-E image encoder and the Lla
110.
by heyitsguay 3y ago
Is this site not just a handy visual catalog of known artifacts and transcriptions? Is there some speculative decipherment implied in the phoneticizations?
111.
by heyitsguay 3y ago
Absolute best case in the cloud for the kind of GPUs this needs? ~$1/GPU/hr, but maybe up to $5/GPU/hr depending on provider and configuration. But companies or other organizations with extra capacity on their in-house h
112.
by heyitsguay 3y ago
tl;dr probably from a sick animal, maybe from a lab, no smoking gun either way. Probably not engineered or lab-adapted.
113.
by heyitsguay 3y ago
Compared to OpenAI's antics I think this is actually a very reasonable move, and a good example of the less glamorous but more concrete reality of actual AI risk management. There's a concrete harm -- disruptive ease of impersonat
114.
by heyitsguay 3y ago
Oh no did i get woosh'd? I guess I'm feeling a little trigger happy after seeing all these "AI dating app" posters come up in the Mission. I don't think they're parodies... (Though now I'm questioning that
115.
by heyitsguay 3y ago
I'm saying contemporary chat bots, even with GPT-4, are incredibly crude simulacra of human intelligence and agency, so to see someone become emotionally invested in one is pitiful on the level of a scared monkey clinging to a piece of
116.
by heyitsguay 3y ago
Depressing as hell. Reminds me of those photos of the monkey clinging to its cloth mother surrogate.
117.
by heyitsguay 3y ago
I'm not going to engage with this directly, but for any other readers passing through - this is nonsense. One more drop in the flood of uninformed AI noise that's been drowning out the signal. Choose the sources you trust very car
118.
by heyitsguay 3y ago
It won't, it just means this is another pointless theoretical study seeking to interpret Transformers in a framework that has no explanatory value for AI.
119.
by heyitsguay 3y ago
Sounds like the idea is that "outlier features" effectively give the model an inhibitory system for other features, and transformer models converge to consistent outlier channel selection per layer at around the 6.7B param mark? I
120.
by heyitsguay 3y ago
It's not. That's part of the uninformed AI hype train that will consistently be posting first on AI stuff for the next 6 months. Right now the main bottleneck for LLM size is GPU memory (VRAM). Training requires much more VRAM tha

More ›