mkaic

18 ms·

181.
by mkaic 3y ago
Ugh. I just spent the past few days reading this exact paper and preparing a detailed presentation on it for my job as an AI researcher, and headlines like this make me roll my eyes very hard. MEGABYTE is indeed a cool new architecture, but
182.
by mkaic 3y ago
I recently stumbled across a truly excellent 5-part deep dive into PCA on Peter Bloem's blog, which I highly recommend to anyone who's interested. It assumes you have some level of linear algebra knowledge. https://pete
183.
by mkaic 3y ago
> I know those cards are second class citizens in the world of deep learning, It's worse than that. AMD cards aren't second class citizens, they're not even on the same playing field. ROCm can't compete with CUDA and
184.
by mkaic 3y ago
I've definitely lost some of my motivation to share, but it's less because I'll be training the AI, and more that I'll be competing against it so people are less likely to consume what I create. I don't really min
185.
by mkaic 3y ago
A less prescriptivist title would be "I disagree with how people use the word fractal", as words are defined by how they're used and in what contexts, not by dictionaries or institutions. Considering that many, many people ca
186.
by mkaic 3y ago
Additionally, here's a link the blog post about it, which I feel might actually be a better place for this post to link to instead of Verge's coverage of it: https://ai.facebook.com/blog/imagebind-six-modaliti
187.
by mkaic 3y ago
As a piano player I definitely depend on the existence of a piano for me to play. Better tools absolutely enable artists to make better things faster — Yo-Yo Ma can make a cheap cello sound amazing, but he can make an expensive cello soun
188.
by mkaic 3y ago
There's a certain humor to the idea of Final Cut Pro being relegated to the Premier Pro subscription lol.
189.
by mkaic 3y ago
Memorandum came to mind as well — something that must be remembered, I guess.
190.
by mkaic 3y ago
Already happened and still actively happening! In Tesla's latest annual AI day presentation they gave some insights into their training procedures and architecture choices. Lots of transformers, lots of bleeding-edge stuff.
191.
by mkaic 3y ago
Mojo Dojo was briefly the name of a trampoline park in Sacramento before it got bought out by SkyZone
192.
by mkaic 3y ago
The 3090 has 24GB so it's an option as well.
193.
by mkaic 3y ago
I believe the version available on DreamStudio is heavily RLHF-tuned, no? I'm mostly interested to see how the raw weights perform out of the box compared to IF, which we have to wait for the release for.
194.
by mkaic 3y ago
Ah, yes, this seems to be pretty strong evidence. Thanks for pointing that figure out to me!
195.
by mkaic 3y ago
Right, I'm aware of the Imagen architecture, just curious to see further research determining which aspect of it is responsible for the improved text rendering. EDIT: According to the figure in the Imagen paper FL33TW00D's respons
196.
by mkaic 3y ago
I didn't think about that but you're totally right, assuming they have those embeddings cached it would be super easy to retrain SD using them. 11B parameter count is rather unfortunate though tbh, I've never been the biggest
197.
by mkaic 3y ago
While it's not publicly available yet, I have strong suspicions that multimodal GPT-4 may actually be SOTA in image-to-text. The examples shown in the Sparks of AGI paper were extremely impressive imo, though of course those are cherry
198.
by mkaic 3y ago
Yeah Emad was clarifying this on the LAION discord the other day — plan is to have a better-licensed version out Eventually™, guess we'll see how long that takes.
199.
by mkaic 3y ago
I think this model will result in a massive new wave of meme culture. AI's already seen success in memes up to this point, but the ability for readable text to be incorporated into images totally changes the game. Going to be an intere
200.
by mkaic 3y ago
HF also wrote a blog post on how you can mess around with the model in a python notebook using their excellent Diffusers library: https://huggingface.co/blog/if
201.
by mkaic 3y ago
I'm quite curious how much of the improvement on text rendering is from the switch to pixel-space diffusion vs. the switch to a much larger pretrained text encoder. I'm leaning towards the latter, which then raises the question of
202.
by mkaic 3y ago
This does outperform Stable Diffusion 2.1, but uses a different architecture and requires more memory and compute. Stable Diffusion runs its denoising process in a compressed "latent space" which is how it was able to be so comput
203.
by mkaic 3y ago
Not GP but I wonder if maybe they're referring to The Thought Emporium[0]? [0] https://www.youtube.com/@thethoughtemporium
204.
by mkaic 3y ago
As a Gen Z-er who grew up learning as much as I could about my passions, mostly on YouTube, I hope you're right about us! I'm really hopeful that my generation can go on to do some pretty great stuff. We do have a patently odd sen
205.
by mkaic 3y ago
I agree! I actually wrote a blogpost about this recently[0], but the TLDR is that ownership is nothing without enforcement, and it has become increasingly difficult to enforce ownership of intellectual property in the modern world — first d
206.
by mkaic 4y ago
Right, I believe GP's point is that for a given capacity, you now need fewer kilograms of batteries to store it, meaning the percentage of overall capacity used to accelerate the mass of the battery itself goes down.
207.
by mkaic 4y ago
More frequent outages, ads in replies, a rather silly new verification system, viewcounts being visible on tweets, Musk publicly mocking a disabled employee, etc. I don't hate Elon, but the dude should really leave Twitter ASAP. He&#x2
208.
by mkaic 4y ago
Oh interesting, I wasn't aware! Thanks for sharing.
209.
by mkaic 4y ago
Agreed. It's incredible to me how good Musk can be at running SpaceX and simultaneously how bad he can be at running Twitter — strengths and weaknesses, I suppose...
210.
by mkaic 4y ago
IMO both Webb's deployment and this Starship test can both be kick-ass displays of engineering prowess. Kick-assery doesn't have to be exclusive to fully-completed deep-space missions!

More ›