imranq

8 ms·

61.
by imranq 3y ago
Attention is basically routing, these other routing schemes put a less fine-grained choice for the model, which potentially makes it easier to train
62.
by imranq 3y ago
Reading the paper, the connection to compilers is more of an analogy rather than a direct technical link. The authors propose using an LLM to reframe the task as high level psuedocode, and then reason on that code on the specific details of
63.
by imranq 3y ago
I think 99% of users aren't trying to train their own LLM with their data
64.
by imranq 3y ago
Shouldn't this be LoRA training?
65.
by imranq 3y ago
GPT-5 will likely only see improvements in deductive reasoning like in math, I think it there are diminishing returns if all GPT-5 is a larger transformer than GPT-4
66.
by imranq 3y ago
Dang this is super cool - here is the github link for anyone to see how it works: https://github.com/saharan/works/tree/main/life
67.
by imranq 3y ago
Thanks for the summary This won't work alone for ML. The matrix sizes are huge with billions of parameters. Doing light based calculations for that seems impossible with this technique. Potentially you could break apart a big matrix in
68.
by imranq 3y ago
The methods are incredible, but it seems like the text is ordinary and nothing to write home about
69.
by imranq 3y ago
Unless you can figure out AI that is available everywhere, all the time (even in the most remote jungle with no power), there will always be value in making humans smarter
70.
by imranq 3y ago
At this point are academic papers simply peer-reviewed blog posts?
71.
by imranq 3y ago
I think Gemini Pro is in bard already? So that's what it might be. A few users on reddit also noticed improved Bard responses a few days before this launch
72.
by imranq 3y ago
LLMs are comprised of just three elements Data Compute Algorithms All three are just scratching the surface of what is possible. Data: What has been scraped off the internet is just <0.001% of human knowledge as most platforms cannot be
73.
by imranq 3y ago
Super cool! I like the fluid movement with the robot
74.
by imranq 3y ago
100%, if we had real personalized AI companions that actually had an idea of your knowledge state then summarization would be a game changer.
75.
by imranq 3y ago
Is the vision model directly reading the screen and therefore also reading the Vimeo tags? It might be more effective to export the DOM tags and the associated elements as a Json object that is fed into chatGPT without using the vision comp
76.
by imranq 3y ago
One problem with summarization that I think is overlooked is that it relies on the context of the reader. A lot of summarization assume some ambiguous level of context, but it would be way better if you knew exactly where the readers coming
77.
by imranq 3y ago
Is it possible to know the minimum model size / data set size it takes to train a model given certain efficiency parameters (latency, etc.)?
78.
by imranq 3y ago
While SD is pretty interesting, I'm curious what do people use it for? Outside of custom greeting cards and backgrounds, it's not really precise enough for conceptual art nor is it consistent enough for animation.
79.
by imranq 3y ago
I think interpretable is a overloaded term. If you use RAG, sure you can look at the retrieved text and understand what is being used, but at that point you're just interpreting the retriever. LLMs need to be interpreted so that they c
80.
by imranq 3y ago
From https://www.lockheedmartin.com/en-us/news/features/history/b... "[The plane] flew coast to coast [in the U.S] in 67 minutes" Being able to go from NY to California in an hour seems pretty
81.
by imranq 3y ago
Courses that can help people work with genAI are sorely needed. At the same time, hardware/software integration with these technologies is really lacking. There hasn't been an iPhone moment for generative AI yet
82.
by imranq 3y ago
I found this tool to be interesting to play with and seems to work pretty well assuming you stay in the same position: https://gazerecorder.com/ I'm guessing a combination of projection mapping, built in lighting, and
83.
by imranq 3y ago
This is the book that got me into mathematics as a high schooler
84.
by imranq 3y ago
Just take a badge reader back with you and badge in at home
85.
by imranq 3y ago
Maybe this increased prudishness is coming from the kinds of queries they are seeing come in...
86.
by imranq 3y ago
Seems like a lot of confirmation bias on this thread, but I've found google search to be fine for most of the search queries I've used. The real threat seems to be chatGPT which has been a great timesaver for information that need
87.
by imranq 3y ago
I've skimmed through the Landau books and while they are technically excellent, they lack a sense of feeling and motivation which makes it hard to self study from. It felt like a slog across random topics with no application
88.
by imranq 3y ago
I mean if someone likes the subject, then they should invent a project that forces them to build something or write something up. Otherwise its easy to "fake" learning by doing the motions on a bunch of tutorials and quizzes.
89.
by imranq 3y ago
I would not start with any course unless you had a project in mind that would take the knowledge from the course to get started. Otherwise you risk wasting a lot of time for knowledge that won't help you in any way and will get outdate
90.
by imranq 3y ago
I had a student who was basically performing at a 6th grade math level despite being in 11th grade. I told that student to go through Khan Academy starting from Pre-K all the way to 12th grade and don't continue unless they achieved ma

More ›