imranq

11 ms·

91.
by imranq 3y ago
Wouldnt this be possible with a solution like Guidance where you have a pre structured JSON format ready to go and all you need is text: https://github.com/microsoft/guidance
92.
by imranq 3y ago
This is pretty cool, do you find the server farm of older computers valuable for your own work?
93.
by imranq 3y ago
There must be. Since there is a finite amount of real world reward signal captured by these models, there can only be a finite amount of grounded knowledge that can come out. Usually without reasoning, the output knowledge "yield"
94.
by imranq 3y ago
This is an impressive demonstration of GPT-4's logic and reasoning capabilities, but the DM result uses a real-world reward signal (e.g. the list is sorted correctly) to validate its results whereas we can never be sure that GPT-4 outp
95.
by imranq 3y ago
Brilliant idea - I think I'll try this in my neighborhood and at work where people seem to be walking alone all the time
96.
by imranq 3y ago
Maybe this is the answer...when humans are no longer required for a field to move forward, prestige becomes meaningless and everything becomes a means toward self-fulfillment not competition
97.
by imranq 3y ago
Nice! There is probably a whole space of applications that help users effectively prompt engineer a workflow with a UI
98.
by imranq 3y ago
There are probably ways to embed cryptographic hashes within images. Any device that creates images from the real world could have secret keys that can be used to validate any image created by said device. We will still need a centralized p
99.
by imranq 3y ago
I can definitely see this being useful for work and school, but not sure if I would use a foldable for everyday tasks. Casing these phones seems like a challenge
100.
by imranq 3y ago
I suspect that there's a sweet spot that combines a collection of several "neurons" and a human-readable explanation given a certain kind of prompt. However, this "three-body problem" will probably need some serious
101.
by imranq 3y ago
A notebook and pen seems to do the trick. In the beginning of the day, write an entry of what I'll aim to accomplish and when. At the end of the day, judge myself on my productivity and write a plan for the next day. That alone has bee
102.
by imranq 3y ago
Eventually I hope the compute required to run these systems become local, but yes I do find Bard's "personality" to be a little more controlled and cleaner than chatGPTs. However, chatGPT 3.5 usually gives better responses (e
103.
by imranq 3y ago
We have a bimodal distribution. Elite universities whose prestige is already established have an "embarrassment of riches" in terms of applicant pool, whereas middling and low ranked universities without a moat are facing enrollme
104.
by imranq 3y ago
I remember Musk even posting a picture of him and Brin partying after this story came out. Seems like another WSJ hit piece to discredit Musk for no good reason (other than to appease short sellers)
105.
by imranq 3y ago
This is on GPT-J which has 6B parameters. I wonder if this scales well to much larger models like Llama 65B or GPT3
106.
by imranq 3y ago
I thought they were on contract? hopefully they don't go on strike again at the same time the power went out like last time
107.
by imranq 3y ago
I wonder what will happen to isomorphic labs which Demis is also leading
108.
by imranq 3y ago
There are plenty of LLM benchmarks that are used to test performance, some of them are: * Winogrande * BoolQ * PIQA * SIQA * HellaSwag etc...
109.
by imranq 4y ago
I like a lot of the LLM use cases mentioned here. A couple more are: - conducting literature reviews (stay sane while researching LLMs!) - Talking to textbooks / AI teaching assistants - language learning with a companion tailored to y
110.
by imranq 4y ago
It's interesting how all it takes is the right bag of numbers (the weights of gpt) and the entire economy can be upended
111.
by imranq 4y ago
"Make it work, then make it right, then make it fast" is brilliant. This should be a universal principle for almost everything
112.
by imranq 4y ago
For all the hype, the benchmarks they report don't seem super compelling. Financial questions need to have 100% accurate responses (not 60% or so they report) otherwise they are worse than useless and can cost billions of dollars in lo
113.
by imranq 4y ago
I suspect they must be selecting different models based on the question asked. I've noticed this myself asking simple questions vs difficult questions, chatGPT is much slower on the difficult questions even though each token has the sa
114.
by imranq 4y ago
Check out the web demo for the 14B parameter model: https://huggingface.co/spaces/BlinkDL/ChatRWKV-gradio I tried a few queries. It works okay for basic prompts for coding questions but can give pretty good result
115.
by imranq 4y ago
The stats shown are pretty compelling that this transformer + RNN approach works. Looking back at the Llama paper ( https://arxiv.org/pdf/2302.13971.pdf ), many of the results are comparable between llama and RWKV. E.g.
116.
by imranq 4y ago
How does a 3rd party know the traffic figures for Google / Bing? I see they are using a service called Similarweb based in Tel Aviv, but its still a mystery to me how you can get this information without access to internal analytics to
117.
by imranq 4y ago
Maybe they define social good as the collapse of democracy, and the commodification of attention?
118.
by imranq 4y ago
We will have local versions of all of these tools so that there's no downtime
119.
by imranq 4y ago
There's less and less relevant data with longer documents, so I would expect performance wouldn't change much
120.
by imranq 4y ago
I don't see what the problem with Sabine's analysis is? I thought it was great. Shouldn't particle physicists have more expectations of what they expect to find rather than we want to find X and we are going to search the ent

More ›