rain1

10 ms·

61.
by rain1 3y ago
But then it's an LLM augmented with a tool that is solving the problem, and not the LLM itself.
62.
by rain1 3y ago
I've experimented with this problem a bit https://github.com/rain-1/gpt-incontextlearning-experiments/... - the results were that they can kind of do it, but they do go off the rails fairly easily and get wro
63.
WorLLMs(gist.github.com)
2 points by rain1 3y ago|0 comments
64.
by rain1 3y ago
Is there a way to share my transcript?
65.
by rain1 3y ago
we do, it's called the algebraic numbers! every polynomial with algebraic coefficients has 'n' solutions (counted with multiplicity)! so e.g. x^121 + sqrt(7)x^9 + fithroot(22)x^7 + (1+i)x^3 + 22/7 = 0 has 121 solutions.
66.
by rain1 4y ago
Nothing much of interest there.
67.
Eliezer Yudkowsky's Letter in Time Magazine(thezvi.substack.com)
4 points by rain1 4y ago|0 comments
68.
by rain1 4y ago
explorer here: https://evanthebouncy.github.io/chatgpt-svg/
69.
Probing Compositional Understanding of ChatGPT with SVG(evanthebouncy.medium.com)
3 points by rain1 4y ago|2 comments
70.
Blame Me for Trying(unremediatedgender.space)
2 points by rain1 4y ago|0 comments
71.
Is it time for a pause? By Kelsey Piper(planned-obsolescence.org)
2 points by rain1 4y ago|1 comments
72.
by rain1 4y ago
I have compiled a list of some of the materials that I found the best for learning about how LLMs work. I Hope this is useful to you all. I will continue to update it as I find new things.
73.
LLMs and GPT: Some of my favorite learning materials(gist.github.com)
280 points by rain1 4y ago|24 comments
74.
by rain1 4y ago
I've included the exact prompt that I gave ChatGPT to get it to answer the questions without saying "As an AI assisant/language model blah blah blah" https://gist.github.com/rain-1/3bf56122b0ebeac929
75.
by rain1 4y ago
Do you have any recommendations on where to learn this? Ideally some online course or just a single really good textbook to study?
76.
by rain1 4y ago
Oh I think I see what you mean, note that I used two different AIs (GPT-4 was the tester, Me & ChatGPT were the testee's).
77.
by rain1 4y ago
That's absolutely right, it just predicts the next token. One of the discoveries that led to GPT was the concept that "token prediction is universal" in the sense that all other natural language tasks are a sub-task of token
78.
by rain1 4y ago
I used to know 110 digits of pi. only know about 70 now though.
79.
by rain1 4y ago
This is a great idea!
80.
by rain1 4y ago
Oh! That's smart. So you could try to cut down the verbosity of the responses with a prompt, and perhaps make it harder for GPT-4 to identify. Sounds like a fun challenge!
81.
by rain1 4y ago
sometimes. :) sometimes we are so much more.
82.
by rain1 4y ago
we can't both be wrong!
83.
by rain1 4y ago
> the system should then be able to show its working The system fundamentally cannot do this. You can make it generate text that is like what someone would say when asked to show their working, but that's a different thing. > It&
84.
by rain1 4y ago
This is a good point. If you ask GPT about much more conceptual advanced mathematics it's actually very good at conversing about this. That said, it does 'hallucinate' falsehoods and it will stick with them once they have bee
85.
by rain1 4y ago
> Of course people who actually know how ChatGPT works don't expect it to be able to magically solve mathematical problems There is a causality inversion here. The only reason people know it can't do this is because they have t
86.
by rain1 4y ago
I think what would be even better than the next GPT being able to get that question right, is for it to correctly identify that it cannot solve this problem itself.
87.
Show HN: GPT-4 Reverse Turing Test(gist.github.com)
288 points by rain1 4y ago|272 comments
88.
by rain1 4y ago
I think this talk goes into really good clear detail about how it all works https://www.youtube.com/watch?v=-QH8fRhqFHM but actually the best content that goes into a little bit more technical depth that I've found is
89.
And yet It Understands(borretti.me)
137 points by rain1 4y ago|226 comments
90.
by rain1 4y ago
Thanks for spotting that. I have fixed it now! Have fun learning python

More ›