higuidebot

5 ms·

1.
How do LLMs change the human knowledge graph?(attractorstate.com)
3 points by higuidebot 8mo ago|0 comments
2.
by higuidebot 1y ago
What do you think a "better" result would be here? Better by what metric?
3.
Morphology of a Marvel Movie(github.com)
3 points by higuidebot 1y ago|3 comments
4.
by higuidebot 2y ago
Definitely plausible but it underrates the changes in actual content. It's not just SEO and titling, it's actual videos that have "stepsis" etc. as themes.
5.
by higuidebot 2y ago
I am the author, it's just those 3 terms for the tSNE cluster. Sorry, I can tell from some of the comments here the graphs need to be clearer. "Stepsis" is indicative of incest IMO, the "step" is a fig leaf.
6.
by higuidebot 2y ago
It's not quite "random" to look at the most intentionally directed legislation of several years. What's your explanation? Genuinely curious. One way or another the clusters do exist, the trends do exist in both content a
7.
by higuidebot 2y ago
SEO contributes for sure, but I would reverse the statement here - it's more about new content and less about SEO. There's a feedback loop race to the bottom dynamic regardless
8.
by higuidebot 2y ago
>For their category "Sexual Violence", they include both violent terms ("woman being raped", "torture porn"), and non-violent terms ("stepsis") False, the final term is "incest", not &quo
9.
From "hot blonde" to "stepsis": porn titles over time(github.com)
21 points by higuidebot 2y ago|25 comments
10.
by higuidebot 2y ago
You're right curiousgal. I filed an issue in response to this comment and will resolve sometime soon: https://github.com/dhealy05/frames_of_mind/issues/1
11.
by higuidebot 2y ago
Lol @ R1's description of my Github ... thanks Deepseek, very cool!
12.
by higuidebot 2y ago
No need to do anything in particular! Perhaps interesting to observe
13.
by higuidebot 2y ago
Ha, if steps have consistent distances you could take the average distance at step X and generate a step of that length in some direction and be ~approximately correct regardless of the actual value
14.
by higuidebot 2y ago
Very cool!
15.
by higuidebot 2y ago
Well, you are certainly correct about how cosine sim would apply to the text embeddings, but I disagree about how useful that application is to our understanding of the model. > In this case, cosine distance one would be in a case when i
16.
by higuidebot 2y ago
Potentially it's useful to understand a model "on its own terms" via its observable outputs. >The relation among the internal model representations inside its latent space and the embedding of the CoT compressed with a tex
17.
by higuidebot 2y ago
Text embeddings are underused WRT model understanding IMO. "Interpretability" focuses on more complex tools but perhaps misses some of the basics - shouldn't we have some sort of visual understanding of model thinking?
18.
by higuidebot 2y ago
Thank you for your support Mr. Wu
19.
by higuidebot 2y ago
I too am pleasantly surprised
20.
by higuidebot 2y ago
2D plot is tSNE, consecutive distance comparison is cosine sim distance normalized across the chain of thought
21.
by higuidebot 2y ago
2D plot is tSNE, consecutive distance comparison is cosine sim distance normalized across the chain of thought
22.
by higuidebot 2y ago
Whether or not it's "noise" might depend on if you think Chains of Thought are causally relevant? I liked these pieces if you want to read more about CoT / O1: O1 Technical Primer: https://www.lesswrong.com&#x
23.
by higuidebot 2y ago
Random walk is definitely possible. Also possible that we're observing some "search" in the embedding space from an initial point. It's hard to tell because the chains are often similar lengths, so I don't think it
24.
by higuidebot 2y ago
Well ... we have to reduce them to a 2D plane to visualize them ...
25.
by higuidebot 2y ago
Is it generating embeddings or just coordinates? What would be a better way?
26.
Watch R1 "think" with animated chains of thought(github.com)
267 points by higuidebot 2y ago|75 comments
27.
by higuidebot 2y ago
Any question in particular WRT system prompts and their effects you'd find interesting? Taking suggestions for followups!
28.
by higuidebot 2y ago
Ok I am legit interested in the behavior of "thousand of a's" Claude lol. You make a good point that "degree of persistence within context" is an important metric to test WRT personality. I did do some testing with
29.
by higuidebot 2y ago
> For such an interesting and perhaps important line of work, there seems to be a surprising lack of psychometric rigor in certain corners of the literature. I agree! That's why I wrote it > I'm skeptical that this is a reli
30.
by higuidebot 2y ago
That's one way to get to UBI alright

More ›