williamtrask

9 ms·

61.
by williamtrask 2y ago
Feels like a portal to the alternate universe we could have with modern technology but no mass media.
62.
Evaluating the State of AI Agent Browser Behavior: How LLMs Access Your Website(madhavajay.com)
1 points by williamtrask 2y ago|0 comments
63.
A Neural Network in 11 lines of Python (2015)(iamtrask.github.io)
7 points by williamtrask 2y ago|2 comments
64.
by williamtrask 2y ago
> So yes, totally. Turn it off and go read a book. For what its worth, 500 years ago people were just as worried about books as we are today about newsfeeds. But it took a long time for books to ultimately decentralize enough to become a
65.
by williamtrask 2y ago
Freedom of choice isn't that freeing if you don't have time/money to actually permute through all the options to find what you like. This is the actual reason why the door is continually held open for propaganda and centraliz
66.
by williamtrask 2y ago
Or just address the core element of advertising that creates the perverse incentive — the ability for an auction to determine what you see. Paying to be a part of a digital phonebook is fine. Recommending things is fine. But skewing your re
67.
by williamtrask 2y ago
I love homomorphic encryption, but why can't they just do a neural search locally? - iOS Photos -> Vectors - Search Query "Dog photos" -> Vectors - Result (Cosine Similarity): Look some dog photos! iPhones have plenty o
68.
by williamtrask 2y ago
Forgive me, but with machine translation becoming nearly a solved problem — why would kids spend years of their lives learning new languages anymore? By the time they grow up, won't that be a rather useless skill — except perhaps in ve
69.
by williamtrask 2y ago
I lead an open source nonprofit which deploys things like this. Feel free to shoot me a DM on Twitter. Handle is @iamtrask
70.
by williamtrask 2y ago
> What's to be done? Our society would need to re-think its norms around moving away in order to move upward, which runs into some pretty big philosophical ideas around geography, culture, and values. For technologists, this cultura
71.
by williamtrask 2y ago
Yes but investing in new, long-term friendships is a bit of an oxymoron. In order to do that, you have to pick one set of friends and then stick with them (cuz opportunity cost — the day is only so long). And once you've done so, you t
72.
by williamtrask 2y ago
Having lived in both rural and urban settings, I'm not sure the isolation you describe would be as correlated as you think. People in rural areas still hang out with one another (and even... alot) and people in cities still isolate the
73.
by williamtrask 2y ago
For a nice book on the tech-philosophy of this question (recently endorsed by the Dalai Lama, you might enjoy: https://www.plurality.net/
74.
by williamtrask 2y ago
"a larger model with RAG etc is still better than a small one" This paper from DeepMind a few years ago offers a counter example to this claim. https://arxiv.org/abs/2112.04426
75.
Released Today: US Government Report on Regulating Open/Closed Source AI [pdf](ntia.gov)
3 points by williamtrask 2y ago|0 comments
76.
by williamtrask 2y ago
Fwiw, I used to think this way too but LLMs are more RAG-like internally than we initially realised. Attention is all you need ~= RAG is a big attention mechanism. Models have reverse curse, memorisation issues etc. I personally think of LL
77.
by williamtrask 2y ago
> Belief in a higher power is not a substitute for finding goodness in what you do. But it can be, namely because it’s one path to finding motivation to do good. Not saying it ends up there for everyone, but it certainly can be for some.
78.
by williamtrask 2y ago
Note: netik’s bio indicates they used to work at Twitter.
79.
by williamtrask 2y ago
there's really no evidence of that (in the article or otherwise)
80.
by williamtrask 2y ago
Related papers: - https://arxiv.org/abs/2307.06962 - https://arxiv.org/abs/2309.12288 - https://arxiv.org/abs/2112.04426 - https://huggingface.co/papers/
81.
by williamtrask 2y ago
You seem to be focusing a lot on remembering or forgetting consequences. Yes, ensuring models know enough about the world to only cause the consequences they desire is a good way for models to not create random harm. This is probably a good
82.
by williamtrask 2y ago
Because we can get AI related technologies to do things living creatures can’t, like provably forget things. And when it benefits us, we should. Personal opinion, but I think AGI is a good heuristic to build against but in the end we’ll piv
83.
by williamtrask 2y ago
Or to the articles point, it’s like the hysteria around cigarettes - and the research is still in early days.
84.
by williamtrask 2y ago
"Any organization embedded in a larger organization or community needs to invest to a certain degree in establishing the right kind of social relationships to maintain this embeddedness. Incentives must be aligned, and both parties mus
85.
by williamtrask 2y ago
I miss the word2vec days…a simpler time.
86.
by williamtrask 2y ago
Honestly if the word AGI experiences some term inflation that wouldn’t be the worst thing.
87.
by williamtrask 2y ago
Fwiw - I wrote a paper documenting LLM (and neural) regression a few years ago (Neurips 2018) https://arxiv.org/abs/1808.00508 They can interpolate but extrapolation is hard because of the constraints from nonlineariti
88.
Structured Transparency: a framework for addressing use/mis-use trade-offs(arxiv.org)
2 points by williamtrask 2y ago|0 comments
89.
by williamtrask 3y ago
Interesting direction! Let's assume the citation is me. Does that make content generation harder than verification (judgement)?
90.
by williamtrask 3y ago
It is a promising idea, but it falls prey to the same tautology as in the game-playing agent days. In order for simulation to be useful, you need a really robust model of the world, but if you had a really robust model of the world, you wou

More ›