gfourfour

8 ms·

31.
by gfourfour 2y ago
Yes. I split the text into sentence and append sentences to a chunk until the max context window is reached. The context window size is dynamic for each article so that each chunk is roughly the same size. Then I just do a mean pool of the
32.
by gfourfour 2y ago
The end result is a recommendation algorithm, so basically just vector similarity search (with a bunch of other logic too ofc). The quality is great, and if anything a little bit of underfitting is desirable to avoid the “we see you bought
33.
by gfourfour 2y ago
I will probably make a post when I launch my app! For now I’m trying to figure out how I can host the whole system for cheap because I don’t anticipate generating much revenue
34.
by gfourfour 2y ago
Like 8 gb roughly
35.
by gfourfour 2y ago
Ah didn’t realize it was every language. Yes I’m using a light weight open model - but also my use case doesn’t require anything super heavy weight. Wikipedia articles are very feature-dense and differentiable from one another. It doesn’t r
36.
by gfourfour 2y ago
Nothing too crazy, just downloading a dump, splitting it into manageable batch sizes, and using a lightweight embedding model to vectorize each article. Using the best GPU available on colab it takes maybe 8 hours if I remember correctly?
37.
by gfourfour 2y ago
Yes
38.
by gfourfour 2y ago
Maybe I’m missing something but I’ve created vector embeddings for all of English Wikipedia about a dozen times and it costs maybe $10 of compute on Colab, not $5000
39.
by gfourfour 2y ago
Easily the worst demo video I’ve ever seen. They spoke about the battery life before they even said what the product was supposed to do. The founders sounded like they were being held at gunpoint. Plus, a $700 price is obscene and a $24&#x2
40.
by gfourfour 2y ago
Once you’re in the door somewhere the cream tends to rise, regardless of your background.
41.
by gfourfour 2y ago
If you’re interested in doing your own thing send me an email at mhmthrowaway23@gmail.com I have a BA in philosophy and a MS in CS w/ a focus in computer vision. Similar boat as you. No 13 years of exp in a prior industry though. I sto
42.
by gfourfour 2y ago
Yes, it’s the current market. I’m in the same boat.
43.
by gfourfour 2y ago
The market now is terrible but your math degree isn’t holding you back
44.
by gfourfour 2y ago
Any kind you want. Being smart matters 100000x more than your major.
45.
by gfourfour 2y ago
> This paper provides an overview of the main sources of catastrophic AI risks, which we organize into four categories: malicious use, in which individuals or groups intentionally use AIs to cause harm; AI race, in which competitive envi
46.
by gfourfour 2y ago
It’s no more thought-terminating than “intelligence,” which is extremely loaded and causes people to make assumptions about these models that work backwards from the “intelligent” label rather than forwards from the tech itself
47.
by gfourfour 2y ago
All in the game
48.
by gfourfour 2y ago
It’s literally about hockey. Big market for women to read about rich athletic white men.
49.
by gfourfour 2y ago
This entire saga is really an example of the absurdity of non-profits and philanthropy in general. The only difference between nonprofit and for-profit entities is that nonprofits divert their profits to a nebulous “cause”, with the investo
50.
by gfourfour 2y ago
To the contrary, the more I use it the more clearly it is just this. That’s not to disparage the value of a juiced up autocomplete though
51.
by gfourfour 2y ago
This was exactly my mindset in high school and to a lesser extent college. I’ve adapted a similar mindset to digital tools with Neovim. I think you’re right I need to just get back to that system, anything digital is too ethereal to really
52.
by gfourfour 2y ago
I agree to an extent but I’ve realized that the benefit of retention is probably outweighed by the downside of slowing information acquisition. I’m realizing that note taking doesn’t help retention as much as I thought it did and not taking
53.
Ask HN: How do you develop and maintain a good note-taking habit?
21 points by gfourfour 2y ago|16 comments
54.
by gfourfour 2y ago
You’re right, that is pedantic
55.
by gfourfour 2y ago
There’s a lot of cargo-cult mimicry of Steve Jobs and Elon Musk that happens in terms of behavior. But those guys were product people and to the extent that their low-empathy personalities were beneficial it’s in the fact that they cared ab
56.
by gfourfour 2y ago
It’s pretty normal to have some narcissistic inclinations as a 19 year old, but it’s important to recognize that it’s fundamentally from a place of insecurity and excessive worry about how others perceive you. A good therapist could be help
57.
by gfourfour 2y ago
This is kind of a confusing perspective considering VCs are giving you money to pay for the operations of your business. Money is money no matter how stupid the giver is, their money won’t leech value from your company itself. As for founde
58.
by gfourfour 2y ago
Yeah, it’s not easy to get a job. At all. Maybe I’m insulated in a white-collar bubble, but it seems like there’s a pervasive sense of ‘quiet desperation’ across all industries.
59.
by gfourfour 2y ago
We need more fun software
60.
by gfourfour 2y ago
It sounds like they’re walking the dogs on a basically public nature trail that runs through Prince’s property. In which case, in the abstract, I am fine with dogs being off leash. This is one of those stories where it’s impossible to take

More ›