jawerty

14 ms·

121.
by jawerty 3y ago
I see, that’s my misunderstanding I was grouping all training as pretraining
122.
by jawerty 3y ago
So I'm not doing RLHF that's how LLama is pre-trained. It's in the loss/optimization phase in their training I believe. For the finetuning i'm using LoRA to freeze most of the layers for parameter optimization. Usin
123.
by jawerty 3y ago
I run through a lot of these concepts, specifically RLHF, in my latest coding stream where I finetune LLama 2 if anyone's interested in getting a LLM deep dive https://www.youtube.com/watch?v=TYgtG2Th6fI&t=4002s Lo
124.
Let's Code a Q/A Model From Lex Fridman's Podcasts [video](youtube.com)
2 points by jawerty 3y ago|1 comments
125.
by jawerty 3y ago
Hey HN! In this video I scrape audio from podcasts (for now George Hotz and Lex Fridman as an example) to generate a dataset for a Retriever/Reader system (using a small home grown vector db and LLama 2). I also go through how to load
126.
Scraping Hacker News like a leet 10x haxor
2 points by jawerty 3y ago|0 comments
127.
by jawerty 3y ago
Thank you! I have some other streams where I do little projects like these check them out
128.
Fine-tuning Llama 2 to code like me
4 points by jawerty 3y ago|0 comments
129.
by jawerty 3y ago
I just streamed this last night https://m.youtube.com/watch?v=TYgtG2Th6fI&t=3998s I’ve been live streaming myself fine tuning llama on my GitHub data (to code like me)
130.
How to learn to code – 4 Essential Rules(medium.com)
1 points by jawerty 3y ago|0 comments
131.
by jawerty 3y ago
Out of curiosity what are the risks of AI?
132.
by jawerty 3y ago
Can't agree more once I started prioritizing Vitamin D in my diet and getting hours of sun if possible it's like a 180 with mental health. Eggs are a great source as well.
133.
by jawerty 3y ago
The younger to older Stanford matching service part got me laughing, good one. Lots of truth there.
134.
by jawerty 4y ago
Saw that this had 796 points and had a mini freak out
135.
by jawerty 4y ago
That’s great to hear you found a positive path forward for the project. Keep it up!
136.
by jawerty 4y ago
Just to add to this: I see that you took it down for some valid reasons but don't be dismayed. This is a cool idea, probably not best to be implemented as a product to improve mental health but there's something here. If you find
137.
by jawerty 4y ago
Recently used Faiss to optimize a kmeans implementation. Way faster than the sklearn implementation can’t recommend enough.
138.
by jawerty 4y ago
How does it work? Does this generate the actual HTML code for the websites? Or just the copy?
139.
by jawerty 4y ago
Love simple html solutions. great job.
140.
by jawerty 4y ago
Rather than editing books from our past to fit what makes you feel better why not write your own books without these phrases you don't like. Speaking as a black guy who could of been "hurt" from reading a James Bond book haha
141.
ChatPlus, a Chrome extension that enhances Rumble chat(github.com)
1 points by jawerty 4y ago|0 comments
142.
by jawerty 4y ago
This person does not represent HN. They can have their opinion.
143.
by jawerty 4y ago
You forgot politically correct HR tone good. Telling the hard truth bad
144.
by jawerty 4y ago
How do you define hate speech?
145.
by jawerty 4y ago
Oh nice! Do you have a way of having the user add their own?
146.
by jawerty 4y ago
Thanks for your response. Also that's cool you're probably right about meta tags open graph is broadly used but not uniform in their content. As for additional sites Stackoverflow and quora would be great additions.
147.
by jawerty 4y ago
I really like this. I've been working on my own personal search engine and might use a ux like this now. Question, how are you detecting whether the results are twitter posts/users and not random twitter pages (like the twitter ca
148.
How to Vet and Hire Engineers as a Non-Technical Founder(medium.com)
2 points by jawerty 4y ago|0 comments
149.
The Guide to Becoming a Career Programmer Without a Degree(medium.com)
1 points by jawerty 4y ago|0 comments
150.
The Problem with Big Tech(medium.com)
1 points by jawerty 4y ago|0 comments

More ›