donkeyboy

23 ms·

31.
by donkeyboy 3y ago
I think this could be fake. He says it’s an MoE model, but then explains that it’s actually a blended ensemble. Anyone else have thoughts on that?
32.
by donkeyboy 3y ago
Actually, AIs have been training on AI-generated content for a long time now. An example of this is student-teacher distillation.
33.
by donkeyboy 3y ago
Being a top ranked Glassdoor company certainly helps in attracting talent. Their scores are a signal that help me determine which company to join/apply. Especially reading reviews of people in my/similar position.
34.
by donkeyboy 3y ago
Vast.ai is a cloud host similar to aws ec2 instances. Weights and biases is a cloud thing that you can track your model run (like how well is it doing so far, what is the current learning rate, etc). It shouldn’t be required - but I guess t
35.
by donkeyboy 4y ago
Very fun article. Convergent evolution is so cool. At the end, the author asked: why don’t plants also evolve into grasses? Would like to hear if anyone knows. If you look at onion or garlic growing, it basically looks like a very long piec
36.
by donkeyboy 4y ago
Note: the tech market isn’t doing too hot, so don’t be too hard on yourself. Applying to jobs can be a numbers game. Just keep applying. Tune your CV to have keywords in each job application. Reach out to the recruiter on Linkedin and see i
37.
by donkeyboy 4y ago
Because it was developed by OpenAI, which is a company that wants to make money (for example through GPT-3 API calls). Historically, OpenAI has also been concerned that their SOTA models could be threatening to the world if released.
38.
by donkeyboy 4y ago
Yes, they exist, and they are called Linear Regression and Decision Tree. Not everything needs to be a neural network. Anyway, residual connections in NNs as well as distillation being only a 1% hit to performance imply our models are way t
39.
by donkeyboy 4y ago
This was my exact reaction when I upgraded to ios16. I spent 20 mins looking how to get the page turn animation back. Sad
40.
by donkeyboy 4y ago
That sounds like the youtuber carykh.
41.
by donkeyboy 4y ago
They already have jit through numba.