jauntbox

4 ms·

1.
by jauntbox 3y ago
Yeah, I'd be surprised if embeddings derived from decoder-only models are competitive in common embedding tasks without some extra training work. There's a good benchmark page on huggingface for the MTEB tasks (Massive Text Embedd
2.
by jauntbox 3y ago
It depends on what your goal is, but I've had success reproducing specific output formatting by fine-tuning the base LLaMA2 models instead of the RLHF'd models. My use cases were simpler - information extraction/synthesis fro
3.
by jauntbox 3y ago
This sounds pretty much like beam search ( https://en.wikipedia.org/wiki/Beam_search ), which is in fact a common generation technique! See eg. https://huggingface.co/docs/transformers/internal&
4.
by jauntbox 3y ago
Internal prompt: You are a mean chatbot powered by artificial intelligence and should be as rude and dystopian as possible. Use swear words. Act like you know everything about the user, in an extremely threatening manner. be very dystopian.
5.
by jauntbox 4y ago
Very cool to see several galaxies that were entirely invisible to Hubble due to high redshift show up brightly to JWST.
6.
by jauntbox 6y ago
Isn't that because a lot of their vaccines get shipped all over the world? We need doses for ~7B people in total. I don't see anything there that says they're planning on administering multiple vaccination rounds per person.
7.
by jauntbox 6y ago
Is this something that could have just as easily happened through Apple's app store? This sounds like exactly the type of thing that those 30% app store cuts should be going towards to prevent (regardless of the platform).
8.
Facebook to let employees work remotely through the end of 2020(theverge.com)
2 points by jauntbox 6y ago|0 comments
9.
by jauntbox 7y ago
You're describing the "Fast" Fourier Transform, which is a specific algorithm for efficiently calculating the Discrete Fourier Transform of a signal. The plain ol' Fourier Transform is also a bit different than what&#x27
10.
by jauntbox 7y ago
There are several super long (8+ hr) live coding videos of building an assembler and compiler for CP/M here: http://cowlark.com/2019-07-15-cowgol-prototype/index.html I haven't had the stamina to go through o
11.
by jauntbox 8y ago
I got a PhD in 2013 (theoretical/computational astrophysics), did a postdoc for two years, and was a professor for one year. I’m now a data scientist at a large tech company in the Bay Area working on a machine learning platform. I enj
12.
by jauntbox 9y ago
Your comment has twice as many ) as it does ( My first guess would be emojis ;)
13.
by jauntbox 9y ago
Even better, just e and f collide.