sorenjan

18 ms·

241.
by sorenjan 2y ago
Is it possible to rearrange a sparse matrix into a smaller dense matrix? Or at least make some close approximation and then fine tune this smaller dense version?
242.
by sorenjan 2y ago
Shearing is a linear operation that should be trivial for a NN to learn. Have you found that unshearing is actually useful? Was it to feed the image to an existing OCR program?
243.
by sorenjan 2y ago
You can use Ollama for serving a model locally, and Continue to use it in VSCode. https://ollama.com/blog/continue-code-assistant
244.
by sorenjan 2y ago
Check out Hardware Haven on Youtube, he tests a bunch of different small form factor NAS computers and similar. I find the whole "raspi ecosystem" a bit overrated, for the most part it's Linux you're working with regardl
245.
by sorenjan 2y ago
Using an LLM to correct text is a good idea, but the text transcript doesn't have information about how confident the speech to text conversion is. Whisper can output confidence for each word, this would probably make for a better pipe
246.
by sorenjan 2y ago
There are keychain sized glass breakers available, maybe a good christmas present for a Tesla owner? Although I don't know if they still carry keys.
247.
by sorenjan 2y ago
They damaged at least one car when their launch pad was suddenly distributed over a large area, throwing concrete pieces at least 6.5 miles. https://www.latimes.com/business/story/2023-04-26/spacex-sta...
248.
by sorenjan 2y ago
Gabe owns yachts worth a billion dollars. I'm sure the others are doing just fine as well. https://luxurylaunches.com/transport/gabe-newell-luxury-yach...
249.
by sorenjan 2y ago
To get position from accelerometer data you have to integrate it twice. Accelerometer data is noisy, and integrating noise quickly leads to large deviations. That's why you need some kind of absolute position reference, like GPS, to no
250.
by sorenjan 2y ago
What a year for games 1998 was. Grim Fandango, Zelda: Ocarina of Time, Half-Life, Gran Turismo, Metal Gear Solid, Starcraft.
251.
by sorenjan 2y ago
I agree with a lot of what he writes, but it's still one of my favorite games. I have faded memories about how frustrated I was running around trying to understand what I was supposed to do next, and strong memories about how the game
252.
by sorenjan 2y ago
That depends on what your particular filter bubble contains. Just browsing HN should inform you that LoRA and fine tuning are common terms in AI, and even if you genuinely thought the article was about the radio technique there's reall
253.
by sorenjan 2y ago
> We randomly initialize A such that it has singular values of 1, freeze it, and only train B. When we do this, we see a sharp reduction in high ranking intruder dimensions in comparison to those in normal LoRA This sounds interesting, b
254.
by sorenjan 2y ago
> I was excited to click the link to see how fine tuning LoRA frequencies I was using on my Mesh network would work. You're thinking of LoRa radio, from Long Range. There's one of you in each LoRA comment section, I have a hard
255.
by sorenjan 2y ago
Like Mathpix? https://mathpix.com/
256.
by sorenjan 2y ago
> Or do they somehow adapt to the operations supported by the user's CPU? This is called runtime dispatch. You can do it manually or use a library, like Google Highway. GCC supports multiversioning where you write separate versions
257.
by sorenjan 2y ago
I think it shows really well how OpenAI was caught off guard when Chat GPT got popular and proved to be unexpectedly useful for a lot of people. They just gave it a technical name for what it was, a Generative Pre-trained Transformer model
258.
by sorenjan 2y ago
I hope ARM doesn't win. I can run whatever I want on my x86 computer, but for some reason ARM based devices seem to need special device trees and custom drivers. I don't know exactly what the difference is, something about device
259.
by sorenjan 2y ago
Can you use a selfhosted LLM that fits in 12 GB VRAM as a reasonable substitute for copilot in VSCode? And if so, can you give it documentation and other code repositories to make it better at a particular language and platform?
260.
by sorenjan 2y ago
Nvidia has done work in AI driven character animation too. https://www.nvidia.com/en-us/on-demand/session/gtcspring22-d...
261.
by sorenjan 2y ago
In addition to the sibling comment's older example there's new work done with GTA too. https://www.reddit.com/r/aivideo/comments/1fx6zdr/gta_iv_wit...
262.
by sorenjan 2y ago
Running that image through Segment Anything you get this: https://imgur.com/a/XzCanxx Imagine if instead of generating the RGB image directly the model would generate something like that, but with richer descriptive em
263.
by sorenjan 2y ago
Definitely, that would make much more sense seeing how content is produced by people. Adjust the technology to how people want to use it instead of forcing artists becoming prompt engineers and settling for something close enough what they
264.
by sorenjan 2y ago
Yes this is true, you do lose some information between the layers, and this increased expressibility is the big benefit of using ML instead of classic feature engineering. However, I think the gain would be worth it for some use cases. You
265.
by sorenjan 2y ago
Text to image models feels inefficient to me. I wonder if it would be possible and better to do it in separate steps, like text to scene graph, scene graph to semantically segmented image, segmented image to final image. That way each step
266.
by sorenjan 2y ago
Don't play their game where they pretend that their net worth is proportional to their achievements.
267.
by sorenjan 2y ago
> wtf do these people think they are appointing themselves fit to hand out trinkets and baubles on behalf of global scientific achievement? https://www.kva.se/en/prizes/nobel-prizes/the-nomination-and...
268.
by sorenjan 2y ago
Have you tried trail running? Running in nature on windy trails is much more fun than just running along on asphalt. Because each trail is different it's also more difficult to compare pace and time between runs, so it's easier to
269.
by sorenjan 2y ago
Related to this, is there a name for the effect when you stitch together video frames into a static background while keeping the moving objects moving? The best example I can think of is this Bigfoot video[0, 1], where the shaky footage has
270.
by sorenjan 2y ago
This is really cool, I'll definitely look at this if I need to embed a map in the future. Are there any libraries that lets you plot geographic data on top of this in Python, with Matplotlib or similar? Slightly off topic, but how come

More ›