antimatter15

6 ms·

31.
by antimatter15 4y ago
From my experimentation I suspect there's some subtle bug in llama.cpp that especially degrades code related prompts- even without quantizing
32.
by antimatter15 4y ago
There's a script in the alpaca-lora repo for converting the weights back into a PyTorch dump- and my changes have since been merged https://github.com/tloen/alpaca-lora/pull/19
33.
by antimatter15 4y ago
It reworks the interactive mode into a chat interface, which -if my code was cleaner- could have just been a pull request.
34.
by antimatter15 4y ago
From my experimentation it seems like there's some significant loss in accuracy running the tuned LoRa models through llama.cpp (due to bugs/differences in inference or tokenization), even aside from losses due to quantization.
35.
by antimatter15 4y ago
It inherits from ARM NEON optimizations in llama.cpp but I believe it should also work on x86.
36.
Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook(github.com)
673 points by antimatter15 4y ago|283 comments
37.
by antimatter15 4y ago
There are already open source LLMs with comparable parameter counts (Facebook's OPT-175B, BLOOM), but you'll need ~10x A100 GPUs to run them (which would cost ~$100K+). I suspect a big part of why stable diffusion managed to consu
38.
by antimatter15 4y ago
I wonder if it'd be possible to build a more compact and power efficient version of this using electrostatics on a flexible PCB
39.
by antimatter15 5y ago
For those interested in trying this out without dusting off their DOS machine, there's an online Javascript emulator here: https://www.pcjs.org/software/pcx86/app/other/visicalc/1981/
40.
by antimatter15 5y ago
I feel like the emphasis on the percentage of KN95s which are counterfeit is suspect in the context of this page, since even a counterfeit respirator is likely to perform an order of magnitude better than any cloth mask or surgical mask at
41.
by antimatter15 5y ago
One of the authors of this project here— We actually iterated a bit on the design since then and removed the dependencies on door hinges and paper plates. The revised^3 design involves scotch tape and a paperclip instead. https:/&#x2F
42.
by antimatter15 5y ago
iPhones can survive 1000G's
43.
by antimatter15 5y ago
The latest version (3.35.4) adds `ALTER TABLE DROP COLUMN` https://sqlite.org/releaselog/3_35_4.html
44.
by antimatter15 6y ago
Ethereum blocks have a gas limit so it wouldn't be Turing complete under your definition either.
45.
How we reduced our AI labeling cost by 10x(cresta.com)
34 points by antimatter15 6y ago|0 comments
46.
by antimatter15 6y ago
I recently took my amateur ham exam— fun fact: broadcasting music on ham radio is forbidden unless it's incidental to some broadcast from a space station. http://www.arrl.org/part-97-text
47.
by antimatter15 6y ago
I've actually prototyped this recently, but never got around to packaging it up into a library. There are a few neat adjacent things that it can be used for (e.g. opening big SQLite files on disk without reading it all to memory), buil
48.
by antimatter15 6y ago
So this must be why last week's updated "App Store Review Guidelines" explicitly excluded "one-to-many realtime experiences". Third party fitness apps need to fork over 30% to Apple, while they launch their own firs
49.
by antimatter15 6y ago
Seems like someone accidentally installed F.lux on the Bay Area skyline today
50.
by antimatter15 6y ago
I can't seem to get it to correctly answer any query which references more than a single table. For instance, "which city has the most farms" yields the somewhat nonsensical "SELECT city.City_ID FROM city GROUP BY city.C
51.
by antimatter15 6y ago
Was it any of these? http://antimatter15.com/ajaxanimator/wave/ or https://antimatter15.com/ajaxanimator/stick2/stick2.html I made it about 10 years ago when I was 12. If it was me, I&#x
52.
by antimatter15 6y ago
I was a little bit confused what Clover was referring to— "Clover EFI is a boot loader developed to boot OS X (Hackintoshes), Windows and Linux in legacy or UEFI mode." ( https://wiki.archlinux.org/index.php/C
53.
by antimatter15 7y ago
This appears to be by Johnny Chung Lee, who did all the experiments with head tracking, and finger tracking with the Nintendo Wii controller many years ago ( http://johnnylee.net/projects/wii/ ).
54.
by antimatter15 7y ago
Disclaimer: I was the original author of Tesseract.JS— though all the hard work nowadays is done by Jerome Wu. If you're interested in supporting the project, consider backing the OpenCollective ( https://opencollective.com&#
55.
by antimatter15 7y ago
(creator here) If you enable the "Disable Lookup" setting from the context menu the extension doesn't communicate with any servers at all— everything is processed with a Javascript/WebAssembly OCR engine bundled with the
56.
by antimatter15 7y ago
(creator here) That's exactly what pressing "Disable Lookup" does. We started a fairly popular Emscripten/WebAssembly port of the Tesseract OCR engine specifically to advance the state of client-side javascript OCR engin
57.
by antimatter15 7y ago
(creator here) The copy is mostly referring to the text detection algorithm that was being used (It's built on a tweaked custom implementation of Microsoft Research's Stroke Width Transform algorithm)— which was state of the art a
58.
by antimatter15 7y ago
(creator here) Unfortunately I only noticed the typo after purchasing the domain name and decided to run with it :)
59.
Show HN: Eigensheep – Run Jupyter Cells on AWS Lambda(github.com)
10 points by antimatter15 7y ago|2 comments
60.
Libra: Facebook’s Cryptocurrency Whitepaper(libra.org)
2 points by antimatter15 7y ago|0 comments

More ›