kernelsanderz

8 ms·

31.
by kernelsanderz 3y ago
It's not really. It was unfortunate timing. This used to be called GPT-Index, and then they changed names before Meta released their LLM. So their use predated it. I feel sorry for the amazing team behind this great library. Changing n
32.
Stable Diffusion’s Founder Emad Has a History of Exaggeration(forbes.com)
71 points by kernelsanderz 3y ago|10 comments
33.
by kernelsanderz 3y ago
Stability AI became a $1 billion company with the help of a viral AI text-to-image generator and — per interviews with more than 30 people — some misleading claims from founder Emad Mostaque
34.
by kernelsanderz 3y ago
Adding this to the huggingface peft library would be amazing. That's the main library that people using LoRA are currently using. https://github.com/huggingface/peft/issues/289
35.
by kernelsanderz 4y ago
If you look at the dockerfile you can see that it’s copied from alice.py
36.
by kernelsanderz 4y ago
I'm excited to see this get implementations for mobile platforms. a 30MiB model sounds like a good tradeoff to stream audio over low bandwidth, or even less reliable mobile connections.
37.
by kernelsanderz 4y ago
Did some more research to see if anything had changed in this space. I found two interesting projects (haven't used them myself yet though): One in C# (with support for auth) https://github.com/alanedwardes/Estrang
38.
by kernelsanderz 4y ago
Last I checked it wasn't easy to use something like optuna to do hyperparameter tuning with hydra/DVC. Ideally I'd like the tool I use for data versioning (DVC/git-lfs/gif-annex) to be orthogonal to that which I use
39.
by kernelsanderz 4y ago
I'd love to see a well-supported git-lfs compatible client/proxy (so you could more easily move backends) that could run on top of S3/object storage. Yes, and written in a modern language like golang/rust for performance
40.
by kernelsanderz 4y ago
I do feel like git-lfs is a good solution. Once you have 10s or 100s of GB of files (eg. a computer vision project), this gets pretty pricey. Ideally I'd love to use git-lfs on top of S3, directly. I've looked into git-annex and v
41.
by kernelsanderz 4y ago
Here are two other approaches that I’ve stumbled on for doing similar things: - https://www.cmcrossroads.com/article/rebuilding-when-files-c... - http://olipratt.co.uk/rebuilding-makefile-targets-only-w
42.
by kernelsanderz 4y ago
This sounds like a great initiative. I can't find anything on the site about a privacy policy, how the email addresses you're collecting will be used. If you're creating this for the AI community, then how will this data be m
43.
by kernelsanderz 4y ago
You kind of can - projects like deepspeed ( https://www.deepspeed.ai/ ) enable running a model that is larger than in VRAM through various tricks like moving weights from regular system RAM into VRAM between layers. Can come
44.
by kernelsanderz 5y ago
I’m wondering if you could compile make to wasm and include it as a cross platform dev dependency?
45.
by kernelsanderz 5y ago
well, apparently in 2018 Google signed a secret deal with Mastercard sharing credit card payment information to do offline tracking of sales that originated from their ads. source: https://www.bloomberg.com/news/article
46.
by kernelsanderz 5y ago
As someone who has recently had to switch from Google Sheets to Office365 the experience has been very poor. Even things like keyboard shortcuts are very inconsistent with the web version of Excel. And if someone is editing the document whi
47.
by kernelsanderz 5y ago
I clicked thinking it was some NLP project that ran on the GPU.
48.
by kernelsanderz 6y ago
ncdu saves my bacon at least every few months. I do machine learning and am always running out of space!
49.
by kernelsanderz 6y ago
I love the idea of Spyder. Particularly as a replacement/alternative to Jupyter notebook style workflows. The last time I tried to use Spyder to connect to a remote kernel, there was no way to interrupt a remote kernel. I understand th
50.
by kernelsanderz 6y ago
I use a vim plugin called slimux to send code from vim into a REPL running in another tmux pane. It works really well. Here's the fork that I'm currently using https://github.com/grusky/slimux I use it with p
51.
by kernelsanderz 6y ago
I this intended for inference of for training?
52.
by kernelsanderz 6y ago
This is a great milestone for Ampere GPU owners, but to get the most out of Ampere you’ll need to wait for PyTorch 1.8 which should have CUDA 11.1 - which has better performance. You can compile from source to get that today. Also CUDNN 8.0
53.
by kernelsanderz 6y ago
You might also want to check out https://github.com/NodeOS/NodeOS
54.
by kernelsanderz 6y ago
I was originally appalled at the software limiting. But according to Tim Dettmers who has a solid record of predicting and comparing NVIDIA cards for deep learning performance, it's not really a big deal. You can read his analysis here
55.
by kernelsanderz 6y ago
This is very interesting work. My concern is that could this technology be used to test for depression, and might employers require their workforce to be tested, and discriminate on this basis? I guess measuring brainwaves is relatively inv
56.
by kernelsanderz 6y ago
Doing a quick search of TESS2 for trademarks look they already have the trademark registered for ZEIT (registered in 2017). So it was probably for other reasons. Which is a shame, because Zeit is very concise, easy to remember, and has a st
57.
by kernelsanderz 7y ago
Do these libraries use deep learning models? It's not entirely clear from the doco.
58.
by kernelsanderz 7y ago
I run Linux (latest Kali Linux) on a similar MacBook Air and it work great for any of the light container tasks I've thrown at it (Docker, firecracker-vm, etc)
59.
by kernelsanderz 7y ago
This. It would be nice to fork the project and do something similar with CloudFront. Any static object data can also be fetched from CloudFront as JSON files, and periodically updated by cache invalidation or cache expiry dates (ie. cache f
60.
by kernelsanderz 7y ago
Reminds me a kickstarter project I backed years ago called ScanBox. I still pull it out from time to time to scan documents when traveling, and have used it once or twice for a live document scanner, though the sides of the box make it dif

More ›