flutetornado

6 ms·

1.
by flutetornado 16d ago
I was wondering if those ternary bits get expanded into full floats internally in the kernels - you’re probably right about lack of tuned kernels. I’m not sure you could just tune your way out of that easily though. Any suggestions on tryin
2.
by flutetornado 16d ago
450 with PTQ_01 and 900 with the other PQ2_0.
3.
by flutetornado 17d ago
GPT Astra did some benchmarking on the DGX Spark. Speed: 34.38 tokens/sec for generation. Seems like we don't have a drafter model yet so it could not test with speculative decoding on. ngram speculative decoding did not help too
4.
by flutetornado 7mo ago
I ended up creating a personal vim plugin for merges one night because of a frustrating merge experience and never being able to remember what is what. It presents just two diff panes at top to reduce the cognitive load and a navigation lis
5.
by flutetornado 7mo ago
My experience with qwen3.5 9b has not been the same. It’s definitely good at agentic responses but it hallucinates a lot. 30%-50% of the content it generated for a research task (local code repo exploration) turned out to be plain wrong to
6.
by flutetornado 1y ago
There are several useful ways of engineering the context used by LLMs for different use cases. MCP allows anybody to extend their own LLM application's context and capabilities using pre-built *third party* tools. Agent Skills allows y
7.
by flutetornado 1y ago
I prefer it because it forces distillation to core ideas, consumable quickly. Busy people have too little time to read too much verbiage.
8.
by flutetornado 1y ago
Everyone in my entire team - best of engineering as well as every manager left. Underpaying and over subscribing people has become a hallmark over there - it's just a body shop now. Engineers are just numbers on a sheet, to be exploite
9.
by flutetornado 1y ago
I’d do that every time I get a chance! Ex-HPE black label on my resume from a startup I used to work in that they bought. That company is a complete horror show.
10.
by flutetornado 1y ago
I think the performance in terminal apps could come from the fact that terminals can use pre rendered, pre cached in GPU, text glyphs covering a fixed size small grid (of glyph sized blocks instead of pixels.) At least that’s what I have wo
11.
by flutetornado 2y ago
I was able to compile ollama for AMD Radeon 780M GPUs and I use it regularly on my AMD mini-PC which cost me 500$. It does require a bit more work. I get pretty decent performance with LLMs - just making a qualitative statement as I didn&#x
12.
by flutetornado 2y ago
My understanding is that top_k and top_p are two different methods of decoding tokens during inference. top_k=30 considers the top 30 tokens when selecting the next token to generate and top_p=0.95 considers the top 95 percentile. You shoul
13.
by flutetornado 2y ago
GPU workloads are either compute bound (floating point operations) or memory bound (bytes being transferred across memory hierarchy.) Quantizing in general helps with the memory bottleneck but does not help in reducing computational costs,
14.
by flutetornado 2y ago
Altair is superb. Have used it a lot and it has become my default visualization library. Works in VSCode and Jupyter Lab. The author has a great workshop video on youtube for people interested in altair. I especially like the ability to con
15.
by flutetornado 3y ago
Try neogit plugin for neovim. Its a work in progress. https://github.com/NeogitOrg/neogit
16.
by flutetornado 3y ago
Yes, on a related note Neovim just got support for WASM plugins and apparently WASM is 100% faster than Lua (neovim's default plugin language runtime) for this use case according to the author. So now plugins in any language that can b
17.
by flutetornado 4y ago
I found this very helpful when switching to nvim recently. Kudos to the author for having the nvim config on github and making videos explaining how he set it all up: https://github.com/LunarVim/Neovim-from-scratch ht
18.
by flutetornado 4y ago
JupyterLab JupyterHub Jupytext - converts ipynb to py Nbstripout - strips all output from ipynb Nbmerge - resolves merge conflicts Vim-jupytext - vim plugin to auto convert ipynb to py Papermill - parameterize notebooks Git Pandas, Altair -
19.
by flutetornado 4y ago
I have been using oil infused Ceramic cookware from Calphalon (Classic). The handles are made of stainless steel which stays cool despite all the cooking. Quite convenient. Works very well as a replacement for Teflon based non stick cookwar
20.
by flutetornado 4y ago
This is the best solution I have found so far being a long time vim user. ssh + tmux + vim is all you need. Least amount of potential problems in this setup. vim runs locally on the server where "remote development" is being done,
21.
by flutetornado 5y ago
For a lot of things such as tables, lists, adding links, etc, markdown allows you to do it "inline" while typing, instead of forcing out of band operations.
22.
by flutetornado 5y ago
If space colonization leads to mining resources from asteroids and offloading the environmental costs of such mining from earth or get us building materials strong enough to give us a space elevator or space factories sending their waste in
23.
by flutetornado 5y ago
I have always wanted Kindle to support a lot more features than what it does today. Digital books could be a lot more than what they are today. Want to embed a python REPL in a python book for users to test things right in the book, from a
24.
by flutetornado 5y ago
Not worried about the singularity anymore after listening to the smartest AI’s generated stories.
25.
by flutetornado 7y ago
I like to use the vim plugin DrawIt for ascii diagrams: https://www.thegeekstuff.com/2009/12/how-to-create-ascii-dra... https://github.com/vim-scripts/DrawIt Pretty easy to create comments fo
26.
Ask HN: Any system programmers who are freelancing? How?
2 points by flutetornado 8y ago|0 comments