terhechte

29 ms·

91.
by terhechte 2y ago
I've come up with a set of rules that describe our reactions to technologies: 1. Anything that is in the world when you’re born is normal and ordinary and is just a natural part of the way the world works. 2. Anything
92.
by terhechte 2y ago
A friend of mine build a similar app last year ( https://joineat.app ) and it didn't go anywhere (even though it is objectively the nicer app). So there's a lot of luck involved here as well (or maybe he was too early).
93.
by terhechte 2y ago
Came here to say this. I've always been a happy Spotify customer, but this is something I really liked when it was available. Makes me question my subscription a bit.
94.
by terhechte 2y ago
People end up thinking this, but they're just looking at tech roles. However, the difference becomes clear when you compare other jobs. In tech, the US pays way more than Europe, for other jobs, they don't. Take teachers, for exam
95.
by terhechte 2y ago
Check out Floneum, it's basically ComfyUI for LLM's, extendable via plugins https://floneum.com/ Scroll down a bit on the website to see a screenshot.
96.
by terhechte 2y ago
Man, I feel you. I did the same, the issue is that I had to regularly update my wrapper types as new exceptions occurred
97.
by terhechte 2y ago
There was a discussion about this on the Rust Reddit. Can't find the link right now as I'm on a very slow internet connection.
98.
by terhechte 2y ago
Not everybody has this luxury. I once worked on a project where the BE dev had a fundamental issue understanding types (or his PHP code did, who knows), such that, for example, a json array would change its type when empty, e.g. /&
99.
by terhechte 2y ago
Here's a 2022 video that shows it in action https://www.reddit.com/r/Games/comments/v42611/dario_on_twit...
100.
LLM-Powered Programming: A Language Matrix Revealed(ben.terhech.de)
2 points by terhechte 2y ago|1 comments
101.
by terhechte 2y ago
Which LLM did you use with Goose? That really affects the quality of the outcome
102.
by terhechte 2y ago
You can, with ish ( https://ish.app ). It is a bit slow though and doesn't support the newest releases. (Well and by default it runs Alpine instead of Debian)
103.
by terhechte 2y ago
I have a set of tests that I can run against different models implemented in different languages (e.g. the same tests in Rust, Ts, Python, Swift), and out of these languages, all models have by far the most difficulty with Rust. The scores
104.
by terhechte 2y ago
That's cool, than you, but does MLX support the Qwen 1M context yet?
105.
by terhechte 2y ago
I used to work together with Mert at the same company but choose to leave on my own 2 years prior to his layoffs because of similar issues as the one pointed out in this post. Most notably, the lack of vision and the excel table. The compan
106.
by terhechte 2y ago
I gave it a 446433 token input, then it calculated for ~4 hours, and gave me a reasonable response. The content was a Rust / Typescript codebase where Typescript is the frontend and Rust is the backend. I asked it which backend apis ar
107.
by terhechte 2y ago
I bought an M4 Max with 128g of ram just for these use cases. Currently downloading the 7b
108.
by terhechte 2y ago
Yes. It requires a lot of ram, and even on a M4 with a lot of ram, if you give it 1mio tokens the prompt processing alone (that is, before you get the first response token) will probably take ~30min or more. However I'm looking forward
109.
by terhechte 2y ago
Its also the name of the AI in Terminator Zero https://villains.fandom.com/wiki/Kokoro I'm not sure if that is related here.
110.
by terhechte 2y ago
Long context windows are a problem. I gave Qwen 2.5 70b a ~115k context and it took ~20min for the answer to finish. The upside of MoE models vs 70b+ models is that they have much more world knowledge.
111.
by terhechte 2y ago
In addition to the ones listed by others, WizardLM2 8x22b (was never officially released by Microsoft but is available).
112.
by terhechte 2y ago
If you have 128gb ram, try running MoE models, they're a far better fit for Apple's hardware because they trade memory for inference performance. using something like Wizard2 8x22b requires a huge amount of memory to host the 176b
113.
Running Llama LLM on Windows 98(blog.exolabs.net)
4 points by terhechte 2y ago|0 comments
114.
by terhechte 2y ago
The logic is called every frame
115.
by terhechte 2y ago
There're multiple solutions like this and I've used some of them over the past years. - There's obviously the fantastic Magit ( https://github.com/magit/magit ) which is an Emacs Plugin but you can configu
116.
by terhechte 2y ago
https://www.lexology.com/library/detail.aspx?g=164a442a-1b90...
117.
by terhechte 2y ago
Back when computers took up a whole room, you'd also have asked: "but what exactly is this useful for? B-Roll some simple calculations that anybody can do with a piece of paper and a pen."? Think 5-10 years into the future, t
118.
by terhechte 2y ago
I don't think you can do that with Claude. That's what people use uncensored local models for.
119.
by terhechte 2y ago
You could also try Hyperdeck which uses Markdown for slides as well, but supports most of the animation features of Powerpoint as well as MathML and stuff like that (no vector editing though) http://hyperdeck.io
120.
by terhechte 2y ago
Most devs use windows ( https://www.statista.com/statistics/869211/worldwide-softwar... ). Reddit llocallama alone has 250k users. Clearly the market is bigger than 1000 people. Why are gamers and Linux people alway

More ›