3 ms·
And herein lies the problem with vibe coding - accuracy is wanting. I can absolutely run models that this site says cannot be run. Shared RAM is a thing - even
by codingdave 2y ago
And herein lies the problem with vibe coding - accuracy is wanting.
I can absolutely run models that this site says cannot be run. Shared RAM is a thing - even with limited VRAM, shared RAM can compensate to run larger models. (Slowly, admittedly, but they work.)
- asasidh 2y agoyes I agree that you can run. I have personally run Ollama on a 2020 intel macbook pro. Its not a problem of vibe coding, but of the choice of logic i went with.
- asasidh 2y agothanks for your feedback, there is room to show how fast or slow the model will run. I will try to update the app
- avereveard 2y agoAlso quantization and allocation strategies are a big thing for local usage. 16gb vram don't seem a lot, but you can run recent 32b model in IQ3 with their full 128k context if you allocate the kv matrix on system memory, with 15t/s and a decent prompt processing speed (just above 1000t/s on my hardware)
- lucb1e 2y agoNew word for me: vibe coding > coined the term in February 2025 > Vibe coding is a new coding style [...] A programmer can describe a program in words and get an AI tool to generate working code, without requiring an understanding of the code. [...] [The programmer] surrenders to the "vibes" of the AI [without reading the resulting code.] When errors arise, he simply copies them into the system without further explanation. https://en.wikipedia.org/wiki/Vibe_coding https://en.wikipedia.org/wiki/Vibe_coding
- thaumasiotes 2y agoAusten Allred sold a group of investors on the idea that this was the future of everything. https://www.gauntletai.com/ https://www.gauntletai.com/