smcleod

28 ms·

361.
by smcleod 2y ago
Glassdoor is very problematic. They pull negative reviews all the time and tend to side with employers on almost all feedback disputes.
362.
by smcleod 2y ago
It's a shame to see they max out at just 32GB, for that price in 2025 you'd be hoping for a lot more, especially with Apple Silicon - while not nearly as fast - being very usable with 128GB+ for LLMs for $6-7k USD (comes with a fr
363.
by smcleod 2y ago
Is the source code available for inspection somewhere? It's not really clear from the landing page.
364.
by smcleod 2y ago
Absolutely not $15k, you can go and buy a 2 year old MacBook with 96GB of unified memory (around 85GB usable for the GPU) for a few thousand USD, or a brand new 128GB version for $4500 USD~, or grab 4x 24GB GPUs second hand etc... I persona
365.
by smcleod 2y ago
It's definitely usable past 48GB, I have a 96GB M2 Max and regularly run models that use around 70GB that are very usable. I also have a home server with 2x3090 and 2xA4000 (80GB vRAM) - yes it's a lot faster, but it's a pain
366.
by smcleod 2y ago
I see the release is a "CRX" file, which doesn't seem to work with Firefox - are you planning a Firefox compatible release?
367.
by smcleod 2y ago
Good video I watched recently on how the Honey scam works: https://www.youtube.com/watch?v=vc4yL3YTwWk *Edit: Oh I see you mention it in the video on your project! Nice work.
368.
by smcleod 2y ago
They opened the standalone unit, assuming this will be also?
369.
by smcleod 2y ago
I have the standalone unit and other than the painfully slow 100mbit Ethernet that's too slow to upload ISOs and which also doesn't work with many modern switches - it's really nice for the price. The problem with a pcie one
370.
by smcleod 2y ago
Weird that it disables the use of right click, paste and seemingly your password manager when trying to login to services via the app.
371.
by smcleod 2y ago
I honestly have no idea why anyone still uses Conda, it's a right pain in the ass. Python package management in general is a nightmare, but whenever I run up a project that uses Conda I immediately disregard it and use uv / pyenv.
372.
by smcleod 2y ago
Neat! I was looking for something like this the other day. Some feedback on the Dockerfiles - I'd recommend instead of trying to mount in the source code as volumes, clone the repo in the Docker build process. That will be a lot more r
373.
by smcleod 2y ago
I'm seeing a lot of these pop up at the moment - but that's a good thing. Some feedback: - Tables are not rendered properly, it places cells on new lines without clear relationships. - There needs to be a "concatenate and dow
374.
by smcleod 2y ago
I once met with NEC who was wanted to hire some consultants to help them on your cloud journey. They wanted to become a cloud managed services and hosting provider - but had never done anything in 'cloud' before, this seemed odd t
375.
by smcleod 2y ago
I hear how deeply frustrating and personally challenging this situation is for you. It's particularly difficult when you have the skills and vision to see how things could be better, but are met with resistance and even retaliation. Th
376.
by smcleod 2y ago
How on earth do you end up with >2400 phone providers in the first place? There must be a lot of profit being made off people?
377.
by smcleod 2y ago
I wrote a tool some time ago called ingest ... to do exactly this from both local directories, files, web urls etc... as well as estimating tokens and vram usage: https://github.com/sammcj/ingest
378.
by smcleod 2y ago
Today I ran some perplexity benchmarks comparing F16 and Q8_0 for the K/V, I used Qwen 2.5 Coder 7b as I've heard people say things to the effect of Qwen being more sensitive to quantisation than some other models. Well, it turns
379.
by smcleod 2y ago
Im not sure what kind of vendetta you have against Ollama but I'll paste you here what I've written before when I've heard claims similar to Ollama is just a wrapper for llama.cpp: With llama.cpp running on a machine, how do
380.
by smcleod 2y ago
I'm going to be generous here and assume you didn't bother to actually read the post (or even the PR) before writing a snaky, non-constructive comment, but skimming through your HN comment history this appears to be on-brand.
381.
by smcleod 2y ago
> this reads as a hobbyist and fan of AI dev that is writing about their work Bingo, that's me! I suspect the OP didn't actually read the post. 1. As you pointed out, it's about getting the feature working, enabled and con
382.
by smcleod 2y ago
I personally use a mix of Open WebUI, Big AGI, BoltAI, AnythingLLM on the desktop. The mobile space is where things are really lacking at the moment, really I just end up browsing to Open WebUI but that's not ideal. I'd love a iOS
383.
by smcleod 2y ago
Shout out to everyone from Ollama and the wider community that helped with the reviews, feedback and assistance along the way. It's great to contribute to such a fantastic project.
384.
by smcleod 2y ago
Opened this site to find the readable text was squashed into the middle maybe 10% of my screen, as much as markdown can be annoying - websites that refuse to use a reasonable portion of the browser width for readable content annoying me far
385.
by smcleod 2y ago
Gaming sure, but not for GPU compute
386.
by smcleod 2y ago
As someone else said - I don't think you have to have GDDR, surely there are other options. Apple does a great job of it on their APUs with up to 192GB, even an old AMD Threadripper chip can do quite well with its DDR4/5 performan
387.
by smcleod 2y ago
12GB of vRAM? What a wasted opportunity.
388.
by smcleod 2y ago
Yes, but that's not building it for your system, that's a relatively generic build.
389.
by smcleod 2y ago
I mean.... is Debian just a libc6 wrapper? Is Firefox just a JavaScript wrapper? Given Ollama currently has llama.cpp, mllama and safetensors backends, there's far more Ollama code and functionality than code that calls llama.cpp
390.
by smcleod 2y ago
Somewhat related - on several occasions I've come across the claim that _"Ollama is just a llama.cpp wrapper"_, which is inaccurate and completely misses the point. I am sharing my response here to avoid repeating myself repe

More ›