smcleod

24 ms·

541.
by smcleod 3y ago
While 8GB might be able to run macOS quite quickly for basic tasks, there's no way less than 16GB should ever be an option for people using the modern internet or applications. Given the popularity of bloatware such as Electron, Chrome
542.
by smcleod 3y ago
Sounds like Vlad did a pretty sane, human thing reaching out and offering to discuss. The authors replies seem pretty rude (or at least somewhat aggressive / dismissive). Kagi is Vlads baby and I could imagine he would care and try to
543.
by smcleod 3y ago
Working fine for me and many coworkers here in Australia.
544.
by smcleod 3y ago
Looks nice other than the low resolution screen given it's a 16"
545.
by smcleod 3y ago
This is a great idea. Nice work!
546.
by smcleod 3y ago
That would be really neat. I’d happily leave my server (RTX3090) or MacBook chugging away for a few hours to get the models I’d like on my phone. Thanks for your reply!
547.
by smcleod 3y ago
I'm glad there's a lot of AI/LLM talk - it's rapidly changing our industry and lives like we haven't seen in decades, I want to stay ahead or at least on top of the wave. This is quite different from the empty hype
548.
by smcleod 3y ago
I've been using Private LLM a few weeks now, it's certainly the best of the local options on an iPhone. I'm wondering if you're going to add support for downloading custom models from HF? (e.g. mlx-community models).
549.
by smcleod 3y ago
"I tried it. It was magic. No, seriously. All those things Google couldn't find anymore? Top of the search pile. Queries that generated pages of spam in Google results? Fucking pristine on Kagi – the right answers, over
550.
by smcleod 3y ago
UI does show and let you select the underlying model
551.
by smcleod 3y ago
Yeah I've got to agree with this. Having links to a paper is useful - but not that interesting without a demo and the source code. It's not helped that ArXiV has a pretty horrible interface for anyone other than people writing pap
552.
by smcleod 3y ago
So that would be runnable on a MBP with a M2 Max, but the context window must be quite small, I don’t really find anything under about 4096 that useful
553.
by smcleod 3y ago
What locally hosted (on device, or on local network) LLMs does it support? I can only see mention of using cloud providers.
554.
by smcleod 3y ago
Orbstack is nice to use, but closed source which is a real shame.
555.
by smcleod 3y ago
Yeah $110AUD/year is more than twice what I'd expect to pay.
556.
by smcleod 3y ago
$110 AUD per year is insanely expensive!
557.
by smcleod 3y ago
Looks nice, then I saw the price… wow - that’s a lot of money for a subscription for a single tool.
558.
by smcleod 3y ago
My mental health _massively_ improved since going 100% remote, it's great I have a better work life balance, get more work done, am more social with friends and am able to switch off at the end of the day easier.
559.
by smcleod 3y ago
It wouldn’t be a local model if it has to work on AWS.
560.
by smcleod 3y ago
Maybe give me lots of money to give Nvidia for a card with more memory then? Nvidia have held back the majority of their cards from going over 24GB for years now. It's 2024 and my laptop has 96GB of RAM available to the GPU but desktop
561.
by smcleod 3y ago
If you’re the only person - and it’s just one of your projects - it doesn’t matter. It’s just a problem if you one person in a group of maintainers of shared code. Usually a forum comes with your VCS tooling (GitHub / GitLab etc…) for
562.
by smcleod 3y ago
Yeah I agree with this. You can only do want you can do and what you want to do. If there's more than you can or want to do - either pass it over to someone who wants to do it or don't do it. If people really want something beyond
563.
by smcleod 3y ago
It looks more like a proxy than a studio, unless I’m missing something?
564.
by smcleod 3y ago
The only way to do that I know of is to right click and select 'use prompt' from an image you generated.
565.
by smcleod 3y ago
You're preaching to the choir!
566.
by smcleod 3y ago
Discussing with the maintainers on their discord now :) https://discord.com/channels/1020123559063990373/10201235598...
567.
by smcleod 3y ago
Awesome work! I’d love to see how this could be integrated with existing tools like InvokeAI.
568.
by smcleod 3y ago
Immediately reminded me of Geordi La Forge (vision impaired)
569.
by smcleod 3y ago
200ml/day at $7.47/L AUD you'd really hope it was worth it!
570.
by smcleod 3y ago
Note - requires a Google account to sign up. Odd thing - the only language option for English is American, no standard/international English option?

More ›