Art9681

17 ms·

211.
by Art9681 3y ago
Just like a competent developer can use LLMs to bootstrap workflows, a competent model will soon have tools like this as part of their normal workflow. A casual user would be able to do things that they otherwise wouldnt have been able to.
212.
by Art9681 3y ago
The code repo literally still has default templates: https://github.com/cap-so/cap/tree/main/apps/desktop From what I can tell, the developer woke up today and decided creating the marketing materia
213.
by Art9681 3y ago
A car that cheap will nickle and dime you until you've spend 5x its initial price. If you dont get lucky and it dies on you before your money was better spent by car mechanics.
214.
by Art9681 3y ago
$4k is a little or a lot depending on your circumstance. Assume three individuals that make the same income. - One of them supports a family of 3 on one income. - One of them is single and supports only themselves. - One of them is married
215.
by Art9681 3y ago
Because the laptop can also be a desktop when hooked up to a big screen and accessories. But a desktop wont ever be a laptop.
216.
by Art9681 3y ago
This is a hard down. Even the API calls wont go through. I am not getting alerts for their service status either. I've never seen it this bad. I guess this is what happens when your SRE team is in limbo due to company politics. EDIT: D
217.
by Art9681 3y ago
This is the correct answer. I have 23 years of experience in datacenter ops and it has been a game changer for me. Just like any tool on one's arsenal, it's utility increases with practice and learning to use it correctly. ChatGPT
218.
by Art9681 3y ago
Go is so deeply embedded in Cloud computing that if it were abandoned it would break the internet. Some of the most critical systems are built with it. If it’s good enough for Kubernetes then it’s good enough for any business.
219.
by Art9681 3y ago
I'd consider leaving my SRE position to help them out. I refuse to move to SF though. Call me OAI!
220.
by Art9681 3y ago
This is a dizzying amount of awesome information and im not sure what to make of it. I've been in enough rabbit holes lately. Where are the Golang examples I can go reference? Id be interested in testing this out for my Go experiments.
221.
by Art9681 3y ago
Mlock is an optional parameter: github.com/ggerganov/llama.cpp/tree/master/examples/main#mlock
222.
by Art9681 3y ago
Seems like they need to adapt the level of difficulty to the new world of developer tooling. An AI may be able to write a starter template and used wisely can move the project forward, but it still requires knowledge and expertize to build
223.
by Art9681 3y ago
There is none. No one understands what intelligence really means or self-awareness. Which is why they feel threatened by anything that challenges their self proclaimed uniquely human trait. The goal posts WILL move a lot more before this de
224.
by Art9681 3y ago
People who are having trouble getting good results from LLMs are still trying to figure them out. Most folks are using the product and not the model. Where it really shines is when you use the API and build a platform of workflows around it
225.
by Art9681 3y ago
If this were true we'd all be screwed with the things we're exposed to on the internet and just popular media in general. Video games, books, music, movies, the list goes on.
226.
by Art9681 3y ago
What is the best model that would run on a 64GB M2 Max? I'm interested in attempting 70B model but not gimped to 2bit if I can avoid it. Would I bet able to run 4bit 70B?
227.
by Art9681 3y ago
The real test is when this stuff is out in the wild and no one tells you it’s AI and the thought doesn’t cross your mind. Of course it’s not impressive nor surprising when the answer was given up front.
228.
by Art9681 3y ago
You are forgetting that as the tooling gets better and the capability of individuals increases, so too does the capability of a group of individuals working together, using the same tools you would be. You are still not going to match the l
229.
by Art9681 3y ago
At this point I would pay those people to stop making videos and start writing again. Sitting through a 15 minute video to explain something that can be read in 2 minutes is a waste of everyone's time.
230.
by Art9681 3y ago
Increased output leads to increased demand. If last week I could pump out 3 solid PRs that fixed issues in our product, then it will be expected that I pump out 20 PRs using AI in a week. Information Engineers are going to be in more demand
231.
by Art9681 3y ago
Didn't skilled workers become that way by being proactive about their knowledge? Managers need to manage and lead, period. In the startup world I see time and time again management defering their job to the engineers. These managers on
232.
by Art9681 3y ago
Behavior is different at different scales but I see your point. I typically walk to my car after an event, but if I see a group take off running with urgency I will probably do the same thing. Know what I mean?
233.
by Art9681 3y ago
That's because QEMU can do hardware acceleration in an x86 host but not in M architecture. But as far as I know, only the Apple framework can do hardware acceleration or use Rosetta 2 to make things near native speed on an M-series Mac
234.
by Art9681 3y ago
Its using this: https://developer.apple.com/documentation/virtualization
235.
by Art9681 3y ago
It's using Apple Virtualization Framework + Rosetta acceleration instead of third party hypervisor like QEMU. There are ways to do this via the CLI with a simple one line command if you have Xcode installed.
236.
by Art9681 3y ago
If its hardware accelerated the performance difference would likely not matter. And you're not going to deploy a high performance container on a desktop environment since edit:[the desktop] will consume a much greater deal of resources
237.
by Art9681 3y ago
Containers on anything other than Linux run in a Virtual Machine. Depending on the platform, you may or may not have hardware acceleration. It's either using the software emulator (slow) or hardware acceleration. On the new M architect
238.
by Art9681 3y ago
I think the intent of the question was not to discourage people from doing something that has been done. That's how we all learn. The question is what makes this different than the 5 other OpenAI API frontends released in the past 3 da
239.
by Art9681 3y ago
https://www.reddit.com/r/LocalLLaMA/ https://github.com/topics/artificial-intelligence https://github.com/topics/llm
240.
by Art9681 3y ago
Very nice. Although I wonder how this is sustainable as a business when it seems like every day someone is releasing a frontend over LangChain/GPT for free. This week alone I think one collected at least 5 open source projects that can

More ›