Casteil

10 ms·

61.
by Casteil 3y ago
>I predict I will never see 5 guys with lunch boxes and hard hats get out of one I'm sure you will around Boca Chica, but they probably won't have much of a choice either. That said, it could be a pretty good 'proving grou
62.
by Casteil 3y ago
>you are getting health insurance, which has a lot of value. So much 'value' that millions of Americans still end up in medical debt, with many having to resort to medical bankruptcy even as 'insured' individuals. Too
63.
by Casteil 3y ago
100% Real question is whether they'll start making their own 'AmazonBasics' branded AI-generated dogshit, just like they do to undercut/displace successful 3rd party products.
64.
by Casteil 3y ago
Ubiquiti U7 Pro is only around $200 USD.
65.
by Casteil 3y ago
I just use Ollama[1] - makes it incredibly easy to get going on MacOS, and can be run on linux/WSL also. RAM required will depend, but generally to run Mixtral at reasonable quantization levels (e.g. Q4) you're going to want 36GB
66.
by Casteil 3y ago
Ollama[1] + Ollama WebUI[2] is a killer combination for offline/fully local LLMs. Takes all the pain out of getting LLMs going. Both projects are rapidly adding functionality including recent addition of multimodal support. [1] https:
67.
by Casteil 3y ago
Yep. Edited my post to reflect as much. The MBP makes a rather nice portable package though.
68.
by Casteil 3y ago
Nice - that's still pretty solid.. although on a more typical 3060 or 3070 with less vram available, I probably wouldn't expect numbers quite that good. My 14" M1 Max does around 30t/s on Mixtral Q4_K_M.
69.
by Casteil 3y ago
Fair enough. I did put 'ruining' in quotes for a reason - I haven't compared output between Q3 and Q4_K_M that I use, but you do generally sacrifice output quality at higher quantization levels. And you're right, you can
70.
by Casteil 3y ago
Same way you'd bounce an idea or situation off a knowledgable colleague when you're stuck. Concise summary of the problem, the desired outcome, and finish the prompt with something to the tune of '[what are/walk me throu
71.
by Casteil 3y ago
Mixtral 8x7B. Short of that (high ram requirements), I've also found Mistral v0.2 to be pretty solid for a 7b model. YMMV though - it's going to depend on your use cases.
72.
by Casteil 3y ago
I've had excellent results with Mixtral too - it's genuinely impressive. Only problem is that it's a relatively big model that's difficult to run with full GPU inference on consumer hardware (vs the 7b/13b models pe
73.
by Casteil 3y ago
Or try using a local LLM as a rubber ducky - that's been working pretty well for me lately.
74.
by Casteil 3y ago
Same here. Official Mixtral & Mistral (the new v0.2) seem to have the best & most dependable output vs basically all their predecessors/derivatives of equal or smaller parameter sizes. Mixtral is on a whole other level with its
75.
by Casteil 3y ago
How much RAM do you have? Mixtral is a beast and the non quantized model wants 40GB+ of memory.
76.
by Casteil 3y ago
I run 7b/13b models pretty gracefully on a 16GB M1 Pro, but it does leave me wanting a little more headroom for other things like Docker and browser eating multiple gigabytes of ram themselves. Maybe keep an eye out for M1 / M2 de
77.
by Casteil 3y ago
Yeah, it's incredibly invasive. US desperately needs privacy laws governing these mass violations of privacy.
78.
by Casteil 3y ago
Seems like every new update, Edge gets more enabled-by-default 'telemetry' options. Here's one of the latest: >Include related matches in Find on page >When enabled, your Find on page search and the webpage contents wil
79.
by Casteil 3y ago
Perhaps a better title for this article would be: "Business leaders are bringing a whole new vibe to the workplace: anxiety" With the popularity of 'hot desking', overbearing micromanagement, unrealistic expectations, an
80.
by Casteil 3y ago
I don't even want to think about how much time I've wasted mulling over release names.
81.
by Casteil 3y ago
Been using Rectangle pretty much as long as I've had my 14" M1 Pro - excellent FOSS that holds up extremely well against paid alternatives! Little to no customization necessary for a very well-executed window management experience
82.
by Casteil 3y ago
Having come from Notion also, I LOVE Obsidian for its non-proprietary markdown file structure. Incredible powerful plugins, too. FWIW, it's not really what you're seeking... but there is a plugin that allows you to invoke an LLM f
83.
by Casteil 3y ago
Despite its 'anti-fingerprint' anodization, the black still shows smudges more than silver/space gray, fwiw.. do you really need to upgrade a ~2yr old laptop??
84.
by Casteil 3y ago
>How does a three-year-old CPU beat the latest Apple Silicon chip in terms of performance in many popular DAWs? Why do people keep saying the M1 Pro is 3 years old? It came out in October 2021 - it's barely over 2...
85.
by Casteil 3y ago
For GPT4? Sure.. For small LLMs like Llama2 7B/13B and its derivatives? They can be run quite gracefully on Apple Silicon Macs & similarly capable PC hardware.
86.
by Casteil 3y ago
That's not a big problem with the training/fine-tuning you would do when creating specialized 'local' LLM agents.
87.
by Casteil 3y ago
> My dad is restoring a 1969 MG Midget. The right turn signal stopped working. Using nothing more than a voltmeter, I found a disconnected wire and a short to the frame. I replaced the entire length of wire that was failing with $3 worth
88.
by Casteil 3y ago
There's an easier way to get LLMs running with much less hassle if you're on MacOS: Ollama - https://ollama.ai/
89.
by Casteil 3y ago
I've used the 80% max charge setting on a 15 pro since the first week or so. FWIW, it seems Apple has it charge to 100% occasionally (about once a month) even with the setting active. I wish you could have iOS artificially adjust/
90.
by Casteil 3y ago
Single use 'Hail Mary' style rockets

More ›