monkmartinez

11 ms·

61.
by monkmartinez 2y ago
Not much? I mean, I set it up initially to use as an LLM search tool for agents. That required me to use a specific version of SearXNG due to a JSON bug. My exact docker command is here: docker run -d -p 9017:8080 --name searxng_data
62.
by monkmartinez 2y ago
Because I can configure exactly which search engines to index, no ads, use it for my local LLM's for search, better image search (maybe not better, but totally different results), a bazzillion tweaks and mods. I don't have to pay
63.
by monkmartinez 2y ago
I don't have ads on my SearXNG instance and I find that its comparable to Kagi. Have you tried searching with SearXNG?
64.
by monkmartinez 2y ago
I am 100% in agreement, between SearXNG and Google I can find darn near anything. Kagi was ok, it seems to really prefer reddit for the types of things I was searching for. I was also super conscious about the number of searches I had left
65.
by monkmartinez 2y ago
Memory. I don't know the equation, but its very easy to see when you load a 128k context model at 8K vs 80K. The quant I am running would double VRAM requirements when loading 80K.
66.
by monkmartinez 2y ago
You could buy access. Buy yourself into a chamber of commerce where you want to live starting with a small business in the area. Keep it small and look for businesses where the subject of the business itself, is interesting to you. Expand f
67.
by monkmartinez 2y ago
That is a fascinating take and approach to contemplating a language. Can you think of any other languages that share a duality like Swift? I mainly play in the python ecosystem, but I am looking to branch out and really learn a compiled lan
68.
by monkmartinez 2y ago
Correct! Arizona is dropping the hammer on a bunch of alfalfa farms here. Interesting side note is that most of them were run and owned by Saudi companies or company. There are markedly less cotton farms than when I was a kid. The farms tha
69.
by monkmartinez 2y ago
How hard would it be to move to 3nm or 2nm in Arizona if something happened in Taiwan? Genuine question because I don't know much about these plants.
70.
by monkmartinez 2y ago
I have heard the water needs are massive, but the reclamation tech is mind blowing. I haven't dug into it. It is hot here in Arizona, but its generally a dry heat. We have humidity in 15% range for most of the year. Our winters are ver
71.
by monkmartinez 2y ago
Exciting times! As a resident of Arizona, it is great to see these plants being built here. The intel plant is absolutely massive and the plant I see most often. The TSMC plant is very north of my location and I've only seen it once. I
72.
by monkmartinez 2y ago
I hope you are not a sole, and have the complete human embodiment of a soul. Otherwise, yes, I agree. My one off projects use more and more cdn loaded information. I love pico, bulma and htmx.
73.
by monkmartinez 2y ago
Openrouter... you get all the models and its not as expensive as you would think. I spent $3 with aider the other day in like the blink of an eye with Anthropic. I am working on a FASTHTML thingy and loaded all the docs, plus a few huge rep
74.
by monkmartinez 2y ago
Which would make the cost of each mirror higher, right? Additional processing will naturally increase the cost per unit. By the way, super cool project and thank you for sharing. My experiments with concentrating sun power when I was a chil
75.
by monkmartinez 2y ago
TFA didn't address the one thing that, in my experience, has been the raison d'être (at least in my city) for large employers to generate lots of emergency medical calls. SICK LEAVE POLICY We get a ton of calls to certain call cen
76.
by monkmartinez 2y ago
Thank you for using discourse! It is sooooo much better than discord. I really, really can't stand discord. Searching for an issue or topic is like wading into the ocean looking for a bluegill.
77.
by monkmartinez 2y ago
You can't. Sorry. Unless... You have a couple hundred $k sitting around collecting dust... then all you need is a DGX or HGX level of vRAM, the power to run it, the power to keep it cool, and place for it to sit.
78.
by monkmartinez 2y ago
Why are (some) Europeans surprised when they are not included in tech product débuts? My lay understanding could best be described as; EU law is incredibly business unfriendly and takes a heroic effort in time and money to implement the myr
79.
by monkmartinez 2y ago
I chart codes on my EPCR, in the PT's house, almost everyday with one hand. Not joking about the one hand either. Its easier, faster, and more accurate than writing in my experience. We have a page solely dedicated to codes and the mos
80.
by monkmartinez 2y ago
This borked our dispatch/911 call center then as well. However, it wasn't as bad as this one. This outage put our entire public safety system into the stone age and with that we were at stone age efficiency.
81.
by monkmartinez 2y ago
Just completed a standing 24 due to this outage. My B-Shift brothers and sisters had to monitor the radios all night for their units to be called for emergencies. I heard every dispatch that went out. We were back in the 1960's with pa
82.
by monkmartinez 2y ago
You need to document everything during a code arrest. All interventions, vitals and other pertinent information must be logged for various reasons. Paper and pen work but they are very difficult to audit and/or keep track of. Electroni
83.
by monkmartinez 2y ago
We took 911 calls all night, I was up listening to the radio all night for my unit to be called. The problem was the dispatching software didn't work so we used paper and pen. Glory Days!!!!
84.
by monkmartinez 2y ago
You are right of course.... IF your metric for manageable/useable is measured only tokens per second (tok/s). If your metric is quality of output, time, money and tok/s, there is no comparison; Local models just aren't t
85.
by monkmartinez 2y ago
Yes, I am with you 100% and keep several LLaMA's on my workstation for that reason. I use Openrouter for everything else. Everything that isn't sensitive goes to one of the big kid models because they are just sooooo much better.
86.
by monkmartinez 2y ago
llama3 at 8billion params is weak sauce for anything serious, it just isn't in the same galaxy as Sonnet 3.5 or GPT-4o. The smaller and faster models like Phi are even worse. Once you progress past asking trivial questions to a point w
87.
by monkmartinez 2y ago
We don't have any more ability to test a CO detector than you! Replace the batteries, press the test button and/or buy a new unit if the old one fails. Please don't call 911 unless you have an actual emergency.
88.
by monkmartinez 2y ago
Nothing is fair. I try to impart this lesson with my children everyday. They see it, viscerally, when they go visit their grandparents in Colombia. There are really poor people in this world who never had a chance. You have a chance and hav
89.
by monkmartinez 2y ago
Let me ask you a question; Why doesn't Singapore deal with this type of crime? We, as a society, have stopped demanding people to take responsibility for themselves. We don't hold anyone accountable for their actions. We ostracize
90.
by monkmartinez 2y ago
> People live in poverty without being an addict Please let me know where these people are! I have been riding the streets for 18 years in a city with over 1 million (Top 100 by population in the US) and I haven't met an actual impo

More ›