lukewarm707

11 ms·

211.
by lukewarm707 7mo ago
local is best for privacy, but i personally think you don't need to go local. anthropic, google, openai etc, decided that their consumer ai plans would not be private. partly to collect training data, the other half to employ moderator
212.
by lukewarm707 7mo ago
this is the most honest argument for it. i respect that. my impression is that if open models did 'distill' claude they made some interesting and productive ideas, like deepseek's more efficient attention
213.
by lukewarm707 7mo ago
from a philosophy grad. both these responses are logical fallacies. 1: it's bad, but so is everything else (ad populum, everyone does it so it's ok). 2: it can only be because the author has a personality disorder or psychotic bre
214.
by lukewarm707 7mo ago
it is better for security when code is simple. i tried using litellm and it was 700mb! it does have a lot of features. postgres db, prometheus, api layer. really complicated. but simple help is missing. it assumes you will put passwords in
215.
by lukewarm707 7mo ago
claude, please review this source repo and make a new app called 'not-claude-code'
216.
by lukewarm707 7mo ago
anthropic argue that you should not use claude API to train your model Situation A - Anthropic pays for a book - Anthropic transform the book into a new llm (transformative use) -> OK Situation B - I pay for Anthropic API - I transform A
217.
by lukewarm707 7mo ago
on fireworks, log in and go to the dashboard, then the subscription is available under "fire pass" (above the model library). the underlying compute is fireworks and is ZDR. other cloud providers, kind of depends on the use case.
218.
by lukewarm707 7mo ago
I use llms to read the privacy policies that are too long to read. They guarantee almost nothing, unless you go out of your way to get an sla
219.
by lukewarm707 7mo ago
API: fireworks Fast: inception labs or cerebras Confidential: tinfoil.sh, phala TTS/STT: groq Routers: vercel (or openrouter if they don't have the model). Search: unsolved, just can't get zdr, local hosted.
220.
by lukewarm707 7mo ago
i think that privacy is good for wellbeing. it may be this is a dying point of view.
221.
by lukewarm707 7mo ago
i don't use local llms. it's mostly the closed source subscriptions that are not private, it really is a choice. there are many cloud providers of zero data retention llm APIs, and even cryptographic attestation. they are not thro
222.
by lukewarm707 7mo ago
i don't use local models, i just use the APIs of cloud providers (eg fireworks, together, friendli, novita, even cerebras or groq). you can get subscriptions to use the APIs, from synthetic, or ollama, fireworks.
223.
by lukewarm707 7mo ago
i would recommend getting an API account on fireworks, this is ZDR and typically the fastest provider. otherwise check the list of providers on openrouter and you can see the pricing, quantisation, sign up directly rather than via a router.
224.
by lukewarm707 7mo ago
please tell me if i'm crazy. i just refuse to use openai/google/anthropic subscriptions, i only use open source models with ZDR tokens. - i like privacy in my work, and i share when i wish. somehow we accepted that our prompt
225.
by lukewarm707 7mo ago
i am rolling back a huge number of 'features' in my personal pc and going back to extremely miminal setups the security solution i have is where it needs to become more simple, getting rid of attack surface that is coming out of t
226.
by lukewarm707 7mo ago
there are tools already like trufflehog that will find leaked secrets macos still ships with live github private keys in the library folder oops i put my god level aws key in js on my website oops i put the supabase key in frontend oh no! i
227.
by lukewarm707 7mo ago
closed source software deliberate vulnerabilities (thanks nsa)
228.
by lukewarm707 7mo ago
is this bad?
229.
by lukewarm707 7mo ago
sometimes when there is mafia you get no option but pay pizzo hence i am just using cloudflare remote browser rendering.
230.
by lukewarm707 7mo ago
i am increasingly moving towards a model of 'no browser'. search for me is now a proprietary index (like exa) that filters rubbish, with a zero data retention sla. so we don't need google profiling. the content is distilled i
231.
by lukewarm707 7mo ago
even open source is not that trustworthy. there are several corpo open source ai apps that have rce built in. to cut a long story short they pull their config from the developer's server on startup. that config has user level permissio
232.
by lukewarm707 7mo ago
there is no browser in the app.
233.
by lukewarm707 7mo ago
i downloaded the app but it doesn't let you use the browser. i thought it was the white house doing something helpful for once and giving us some internet freedom. alas.
234.
by lukewarm707 7mo ago
if custody is with the customer.....why does palantir have compute pricing..... hmmmmmm
235.
by lukewarm707 7mo ago
onyx is good for this, it is standard doc ingestion -> chunk -> embedding -> index -> query -> rerank -> answer. there are a few other local apps with simple knowledge base type things you can use with pdfs. cherry studio
236.
by lukewarm707 7mo ago
9tb should be fine for vectordb, for sure. google search is many petabytes of index with vector+semantic search, that is using ScaNN. you could probably use the hybrid search in llamaindex; or elasticsearch. there is an off the shelf discov
237.
by lukewarm707 7mo ago
these days, i just use a private llm. it's very quick and when i see the logs, it does a better job than me for this type of task. no i don't let it connect to web...
238.
by lukewarm707 7mo ago
i ran it through mitmproxy, i am using pinned version 1.2.20, 6 march 2026, set up with local chat completions. on that version, it does not fall back to the main model. it silently calls opencode zen and uses gpt-5-nano, which is listed as