social_quotient

7 ms·

1.
by social_quotient 4mo ago
Would be curious about the model and the prompt for this. Not kidding at all. I had a similar issue with a project where I needed to classify images into specific demographics, and Gemini, while capable, was entirely not going to do the tas
2.
by social_quotient 10mo ago
Hey your dates are wildly wrong... It’s important people know aider is 2023. 2 years before CC
3.
by social_quotient 11mo ago
I’ve run millions of jobs on MTurk. For a major mall operator in the USA, we had an issue with tenants keeping their store hours in sync between the mall site and their own site. So we deployed MTurk workers in redundant multiples for each
4.
by social_quotient 1y ago
For the oldest… The primary driver for us was realizing that most alternative learning models just don’t align well (maybe id say incompatible) with the structure of college/higher education. Things like homework, progressing through s
5.
by social_quotient 1y ago
There is an internal financial aid. I don’t know the qualifications for it but I know it’s used extensively. What’s wild.. at Alpha. Money is no issue or object of discussion other than my oldest coming home with 2k on a Venmo for scoring 1
6.
by social_quotient 1y ago
So here’s part of the trade-off to consider: (great questions and thinking btw you’d be surprised by the number of people that treat education as day care… even at a 40k per year school) The program is heavily STEM-focused. While my kids pe
7.
by social_quotient 1y ago
A couple of thoughts based on my own experience, as both of my girls attended Alpha for 4 and 5 years. First, not all the students come from wealthy backgrounds, which is a common assumption. Second, while the school emphasizes 2-3 hours of
8.
by social_quotient 1y ago
I’m reminded of this story https://terminalbytes.com/iphone-8-solar-powered-vision-ocr-... 83,418 OCR requests processed over more than a year of operation Up to 1,000+ requests on busy days If you forget about the million
9.
by social_quotient 1y ago
Exactly! You can use tools like https://github.com/musistudio/claude-code-router which let you use other LLMs. The way I would use this $50 Cerebras offering is as a delegate for some high token count items like docume
10.
by social_quotient 1y ago
Unrelated, but this reminds me of a persistent headache on Windows. My screensaver refuses to kick in, no matter what. After tumbling down a rabbit hole longer than I’d care to admit, it’s clear I’m not alone… tons of apps and processes hij
11.
by social_quotient 1y ago
Yeah I get that, I’m not “stuck” it’s that I don’t think the comms make sense and it’s troubling none of these teams have figured out a pricing model that isn’t a rug pull. If all of these ai llm coders were priced right, they would be out
12.
by social_quotient 1y ago
I love Claude Code, but Anthropic’s recent messaging is all over the map. 1- “More throughput” on the API, but stealth caps in the UI - On Jun 19 Anthropic told devs the API now supports higher per-minute throughput and larger batch sizes,
13.
by social_quotient 1y ago
Runpod is worth a look for these on demand workloads https://www.runpod.io/pricing I use a lot for ffmpeg workloads. Found this a few days ago which might be neat for finding cheaper https://www.primeintellect.ai
14.
by social_quotient 2y ago
Yeah, I think a couple of points here: 1. Inference time is not training anything. The AI model has been baked and shipped. We are just using it. 2. I’m not sure “gaslight” is the right term. But if users are somehow getting an output that
15.
by social_quotient 2y ago
I should note, some of this falls apart in the new multi modal world we are now in , where you could ask the llm to print the secrets in an image/video/audio. My similarity search model would fail miserably without also adding mor
16.
by social_quotient 2y ago
I have not found a way yet, even conceptually, and in our case the extra layer comes at a cost to the ux. To overcome some of this we use https://sdk.vercel.ai/docs/reference/ai-sdk-core/simulate-re... To
17.
by social_quotient 2y ago
I think you’re spot on! We’re using a similar trick in our system to keep sensitive info from leaking… specifically, to stop our system prompt from leaking. We take the LLM’s output and run it through a RAG search, similarity search it agai
18.
by social_quotient 2y ago
I spend a ton of time in FFmpeg, and I’m still blown away by how it uses abstractions to stay modular—especially for a project that’s been around forever and still feels so relevant. Those filtergraphs pulling off polymorphism-like tricks i
19.
by social_quotient 2y ago
Cool comment, got me thinking a bit and I’d like clarity if you don’t mind. Sorting in a GET request param doesn't alter the server's state. It only changes the data representation, not the underlying resources. This fits "sa
20.
by social_quotient 2y ago
Concat to a file but it helps to make an ascii tree at the top and then for each merged file out its path and orientation details. I’ve also started playing with adding line ranges to the ascii tree hoping that the LLMs (more specifically t
21.
by social_quotient 2y ago
I found myself thinking about Cloudflare Durable objects new SQLite offering. Nicely detailed here https://simonwillison.net/2024/Oct/13/zero-latency-sqlite-st... And https://developers.cloudflar
22.
by social_quotient 2y ago
Good job on the launch and the write up. I'll be interested to play with this api. I'm glad to see the ttft talked about here. As someone who's been deep in the AI and generative AI trenches, I think latency is going to be th
23.
by social_quotient 2y ago
Would love if you could de identify and share a bit more detail on a prompt that big.
24.
by social_quotient 2y ago
I’d be curious if people really ever switch from ffmpeg and if yes, what to?
25.
by social_quotient 2y ago
With query expansion do you find it needed for ux purposes to tell the user what you have done to their original query? or do you just run with it and let the result interactions speak for themselves?
26.
by social_quotient 2y ago
Suppose I have a conversation with ChatGPT about a macro, or better yet, a series of macros. We reach the 10th sub-module, but suddenly, I find a bug in module 2 (20 minutes ago chat). While I could redirect the chat back to module 2, it&#x
27.
by social_quotient 2y ago
Is it a “document” if it has animations and non static (video) media?
28.
by social_quotient 2y ago
Super curious what data this is, can you share a bit more of your use case for this much vector data?
29.
by social_quotient 3y ago
Contextual bandits are algorithms that decide which action to take (like displaying ads or recommending products) based on the current situation (context) to maximize rewards (clicks, sales). They learn over time what works best in each con
30.
by social_quotient 3y ago
Would have been a good trade - https://x.com/unusual_whales/status/1754572604097409137?s=46...

More ›