jacob019

7 ms·

61.
by jacob019 1y ago
Depends on what you're doing. Too much context and code generation gets sloppy, but it does a decent job attending to the large context to answer questions, analyze control flow, investigate bugs, review style consistency and guidelin
62.
by jacob019 1y ago
Product prices for thousands of listings across various ecommerce channels. Funny you mention keyword bids, I use algorithms and ML models for that, but not LLMs, yet. Keyword bids are a different problem and more difficult in some ways du
63.
by jacob019 1y ago
Claude is great for code, if pricy, but when it gets stuck I break out Gemini 2.5 pro. It's smarter, but wants to rewrite everything to be extremely vebose and defensive, introducing bugs and stupid comments. 2.5 flash is amazing for
64.
by jacob019 1y ago
Love it, I did something very similar, deriving a pydantic model from the function signature. Simpler without the native tool call API, even though occasional retries are required when the response fails to validate. Will have to give Lan
65.
by jacob019 1y ago
Looks great, MCP, supports multiple vector stores, and nice docs! How do you handle to subtle differences in tool call APIs?
66.
by jacob019 1y ago
Generally, I keep the context. If I'm one shotting then I invoke a new agent. All calls and responses append to the agent's chat history. Agent's are relatively short lived, so the context length isn't typically an is
67.
by jacob019 1y ago
Python classes. In my framework agents are class instances and tools are methods. Each agent has it's own internal conversation state. They're composable and the agent has tools for communicating with the other agents.
68.
by jacob019 1y ago
I had not thought about sharing it. I rolled my own framework, even though there are several good choices. I'd have to tidy it up, but would consider it if a few people ask. Shoot me an email, info in my profile. The more difficult
69.
by jacob019 1y ago
It's actually a decent patern for agents. I wrote a pricing system with an anylyst agent, a decision agent, and a review agent. They work together to make decisions that comply with policy. It's funny to watch them chatter someti
70.
by jacob019 1y ago
That's great news! Love Aider too and that's the main thing that's missing right now. Oh the things I will build.
71.
by jacob019 1y ago
The first languge I used to solve real problems was perl, where regex is a first class citizen. In python less so, most of my python scripts don't use it. I love regex but know several developers who avoid it like plague. You don&#x
72.
by jacob019 1y ago
Your understanding is correct. You can use all the cores but it's much slower per thread and existing libraries may need to be reworked. I tried it with PyTorch, it used 10x more CPU to do half the work. I expect these issues to imp
73.
by jacob019 1y ago
This is where they shine, for prototyping greenfield projects, but as the project gets closer to production that 10x erodes. You have to be really intentional about the architecture, fixing core design issues later can turn 10x into 0.1x.
74.
by jacob019 1y ago
It's very fustrating when you end up spending more time tracking down bugs and cleaning up inconsistent code then it would have taken to do it right yourself in the first place. It's an important lesson. That said, there are sti
75.
by jacob019 1y ago
Sure, but that is not what I'm seeing in FastMCP proxy mode, and it can only talk with the parent process. You make a good point though, stdio is similar to tcp sockets and cross-platform without namespace issues, but can only support
76.
by jacob019 1y ago
The consensus around here seems to be that the protocol itself is fine, but the transport is controversial. Personally, even the stdio transport feels suboptimal. I mostly write python and startup time for a new process is nontrivial. Sta
77.
by jacob019 1y ago
Yeah sorry, I misread the title. I used Debian with CUPS on an SBC for something similar, but yours looks way more elegant. This concept is not just for old printers, BTW; a lot of new ones have buggy implementations or can't be trust
78.
by jacob019 1y ago
Selling non-free software under a GNU license != open source. The title will be misleading to most people. Nothing wrong with charging for your software, but you shouldn't call it open source. Edit: Apparently I misread the title.
79.
by jacob019 1y ago
You said in the same sentence that the source is open and not freely available.
80.
by jacob019 1y ago
I got claude to write me an auth layer using only python http.client and cryptography. One shot no problem, now I can get a token from the service key any time, just have to track expiration. Annoying that they don't follow industry
81.
by jacob019 1y ago
Except that the OpenAI compatible endpoint isn't actually compatible. Doesn't support string enum values for function calls and throws a confusing error. Vertex at least has better error messages. My solution, just use text com
82.
by jacob019 1y ago
Because it's easy and cheap. Like how many products use a Raspberry Pi or ESP32 when an ATtiny would do.
83.
by jacob019 1y ago
Indeed. What ever happened to user mode linux?
84.
by jacob019 2y ago
This is great. Is it available as a printed book?
85.
by jacob019 2y ago
Observations and expectations are not prophecy, but thanks for replying to dismiss my thoughts. I've been working on a ML project outside of the LLM domain, and I am blown away by the power of the tooling compared to a few years ago.
86.
by jacob019 2y ago
We are at the precipice of a new era. LLMs are only part of the story. Neural net architecture and tooling has matured to the point where building things like LLMs is possible. LLMs are important and will forever change "the interfa
87.
by jacob019 2y ago
Totally agree. Chat is a fantastic interface because it stays out of my way. For me it's much more than a coding assistant. I get live examples of how to use tools, and help with boilerplate, which is a time saver and improvement ov
88.
by jacob019 2y ago
Hey, I'd love to hear more about dynamic pricing with contextual multi-armed bandits. If you're willing to share your experience, you can find my email on my profile.
89.
by jacob019 2y ago
Interesting how the IPv4 price has pulled back 30% since early 2022.
90.
by jacob019 2y ago
Found the web interface: https://ux.priorlabs.ai/ Really cool! Just playing around with regression mode... A very simple dataset, powers of two: 1:2, 2:4, 3:8, 5:32, 6:64, 7:128 (missing the #4 value) Predict

More ›