sdesol

10 ms·

121.
by sdesol 1y ago
I don't use Cursor so I can't say, but based on what I've read, they optimize for smaller context to reduce cost and probably for performance. The issue is, I think this is severely flawed as LLMs are insanely context sensiti
122.
by sdesol 1y ago
> I really desperately need LLMs to maintain extremely effective context I actually built this. I'm still not ready to say "use the tool yet" but you can learn more about it at https://github.com/gitsense&#
123.
by sdesol 1y ago
Joking aside, I do believe we are moving into a era where we have LLMs write for each other and humans have a dedicated TL;DR. This includes code with a lot of comments or design styles that might seem obvious or stupid but can help anothe
124.
by sdesol 1y ago
> I once again ask Claude Code to fix the bug, this time including the little bit I learned in #3. Claude Code fixes the problem in one round. Context is king, which makes sense since LLM output is based on probability. The more contex
125.
by sdesol 1y ago
I think it is more of, LLMs should be treated as a utility service. Unless Google and others can clearly show the training data involved, the price that providers can charge for LLMs should be capped. I have no issue with contributing my co
126.
by sdesol 1y ago
This reads like it could result in "the blind, leading the blind". Unless the Supervisor AI agents are deterministic, it can still be a crapshoot. Given the resources that SourceGraph has, I'm still surprised they missed the
127.
by sdesol 1y ago
> Have you tried building agents? I think the issue right now is so many people want to believe in the moonshot and are investing heavily in it, when the reality is we should be focusing on the home runs. LLMs are a game changer, but the
128.
by sdesol 1y ago
Nice write up. I don't necessary think it is "if you adopt it, you will flourish" as much as, if you have this type of "personality you will easily become 10x, if you have this type of personality you will become 2x and
129.
by sdesol 1y ago
> I've had it do some huge things that run for an hour or more, Can you clarify this? If I am reading this right, you let the llm think/generate output for an hour? This seems bonkers to me.
130.
by sdesol 1y ago
> This is a huge opportunity, maybe the next big breakthrough in AI when someone figures out how to solve it I am not saying I solved it, but I believe we are going to experience a paradigm shift in how we program and teach and for some,
131.
by sdesol 2y ago
> Why not just put the conversation / prompt at the end of the commit/PR message? This might be something I would do. My only concern is, the conversations can be quite long and mean very long. My "Chat Flow" right n
132.
by sdesol 2y ago
When dealing with prompts, there is no such thing as reproducible builds, since we are dealing with a non-deterministic system. The purpose for connecting prompts and conversation to code is to aid in debugging and developing new features.
133.
by sdesol 2y ago
> All in all, a prompt history would be really edicational if anyone thinks about doing something similar. As we start to develop AI first programs, I believe we will need to start connecting LLM conversations to code, not only for educa
134.
by sdesol 2y ago
I think it being Chinese is part of the reason as some of the examples in the early days were Chinese only, which could deter some people. It is certainly more complex (for a good reason in my opinion), I can see why it is not well known si
135.
by sdesol 2y ago
Full Disclosure: I built an indexing engine for Git and GitHub that can process repos at scale and my words should be taken with scepticism. I think using MCP is an interesting idea, but the heavy lifting that can provide insights, is not w
136.
by sdesol 2y ago
Not really. I had to do the following: - Identify the files that should be put into context since tokens cost money and I wanted to use a model that was capable like Sonnet, which is expensive. - There were 35 messages (minus 2 based on how
137.
by sdesol 2y ago
Full Disclosure: I'm building a LLM chat app for software developers and domain experts > I struggle to find much utility in terms of actually writing code. I personally feel you need to give up some control and just let the LLM do
138.
by sdesol 2y ago
Wouldn't Occam's razor at this point be OpenAI doesn't have a moat and Microsoft knows this?
139.
by sdesol 2y ago
> I'm sorry, we're assholes when it comes to nationalism sometimes Please speak for yourself, as a fellow Canadian. This is not about nationalism, but rather about not giving into a bully. If we start begging for mercy now, t
140.
by sdesol 2y ago
It just feels natural to me. The person knows the language but they are not trying to sound smart by using words that might have more impact "based on the words dictionary definition" GPT 4.5 does feel like it is a step forward i
141.
by sdesol 2y ago
I didn't get the impression that the city was focused on creating housing for Toyota employees; rather, it seemed to be about understanding what will work and what won't. Toyota, like many Asian companies, has many different verti
142.
by sdesol 2y ago
I understand the reasoning and I hope there is legislation in the future that basically goes "If you can't produce the data, you can't charge more than this for it". Basically, LLM producers will have to treat their pro
143.
by sdesol 2y ago
> LLMs will compete with outsourced developers I guess the question is whether the person you are replying to is potentially living in a country where most of the work is currently being outsourced, as this could significantly impact the
144.
by sdesol 2y ago
> It’s AI corporate-speak. It is not meaningful It is if you want to better understand how models are trained and in what directions they are leaning.
145.
by sdesol 2y ago
> post seems to go into all different directions, which seems strange. I asked AI to give feedback on the negative points in the article, with a focus on the human impact. I asked Gemini Flash 2, GPT-4o, Llama 3.3, and DeepSeek v3 and th
146.
by sdesol 2y ago
> The idea of using a smaller version of the same (or a similar) model as a check is interesting. I built my chat app around this idea and to save money. When it comes to coding, I feel Sonnet 3.5 is still the best but I don't start
147.
by sdesol 2y ago
> using LLMs is learning how to manage your context. This is the most important thing in my opinion. This is why I switched to showing tokens in my chat app. https://beta.gitsense.com/?chat=b8c4b221-55e5-4ed6-860e-12f0..
148.
by sdesol 2y ago
> 1. I find a "pair programming" mentality is key. I focus on the high-level code, and let the model focus on the lower level code. I code review all the code, and provide feedback. Blindly accepting the code is a terrible appr
149.
by sdesol 2y ago
Yeah, it almost feels like you are talking to somebody with OCD. The frustrating part is, output tokens are usually a lot more expensive than input tokens, so they are wasting energy and money :-). Also, the more they generate, the greater
150.
by sdesol 2y ago
I guess the question is, did DeepSeek force them to rethink pricing? It's crazy how much cheaper it (v3 and R1) is, but considering they (Deepseek) can't keep up with demand, the price is kind of moot right now. I really do hope

More ›