sdesol

20 ms·

271.
by sdesol 2y ago
With humans we have a decent understanding of what they are capable of. I trust a medical professional to provide me with medical advice and an engineer to provide me with engineering advice. With LLM, it can be unpredictable at times, and
272.
by sdesol 2y ago
As mentioned earlier, unless you have a 6th sense for what is wrong, you won't know. If the message was "make sure to double check our response" then they get a pass, but they know people will just say "why shouldn'
273.
by sdesol 2y ago
Hey thanks! The error is in the config file. Will fix this.
274.
by sdesol 2y ago
Yes this is a tokenization error. If you rewrite the sentence as shown below: https://app.gitsense.com/?doc=905f4a9af74c25f&model=Claude+3... Claude 3.5 Sonnet will now misinterpret "GitHub as "Github"
275.
by sdesol 2y ago
> While LLMs do plenty of awful things, people make the most incredibly stupid mistakes too I am 100% not blaming the LLM, but rather VCs and the media for believing the VCs. Once we get over the hype and people realize there isn't
276.
by sdesol 2y ago
My reason for commenting wasn't to say LLM sucks, but rather we need to get over the honeymoon phase. The fact the GPT-4o (one of the most advanced, if not the most advanced when it comes to non programming tasks) hallucinated "G
277.
by sdesol 2y ago
In the process of developing my tool, there are only 5 models (the first 5 in my models dropdown list) that I would use as a writing aide. If you used any other model, it really is a crapshoot with how bad they can be.
278.
by sdesol 2y ago
> "let's only allow the LLM to do things we know it is rock-solid at." Even this is insanely hard in my opinion. The one thing that you would assume LLM to excel at is spelling and grammar checking for the English languag
279.
by sdesol 2y ago
If the P is silent, how can you "Prompt"?
280.
by sdesol 2y ago
I have no doubt the author of the press release used LLM to help them, but I'm not convinced that this was fully generated by AI. Since you got me thinking about this more, I decided to run the sentence across my tool with a new prompt
281.
by sdesol 2y ago
I messed up and didn't really analyze the paper but the article. Since I can't edit, here is the introduction to the paper: https://app.gitsense.com/?doc=696357b733b which contains enough grammatical errors that
282.
by sdesol 2y ago
I ran this across my AI spelling and Grammar checker at https://app.gitsense.com/?doc=4715cf6d95689&other-models=Cla... Note, sentences highlighted in yellow means one or more models disagree. The sentence that makes me
283.
by sdesol 2y ago
> Ok so just to be clear, that's an entirely different and unrelated argument from the one I responded to. It honestly made no sense what you were saying so I didn't respond to that directly as I assumed it would be clear from
284.
by sdesol 2y ago
> But the idea of letting an LLM write/move large swaths of code seems so incredibly irresponsible. I do think it is kind of crazy based on what I've seen. I'm convinced LLM is a game changer but I couldn't believe ho
285.
by sdesol 2y ago
Animals are capable of learning. LLMs can not. LLM uses weights that are defined during the training process to decide what to do next. LLM cannot self evaluate based on what it has said. You have to create a new message for it to create a
286.
by sdesol 2y ago
> Most people recognize that LLM's are not currently super intelligent, I think calling it intelligent is being extremely generous. Take a look at the following example which is a spelling and grammar checker that I wrote: https:&#
287.
by sdesol 2y ago
> style does not scale to real software scales I think those that dismiss AI completely will fall behind, and those that turn it into a crutch will pay for it in the years to come. I truly believe AI is game changing, as I used it to cr
288.
by sdesol 2y ago
And remember to always challenge the response with both the same and different models. No joke. Just continue the conversation for the example in the blog and ask the LLM "Do you see anything wrong with the code?" and it will spit
289.
by sdesol 2y ago
I would have to imagine 90+ percent of people use LLM and AI to outsource their thought and most will not heed this warning. OpenAI might say "Check important info." but they know most people probably won't do a google searc
290.
by sdesol 2y ago
You do have to admit, the footer is extremely small and it's also not in the most prominent place. I think most "AI companies" probably don't go into a sales pitch saying "It's awesome, but it might be full of
291.
by sdesol 2y ago
> 100% agree. We don't expect human developers to be perfect, why should we expect AI assistants. I think the issue is that we are currently being sold that it is. I'm blown away by how useful AI is, and how stupid it can be at
292.
by sdesol 2y ago
> I can't imagine people actually typing code by hand anymore by that time. I can 100% imagine this. What I suspect developers will do in the future is become more proficient at deciding when to type code and when to type a prompt.
293.
by sdesol 2y ago
This will only work if they can ensure the product that they promote is, in fact, good. Google makes it very clear that what you are seeing is popular (or is a paid ad), but they don't endorse it. ChatGPT is seen as an assistant for m
294.
by sdesol 2y ago
> Tough to tell, given nobody is turning a net profit on LLMs yet. I suspect in the case of Meta and other big players, profit isn't necessary required to bring substantial value. Imagine their model being able to help them moderat
295.
by sdesol 2y ago
> Subsidizing open-source projects is ultimately a marketing spend They say 2M in Vercel credits. How much is that in actual money?
296.
by sdesol 2y ago
I've built a code search engine in the past so I know how painful debugging long indexing jobs can be and I would certainly be reluctant to support private repos until I know I can index thousands if not tens of thousands of open sourc
297.
by sdesol 2y ago
> then realize that you yourself don't have a perfect idea of what exactly this feature should be I talked about it the last time that Copilot Workspaces reached the front page two days ago and that was, I don't think the value
298.
by sdesol 2y ago
I do think workspace by GitHub is a smart move. What is clear as day is, we don't have enough data to model how developers think and iterate to solve problems. With workspace, I see it as a way to capture structured data on how devel
299.
by sdesol 2y ago
Interesting. I don't think the AI code generation will live up to developer expectations, but I do see the value in "project management for developers". The value I see with workspace is not the code generation, but the abili
300.
by sdesol 2y ago
Can you share some of your prompts that you have used?

More ›