4 ms·
Does your work not depend on existing code bases, product architectures and nontrivial domain contexts the LLM knows nothing about? Every thread like this over
by layer8 2y ago
Does your work not depend on existing code bases, product architectures and nontrivial domain contexts the LLM knows nothing about?
Every thread like this over the past year or so has had comments similar to yours, and it always remains quite vague, or when examples are given, it’s about self-contained tasks that require little contextual knowledge and are confined to widely publicly-documented technologies.
What exactly floored your colleague at Microsoft?
- fuzztester 2y ago[flagged]
- fuzztester 2y agoEven more negativity towards this comment of mine, than to some of my other ones, as shown by the greater downvotes. Jeepers creepers! :)
- AdieuToLogic 2y agoComments should get more thoughtful and substantive, not less, as a topic gets more divisive. Eschew flamebait. Avoid generic tangents. Omit internet tropes. Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes. Please don't comment about the voting on comments. It never does any good, and it makes boring reading. source: https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html HTH
- andrewflnr 2y agoNot-so-subtly mocking the top-level for not replying "yet", when they replied almost immediately after with a video of the relevant workflow, was not a move that made you look smart or nice.
- fuzztester 2y agoHey. These are the four simple lines that I wrote above: >Solid questions and comments, layer8. >I notice that the person you replied to has not replied to you yet. >It may be that they will, of course. >But your points are good. (Italics mine, and they were not in my original comment.) You, above: >when they replied almost immediately after with a video of the relevant workflow, I did check the time intervals between the top level comment and layer8's comment, before my first reply. It is over an hour now, so I cannot see the exact times in minutes any more, but IIRC, there was a fairly long gap (in minutes). And I also think I noticed that the top level person did reply to someone else, but not to layer8, by the time I wrote my comment. So I don't see anything wrong in what I said. I even said that they may reply later. You consider that to be: >"Not-so-subtly mocking"? Jeez. I think you are wrong. Then I have nothing further to say to you, except this: >was not a move that made you look smart or nice. Trying to look smart or nice is not the goal in online discussions. At least, I don't think so. You appear to think that. The goal (to me) is to say what you think, otherwise, why write at all? I could just get an LLM to write all my comments, and not care about its hallucinations. I don't try to be smart or nice, nor the reverse. I just put my considered thoughts out there, just like anyone else. Obviously I can be right or wrong, just like anyone else can be. And some points can be subjective, so cannot be said to be definitely either right or wrong.
- kristiandupont 2y agoYou were being passive aggressive and adding nothing to the discussion. The fact that you weren't wrong doesn't make any difference.
- fuzztester 2y ago>You were being passive aggressive and adding nothing to the discussion. What arrant nonsense! Don't accuse people falsely or without substantiating your accusation. My comment being referred to above, consisted of four simple short lines. I am not going to bother to paste them here again for a third time. Those HN readers who wish to do so, can go the few needed levels up this thread and check for themselves: Nothing I said in those four lines can be interpreted as being passive-aggressive. I say that you do not know what the heck you are talking about, if you claim that I was passive-aggressive in that comment.
- _acco 2y agoContext is the most challenging bit. FWIW, the codebases I'm working on are still small enough to where I rarely need to include more than 12 files into context. And I find as I make the context bigger beyond that, results degrade significantly. So I don't know how this would go in a much larger codebase. What floored him was simply how much of my programming I was doing with an LLM / how little I write line-by-line (vs edit line-by-line). If you're really curious, I recorded some work for a friend. The first video has terrible audio, unfortunately. This second one I think gives a very realistic demonstration – you'll see the model struggle a bit at the beginning: https://www.loom.com/share/20d967be827141578c64074735eb84a8 https://www.loom.com/share/20d967be827141578c64074735eb84a8
- wokwokwok 2y agoSo you spend 10 minutes writing a free text description of the test you want; tell it exactly how you want it to write the test, and then 4-5 minutes trying to understand if it did the right thing or not, restart because it did something crazy then a few minutes manually fixing the diff it generated? MMmm. I mean, don't get me wrong; this is impressive stuff; but it needs to be an order of magnitude less 'screwing around trying to fix the random crap' for this to be 'wow, amazing!' rather than a technical demonstration. You could have done this more quickly without using AI. I have no doubt this is transformative technology, but people using it are choosing to use it; it's not actually better than not using it at this point, as far as I can tell. It's slower and more error prone.
- iluvcommunism 2y agoI used it for some troubleshooting in my job. Linux Sys Admin. I like how I can just ask it a question and explain the situation and it goes thru everything with me, like a Person.
- jlarocco 2y agoHow worried are you that it's giving you bad advice? There are plenty of, "Just disable certificate checking" type answers on Stack Overflow, but there are also a lot of comments calling them out. How do you fact check the AI? Is it just a shortcut to finding better documentation?
- novaleaf 2y agoI think that Greptile is on the right track. I made a repo containing the c# source code for the godot game engine, and it's "how to do X", where X is some obscure technical feature (like how to create a collision query using the godot internal physics api) is much better than all the other ai solutions which use general training data. However there are some very frustrating limitations to greptle, so severe that I basically only use it to ask implementation questions on existing codebases, not for anything like general R&D: 1) answers are limited to about 150 lines. 2) it doesn't re-analyze a repo after you link it in a conversation (you need to start a new conversation, and re-link the repo, then wait 20+ min for it to parse your code) 3) it is very slow (maybe 30 seconds to answer a question) 4) there's no prompt engineering I think it's a bit strange that no other ai solution lets you ask questions about existing codebases. I hope that will be more widespread soon.
- dakshgupta 2y agoI work at Greptile and agree on all three criticisms. 1) is a bug we haven't been able to fix, 2) has to do with the high cost of re-indexing, we will likely start auto-updating the index when LLM costs come down a little, and 3) has to do with LLM speed. We pushed some changes to cut time-to-first-token by about half but long way to go. Re: prompt engineering, we have a prompt guide if that helps, was that what you are getting at? https://docs.greptile.com/prompt-guide https://docs.greptile.com/prompt-guide
- photonthug 2y agoNo idea about the product, but I would like to congratulate you guys on what is maybe the greatest name ever. Something about it seems to combine "fierce" with "cute", so I think you should consider changing your logo to something that looks like reptar
- dakshgupta 2y agoSo glad you like it - we were worried it was too silly. The logo is supposed to be a reptile claw but we might modify it to make that more obvious.
- Havoc 2y ago> What exactly floored your colleague at Microsoft? Speaking of understand context… They floored him not other way round