3 ms·
WizardCoder is fantastic. I use it as my local "code assistant" LLM[1]. I'd really like to hear from the Phind team about this. Using someone else's work witho
by npsomaratna 3y ago
WizardCoder is fantastic. I use it as my local "code assistant" LLM[1].
I'd really like to hear from the Phind team about this. Using someone else's work without attribution isn't cool (assuming this thread is true).
------
[1] In fact, I put out a set of instructions on how to get it to work with VS Code (with the help of Continue + llama.cpp) a couple of days ago: https://news.ycombinator.com/item?id=37296728 https://news.ycombinator.com/item?id=37296728
- theusus 3y agoIs there a service that provides it?
- eurekin 3y agoCan you share more about the usage? Was it really useful, in what cases? Would you recommend it over gpt-4 or codepilot?
- npsomaratna 3y agoSure. So, my startup[1] does data processing for clients in aviation and finance. Due to security, legal, and regulatory requirements, sending our code on to a third party (e.g., OpenAI) is a no-go. Thanks to CodeLlama (the WizardCoder fine-tune), I've finally been able to get AI assistance with my code. My fundamental programming skills are solid (30+ years programming!), but I only started using Python extensively relatively recently. I can get the language to do what I want it to do—but often not in the most "Pythonic" way. With CodeLlama, I'm able to check if I've done things in the "right" way, and I'm also able to ask questions when I'm trying to figure out how to implement something. As mentioned above, I cannot use GPT-4 for my startup, but I have used it for personal stuff. My feel so far is that wizardcoder-python-34b is surprisingly good. I certainly haven't thought "oh, I wish I had GPT-4 instead"—at least, not yet! (I haven't used Copilot either, for the same reasons listed above.) -------- [1] Shameless plug: https://www.amw.ai https://www.amw.ai
- rvbissell 3y agoHumorous observation: amw.ai sounds like an LLM MLM. ... "Can I be an Amwai distributor?"
- eigenket 3y agoIsn't using someone else's work without attribution the whole point of (modern) AI? I don't get any attribution for the code or messages I wrote that GPT4 was trained on, and there are multiple examples of LLMs regurgitating people's code (even copyrighted code) without attribution. https://news.ycombinator.com/item?id=33226515 https://news.ycombinator.com/item?id=33226515
- nehslajs 3y agoExcellent point. The training dataset is just upstream of the fine-tuning step but both are supplying vital data to the whole pipeline.
- Maxious 3y agothieves are never rogues amongst themselves
- danmur 3y agoHahaha you beat me to it. Still rude though. Rude on rude.
- brookst 3y agoWell by that standard how many of us can say we learned to code without seeing anyone else’s code? And how many of us “regurgitate” copyrighted code? I don’t check my own output, and across decades of writing, odds are good I’ve produced verbatim copies of some copyrighted code. Point being, there’s a legit conversation to be had about AI training data, but it’s not the same conversation as humans intentionally creating a derivative work. I think it’s too reductive to insist those are the same thing.
- eigenket 3y agoThe link I provided shows copilot regurgitating a 21 line function pretty much exactly. The comments are changed from //comment style to /*comment*/ style and some of the variables have been renamed, but thats about it. I can say with pretty high confidence I have never plagarised anything to that level, and I think the same is true of most human programmers.
- RealityVoid 3y agoThis is neat! I'm going to give it a shot!