9 ms·
Google Colab will soon introduce AI coding features
- neets 4y agoTrain the AI by using AI, things are getting pretty META
- deleted 4y ago[deleted]
- nextworddev 4y agoIs this another "beta" feature? It says it's available today, but I don't see it. Source: currently a Colab pro subscriber based in the U.S., but don't see the AI features in my Colab notebook
- neom 4y agoIt specifically says in multiple areas of the article that it's not available today. "Google Colab will soon introduce..." "Access to these features will roll out gradually in the coming months, starting with our paid subscribers in the U.S. and then expanding into the free-of-charge tier. We'll also expand into other geographies over time. Please follow @googlecolab on Twitter for announcements about new releases and launches."
- cperry 4y agonot yet available; it'll roll out sequentially in the coming weeks as we sort out capacity and polish.
- nailer 4y agoHow far away is the VS code plugin?
- cperry 4y agoWhich one? If you're talking Palm 2, I couldn't say, I spend my days trying to convince everyone at Google to prioritize and support ME first ;)
- nailer 4y agoThis one, Codey - from the headline I thought that was what was being pre announced. It’s hard to do AI assisted coding if you’re not in everyone’s editor and your competitor already is.
- greatpostman 4y agoI really think the current paradigm of literally typing if else logic all day into programs, and then getting paid huge money to do so will go away. Programming is going to be much higher level and accessible, though still complex. It will take five years or so. Edit: My prediction is essentially that: You give it a set of requirements for an api, with edge conditions written in plain English. Test cases are provided. And the vanilla api is generated. We aren’t that far from this. It’s going to happen. Programmers may go in and tweak the generated code. When the requirements change, you pass in the old code as context. Complex software will require human coding. But most programmers are in denial about how complex the code they’re writing actually is. Requimemts gathering is notoriously tricky, but you won’t need engineers for it. Welcome to the age of the PM
- nextworddev 4y agoThe bi-furcation of programmer careers will intensify. Think of it like hedge fund traders vs stay-at-home retail traders. The closer you are to the core AI stack, the more you will get paid - kind of like hedgefund traders. If you are just copy pasting ChatGPT mostly, then you will get disintermediated at some point.
- greatpostman 4y agoI disagree with this as well. The number of people legitimately working on LLMs right now is probably only in the hundreds. One or a few huge models will do all the programming automation. But yes, high paying developer jobs will exist. The rest will not pay as well, and with much worse job security. This field is going to change very fast
- cj 4y ago> This field is going to change very fast It will be slowed by bureaucracy. Example: To be SOC 2 compliant, you need to have change management controls in place. How do humans manage change management if an AI is doing everything for the humans? Would humans still be doing code reviews? (AI might be so great where code reviews are obsolete, but compliance / regulations may still require humans in the loop) There's also a -huge- subset of software that is extremely mission critical or heavily regulated by compliance where all current compliance frameworks assume there's a human in the loop. Ripping the human out of the loop would require re-writing the regulations / standards (which I guess AI could help with) but I think the change will come slower than you're predicting. Change won't be slower because of any technological barrier necessarily (this is debatable), but because it will absolutely take a very long time for humans to fully trust AI and its output. The era we're in currently feels like where Tesla was a few years ago. Really cool concepts and proof that self-driving "works", but there are so many edge cases which limit its complete roll-out and makes the original promise of "everything will be self driving in 5 years" seemingly achievable, but 5 years later it hasn't been achieved, and remains simply an assistive technology with many limitations.
- falcor84 4y agoI'm tired of Google announcing something in the future; wake me up when it's actually out.
- xena 4y agoAre you kidding? Google's main product is waiting lists.
- cperry 4y agowe debated this; this is going to be a sequential rollout based on availability/capacity, and it seemed better to broadcast it was coming earlier b/c we're not going to have a "launch event" moment.
- 4y ago
- anotherpaulg 4y ago(Shamelessly spreading the word about my open source tool) You can do GPT-4 powered coding chats in your terminal today with aider. It's not free in the sense that you need a gpt-4 api key, which openai charges you for. But it's a pretty great way to collaborate with AI on code. https://github.com/paul-gauthier/aider https://github.com/paul-gauthier/aider
- worldsayshi 4y agoNeat! This interface look simpler than most alternatives I've seen lately. Do you know how it deals with source files that are larger than the context window?
- anotherpaulg 4y agoThanks for checking it out. Right now aider doesn't even try and deal with files larger than the context window. For gpt-4, that's 8k tokens or about 32kbytes. Which is pretty reasonable. According to the data in [1], the average source file in github is less than 14KB. It's worth noting that they explicitly discarded small files with less than 10 lines. So the true average is probably much lower. Regardless, I haven't found the gpt-4 context window issue to be problematic in practice yet. You do need to be careful about how many files you "add to the chat" at once. But that's not hard. For sure there are cases where you would need to refactor a large file before you could use it with aider. I am certainly interested added context window management features to aider. I have previously explored a bunch of approaches for this with gpt-3.5-turbo. I shared some notes about these experiments previously on HN [2]. [1] https://hoffa.medium.com/400-000-github-repositories-1-billion-files-14-terabytes-of-code-spaces-or-tabs-7cfe0b5dd7fd https://hoffa.medium.com/400-000-github-repositories-1-billi... [2] https://news.ycombinator.com/item?id=35441666 https://news.ycombinator.com/item?id=35441666
- panarky 4y agoFor chat, its common to use gpt to summarize previous turns so they consume fewer tokens, while not losing the context completely. Seems like that could work even better for code, where gpt could compactly summarize what functions do without memorizing all the code.
- balls187 4y agoThe animated gif for the first example leaves a lot to be desired. The UX: Click a button, type in a prompt, click another button. The speed just to generate 2-3 lines of code. And AI generated code with no basic error handling.
- pphysch 4y agoThat's the free UX. Paid users get a seamless Copilot-style autocomplete experience. Clever use of intentional UX friction IMO. It does cost money to run these models.
- balls187 4y agoAnd, free users are providing training data back to Google for free. Certainly google should monetize; but not off removing artificially bad UX.
- cperry 4y agogotta start somewhere. we're in a sprint this week working on different UX patterns.
- deleted 4y ago[deleted]
- meghan_rain 4y ago> Democratizing machine learning for everyone: Anyone with an internet connection can access Colab, and use it free of charge. Millions of students use Colab every month to learn Python programming and machine learning. Under-resourced groups everywhere access Colab free of charge, accessing high-powered GPUs for machine learning applications. Ugh, cringe. Just say this is a panic swing at an existential threat (OpenAI) and you're trying to commiditize them.
- cperry 4y agolol been working on this since 2021; I have a small team and we do our best.
- striking 4y agoDeep respect for reading the comments and showing up for your team.
- cperry 4y agoright back at you, thanks!
- meghan_rain 4y agothen i take it all back, thanks for your work, the outcome looks very useful, looking forward to using it :)
- junglistguy 4y ago[dead]
- indigodaddy 4y agoNot free for gpt-4, but there is also cursor.so (no affiliation/never used but looked interesting when I stumbled on it last week)
- barbazoo 4y agoIf you're not paying for it, you're the product
- sharemywin 4y agoyour data is they could give 2 shits about you. They take care of pigs before they slaughter them.
- astrange 4y agoGoogle doesn't need to care about "your data" particularly, they show you ads.
- astrange 4y agoYou can pay for Colab.
- nlstitch 4y agoYeah something about being vendor locked by Google into the "Democratisation of ML" does not sound appealing at all.
- assane101 4y agoHow is it vendor locking if you are writing Python code you can pull out any time ?
- cperry 4y ago+1 all Colab files are the standard Jupyter .ipynb extension: we very much want to avoid any notion of lock-in. We bundle them all into a folder for you in Drive: it takes you like a second to take all of your work to any competitor.
- deleted 4y ago[deleted]
- oli5679 4y agoI find VS-code running notebooks with Colab plugin installed pretty helpful for this type of thing already. (1) run notebook in VS-code https://code.visualstudio.com/docs/datascience/jupyter-notebooks https://code.visualstudio.com/docs/datascience/jupyter-noteb... (2) install Github Copilot extension https://marketplace.visualstudio.com/items?itemName=GitHub.copilot https://marketplace.visualstudio.com/items?itemName=GitHub.c... and then it can quite often achieve what you want with just a comment or some previous code snippets. Then if you load in pandas and a DataFrame you want to analyse, it quite often suggests the next stage of your data-analysis work, either right away, as you write the first step in some chain of pandas methods.
- hn_throwaway_99 4y ago> I find VS-code running notebooks with Colab plugin installed pretty helpful for this type of thing already. I think you meant "with the Github Copilot plugin installed".
- BudaDude 4y agoI got excited for a moment to run Colab in vscode. I was sad to see it was typo
- sheikheddy 4y agoUsed to be available but Google banned it: https://github.com/abhishekkrthakur/colabcode/issues/109 https://github.com/abhishekkrthakur/colabcode/issues/109
- qumpis 4y agoWow, me too. Coding without copilot is incomprehensible to me, let alone outside of vscode or pycharm.
- oli5679 4y agoYou’re completely right. It was a typo that causes confusion
- 4y ago
- version_five 4y ago"We won't charge you for providing us with training data" Also, I'm sure they have ways around it, but I'd imagine colabs are a poor source of "good" code to use for further model training, both because of the kind of code you write in notebooks and the demographic that would make up colab users. It sort of fits with the idea that autocomplete might be good at writing short functions that do some specific thing, but not much help actually writing a full program.
- omeze 4y agoFree of charge, unless they don’t like what sort of programs you run! Google bans certain open source AI models in Colab, like Pygmalion. See https://colab.research.google.com/github/PygmalionAI/gradio-ui/blob/master/notebooks/GPU.ipynb https://colab.research.google.com/github/PygmalionAI/gradio-...
- dymk 4y agoWhat's the problem here? They get to choose how they offer their free service?
- omeze 4y agoThe problem for users (not google) is that its an arbitrarily enforced restriction. Of course companies can do whatever they want. Google could ban all programs that import PyTorch on their free tier, too. Totally their choice. It’s also my choice to mention that people should look into alternatives like Replit if they’re worried about a cool notebook they made on Colab randomly getting them in Google TOS trouble.
- jsnell 4y agoDoes Replit give free access to GPUs for any use case? The documentation[0] has screenshots that imply that GPUs cost "cycles", which are a virtual currency you buy with real money[1]. [0] https://docs.replit.com/power-ups/gpus https://docs.replit.com/power-ups/gpus [1] https://docs.replit.com/cycles/about-cycles https://docs.replit.com/cycles/about-cycles
- ztgasdf 4y agoWould be nice to try, until I got banned yesterday for trying to connect two Colab runtimes together via SOCKS5. Turns out connecting to any proxy at all immediately suspends your Colab usage for "suspected abusive activity"!
- cperry 4y agoappeal in product and we're usually pretty forgiving
- ztgasdf 4y agoAlready did, but I accidentally did this once before and appealed and got unbanned some hours later. It's been almost 48 hours since now, so I don't think they're too forgiving for repeat offenses.
- sangnoir 4y agoI have no dog in this fight - but your actions give the appearance of probing for weaknesses if you already knew this was not allowed from your prior accident.
- ztgasdf 4y agoNot really, I just wanted to bypass ratelimits from certain download sites so I figured that maybe rotating notebook sessions would work. Silly me for not checking TOS every other week :P
- aorth 4y agoWas it also trained on my/our open-source code repositories and Creative Commons StackOverflow answers? https://stackoverflow.com/help/licensing https://stackoverflow.com/help/licensing Does it provide any attribution?
- seydor 4y agoAlexa build me a Google (or is it the other way around?) As more people use automated programmaking, most of the code will be low level spaghetti in procedural languages, because it is easier for the model to reason with it (without needing huge buffers to know about abstractions). We will see a lot of generated Javascript, PHP, even a return of Win32. Who cares if they are tedious for humans to read and fix, now the AI can do all kinds of advanced search/replace in the code. And maybe at some point they 'll be generating machine code directly
- dang 4y ago> "soon introduce" This looks like an announcement of an announcement, which isn't on topic for HN. https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sort=byDate&type=comment&query=%22announcement%20of%20an%20announcement%22 https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sor... On HN, there's no harm in waiting for the actual thing: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&sort=byDate&type=comment&query=%22no%20harm%20in%20waiting%22%20by:dang https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so...
- jsnell 4y agoI don't think that's the case. This is the official announcement of a product, with details on how the product works, and I doubt they'll be writing anything particularly more meaty when they proceed through various rollout stages. The way I've understood the "announcement of an announcement" rule in the past is that it is for reports/rumors that somebody is company to release something, or a company sending a teaser for a future event where they'll announce something. The standard has never been that the product needs to already be generally available to be on-topic. If that were the standard, when could we discuss say a new iPhone? Not when it's talked about on the big Apple stage. Or as another example consider yesterday's discussion of the changes to the Google account deletion policy. No accounts will be deleted for 9 months, was it an announcement of an announcement?
- dang 4y agoOk, I've rolled back that penalty. https://news.ycombinator.com/item?id=35978216 https://news.ycombinator.com/item?id=35978216 confirms what you've said. The comments in this thread are nearly entirely generic, though.
- insomagent 4y agoI like you, dang.
- bushbaba 4y agoGoogle should learn from Apple and their prior Gmail launch how the announcement should have a clear call to action. Else they created buzz that was not capitalized on.
- deleted 4y ago[deleted]
- renewiltord 4y agoThe way that I do this right now is use Copilot in IntelliJ for notebooks that I execute on a remote server. This does the job.
- pprotas 4y agoWhat kind of remote server do you use?
- renewiltord 4y agoIntelliJ can connect to a Jupyter server. That's what I use. As for hardware, it's just some generic Linux box with lots of RAM - nothing special. And strictly I use Pycharm from the IntelliJ suite. If you mount the remote FS locally (I use NFS) you can even stop writing locally and continue on your server's Jupyter web interface.
- candiodari 4y agoI'm sure it'll be available in 180 countries: the US, the United States, America, New York, Washington, Wisconsin, ... (sorry frustrated bard-non-user in the EU speaking ...)
- miohtama 4y agoHopefully the AI knows how to update Colab to newer Python versions!
- nomel 4y ago3.10 is supported. I suspect it's others [1] preventing 3.11. [1] https://pyreadiness.org/3.11/ https://pyreadiness.org/3.11/
- cperry 4y agoWe had a couple SWEs move us from 3.7 to 3.10 over the past six months, removing years of tech debt. This comment is dead wrong. We'll upgrade to 3.11 when they push their final regular bug fix release in April 2024. Make fun of my stupid blog post all you want, but my eng partners are awesome!
- miohtama 4y agoThank you. We stopped using Colab some time ago because it was stuck on old Python versions. Happy to see the train moving again.
- ilaksh 4y agoDoes this mean that Codey will be available soon via the Vertex/PaLM 2 API?
- mark_l_watson 4y agoI saw this announcement a few days ago and I am enthusiastic. Even though I only use Colab 3 or 4 hours a month, it is a good product and so I happily pay $10/month for it. I hope Codey is available on the $10 plan. I have been using CoPilot for about a year (mostly in Emacs, sometimes in VSCode) and I find it very useful, so I am especially excited to see what Google offers. I also find myself using Bing+ChatGPT a lot for writing short functions in a variety of programming languages. All of these tools, at least for me, eliminate most of the tedium in my programming projects.
- cperry 4y agowe'll start on Pro+, but plan to support Pro as well, including w/ autocompletions (those may slip if cost/usage comes in too high, but so far in dogfooding it's very reasonable).
- neilv 4y ago> Colab will use Codey, "OK, team. With our founding cash cow threatened, we're at a critical juncture that could preserve or break us. If we're to survive, we must make the most of every factor of success at our disposal. This includes branding, and that's why we hire you, some of the best in the world at it. First major disruptive tech up for branding is a code LLM. Brainstorm now." "Codey McCodeface!" "Looks like we can go home early."
- Jackson__ 4y agoSoon meaning hopefully with the release of palm 3? From the few tests I ran with palm 2 in bard, it's... well not absolutely horrible, but still quite a bit worse than ChatGPT3.5.