6 ms·
Improvements to data analysis in ChatGPT
- jmpeax 3y ago"Hey there gorgeous! Do you want me to analyse your tables? ;)"
- chipgap98 3y agoIt will be interesting to see if ChatGPT can drive meaningful differentiation through features like this. Why would a business use this solution as opposed to native solutions from Microsoft and Google?
- taberiand 3y agoGiven the level of partnership between Microsoft and OpenAI, wouldn't this just be the same feature offered in different ways been ChatGPT and Office 365?
- billy_bitchtits 3y agoCan copilot in office 365 do this? I have that at work and has chat gpt at home and find chat gpt to be way better at data analysis. I can’t see how to get copilot to do it outside of manipulating excel.
- 7thpower 3y agoOffice copilot sucks, except for Teams, which is great. The rest is vaporware, basically. Obviously it will get a lot better, but this is refreshing. Hopefully Microsoft has something better to show at Build that isn’t a bunch of half baked tools that will… maybe be better in two years.
- jnnnthnn 3y ago> Instead of downloading files to your desktop and then uploading them to ChatGPT, you can now add various file types directly from your Google Drive or Microsoft OneDrive. This allows ChatGPT to understand your Google Sheets, Docs, Slides, and Microsoft Excel, Word, and PowerPoint files more quickly. As far as I know, this is the first integration of other cloud products in ChatGPT that's done as a 1st party integration (vs. "GPTs", which are all 3rd party)?
- sebastiansm 3y agoWhat alternatives exist to the analysis feature of chatgpt?
- cstanley 3y agohttps://patterns.app/ https://patterns.app/, but is more for databases
- jnnnthnn 3y agohttps://julius.ai https://julius.ai is great
- loumaciel 3y agohttps://www.findly.ai/ https://www.findly.ai/ works with databases.
- CephalopodMD 3y agoGoogle just announced their version of this on Tuesday with Gemini
- Hansenq 3y agoIf you're looking for a more powerful version of ChatGPT Data Analysis, I recommend https://julius.ai/ https://julius.ai/. If you're looking for a version of ChatGPT Data Analysis, but want to offer it to your customers, take a look at us! https://www.lightski.com/ https://www.lightski.com/ (disclaimer: I'm the co-founder.) We're building this feature of ChatGPT, but in a way that you can embed inside your app, so that your end-users can get an AI Data Scientist without needing to export data, then import it into ChatGPT or Julius.
- andenacitelli 3y agoAkkio has a pretty good chatbot for this as well as a much longer tail of data transformation and predictive modeling / AutoML features. Disclaimer: I work at Akkio, but think we have a really nice, value-add product and an excellent team behind it :)
- boyd 3y agoWe’re more focused on data visualization vs. general “chat with your data”, but building in this space: https://minard.ai https://minard.ai Upload or import a CSV, Excel, Google sheet, etc. and also just launched Postgres and Snowflake connectors today!
- Jimmc414 3y agoLooks like it will be nice when they work some of the kinks out. I'm now getting an internal error with the environment 'AceInternalException' when trying to display data in a pandas dataframe to the console. I looked around for about 5 minutes for a link or route to properly report the reproduction steps as a bug but didn't find anything and gave up.
- nbzso 3y agoI will ask again: The corporate data in the cloud? Sells, relationships, confidential information. I am crazy, or the world is getting ridiculous? First killing copyright. Now what? Privacy? Security?
- deleted 3y ago[deleted]
- jonas21 3y agoHuh? Almost everyone stores corporate data in the cloud and has for years.
- nbzso 3y agoSo I am the only one stupid enough to have a private cloud? And the biggest and most successful corporations have trusted their intellectual property to Microsoft and Google? Boy, I am living under the rock. It is time to break all the walls. Right?
- cloudking 3y agoMicrosoft and Google have thousands of security engineers focused on protecting your data.
- milemi 3y agoEven from you https://www.theguardian.com/australia-news/article/2024/may/09/unisuper-google-cloud-issue-account-access https://www.theguardian.com/australia-news/article/2024/may/...
- cooper_ganglia 3y agoOh, well in that case, they can access whatever data they'd like!
- neffy 3y agoThis would be the same Microsoft that can´t explain to the US State Department how there was a golden key floating around that allowed their email to be hacked? https://techcrunch.com/2023/07/17/microsoft-lost-keys-government-hacked/ https://techcrunch.com/2023/07/17/microsoft-lost-keys-govern...
- moralestapia 3y ago"OpenAI doesn't have a moat", yet every time they announce something it goes on to trend worldwide. I'm not even a fan of them, and I dislike the hypocrisy behind the name; and still, ChatGPT has replaced Google for 90% of my queries. It's starting to feel like a burden to have to open Google when ChatGPT doesn't give me what I want for some reason. As soon as they're able to "ground" results, 99% of my queries will go there. Anyone that doesn't understand this is just coping hard with this new reality.
- Bjartr 3y agoThat they are delivering useful capability is orthagonal to whether or not they have a moat. They have first-mover advantage, no doubt, but there's very little stopping others from catching up.
- moralestapia 3y ago>there's very little stopping others from catching up And yet they don't! Talk is cheap.
- HarHarVeryFunny 3y agoClaude is same level as GPT-4. Anthropic have just hired a Chief Product Officer (Mike Krieger - co-founder of Instagram), so you may see more layered on top of the core AI if that is what you are referring to, although they seem to have a different focus (more corporate) to OpenAI, so don't hold your breath for an Anthropic AI girlfriend. OpenAI seem to be trying a shotgun strategy of productizing GPT any way they can, but I'm not sure that's the best long-term strategy. Maybe better to build an ecosystem - build the OS/APIs, and let 3rd party's build the applications on top of that.
- mupuff1234 3y agoSeems like Google is mostly caught up.
- 3y ago
- iamsanteri 3y agoIsn’t this literally what all sorts of analysts do as their core jobs? Are they getting automated away?
- andy99 3y agoNo. People that boil a job down to a simple cognitive task rarely understand what the actual work of the job is.
- nextworddev 3y agoYou are right, but this tool gives executives a nominal reason to downsize.
- zx8080 3y agoIs downsizing a thing that execs fear of? Less budget, less power.
- andy99 3y agoIn practice it doesn't work that way. What's downsized is line workers that exec's treat as fungible and don't care about anyway. Any "savings" goes to more management to run whatever the replacement solution is. Someone like a foreman may see their headcount reduced but they are the only people who would care.
- ImaCake 3y agoExactly. I am a "Data Scientist" for whatever that label is worth. But what I actually do is domain specific to outdoor air quality. These tools help automate the boring stuff - if chatGPT made programming obsolete for me tomorrow I wouldn't lose my job, I would just be able to spend my time doing something more useful. But somehow I doubt it will.
- autokad 3y agoyou don't need this though, you can just ask chat gpt to give you python code for running general data analysis
- VWWHFSfQ 3y agosure, but I'm super lazy. I just want the chart or table or whatever so I can paste it in an email and then go home.
- 7thpower 3y agoNot everyone knows how to python or wants to deal with the frustration of learning it. This is a big deal for a lot of people, especially corporate workers who don’t have access rights to run code in the first place.
- ramoz 3y agoThe point is they’re headed in a direction that erases the need for someone who must work with code in order to understand analytics
- sv123 3y agoIt is so much easier to do it in a chat interface and iterate on the exploratory analysis... copy/paste back and forth from a notebook is terrible.
- deleted 3y ago[deleted]
- phillipcarter 3y agoI've believed for quite a while that data analysis is a much better use of this kind of AI than coding assistants is. Really happy to see OpenAI investing in this space. There's likely loads and loads more improvements to make.
- ramoz 3y agoYou mean using code generation in a way that replaces the developer (in this case the data scientist who would be asked to conduct/code the analytics).
- rohitghumare 3y agoI hope the demo will be the same as the actual implementations.
- mpeg 3y agoI like the concept, but I'm not sure I like the implementation. The demo they show has an excel sheet source being transformed into another sheet by grouping by a specific column. I don't like how it does a transformation step, sends a new transformed file and then switches the display to this new file. I worry that this loses the history of what exactly has happened to the file, so you're letting a black box run an unknown transformation and trusting the result to be correct. A better implementation would require a custom UI for this, similar to existing data wrangling tools where every action is logged so that it's clear what has happened to the file and the steps can be checked transparently and rolled back if needed. As it exists now I would find it hard to trust it
- ramoz 3y agoFile lineage doesn’t seem like a complex feature addition here.
- mpeg 3y agoYes and no, apart from the UI for it it really depends on how they've implemented the transformations. For example, if it's writing and running python behind the scenes which I suspect is what is happening here as that's what the old ChatGPT data analysis did that would not work very well without having to read the code which defeats the point of it being no-code... You'd want deterministic steps, like it would need to have a limited list of functions to choose from that do specific things eg "group_by()" "filter()" etc so that the code it runs is always the same for it.
- StarlaAtNight 3y agoMight make sense for them to anchor to ibis for the code part (since it compiles down to SQL or Pandas) - and, being inspired by tidyverse, could easily translate to R
- bhl 3y agoTo collaborate with LLMs with text editors and spreadsheets, yeah I do think we will need deterministic declarative primitives that both users and LLMs can use. Getting those primitives right would also get us generalized autocomplete for apps.
- hooloovoo_zoo 3y agoUntil the LLM has more to go on than the column name, all these analytics AI tools are doomed to failure for anything nontrivial.
- vikramkr 3y agoI mean, if you're going to doom these tools to failure you should probably pick a higher bar than 'can look at more than column name' since that's not going to take very long at all to happen at this rate of progress.
- hooloovoo_zoo 3y agoYou are way underestimating the difficulty there. Most often the actual column does not have a detailed description somewhere so the llm is going to have to understand your entire codebase including whatever is logging the column and what that log actually means. Open AI has been trying to do this for 5+ years in various forms.
- vikramkr 3y agoHonestly for companies that are really on board with the AI stuff they'll probably start shaping their data and processes to work well with these tools. And the whole 'understand your entire codebase and the meaning of the log' thing is both what these models area already decent at and also not really relevant here? I double checked the announcement and I don't see anything about code or logging? Seems to be pretty straightforwardly a data analysis tool to work with the standard data formats (excel, google sheets) that the vast majority of people use.
- hooloovoo_zoo 3y agoSuppose you have some natural language analysis question like “how many users clicked on x product?”. In the demo, there’s always a ‘clicks’ table and the LLM just gets it right. In the real world, that product has multiple links on multiple platforms some of which represent a prefetch and also that product really comes in multiple skus so do you want all of them bla bla bla. It would already be helpful without AI to better document how a table works but it doesn’t happen and there are already better ways to document tables than natural language which nobody uses so I doubt businesses are just going to suddenly be great at documentation. The LLM will get the wrong analytic answer because it doesn’t know how anything works, which makes the analytic tools not very useful.
- m3kw9 3y agoYou could already do that if you don’t need google sheets
- wuj 3y agoIt starts to feel like a trend where OpenAI is integrating features that were previously implemented by GPT-wrapper startups into ChatGPT. While these startups have added value by enhancing user experience, the trajectory is leading towards an ecosystem where these functionalities seamlessly integrate. The future will be challenging for those startups.
- RobertDeNiro 3y agoIt always seemed like loosing bet to implement a startup purely on top of the OpenAI apis. If you do that you have zero moat.
- zarathustreal 3y agoProprietary data is the moat in those cases, unless you’re literally a wrapper
- alvah 3y agoThe founders of Conversion.ai / Jarvis / Jasper / whatever they're called today did OK out of it though.
- pseudosavant 3y agoThat is the conclusion I’ve come to with all of my AI ideas so far. Easy to be replaced by a feature in ChatGPT or Copilot. Hard to create a meaningful moat.
- ChildOfChaos 3y agoI remember even Sam said this, he said something along the lines that if you are just building something that is effectively a missing feature of ChatGPT or one of there products, they are going to end up replacing you, so you need to be building something more significant.
- ttul 3y agoFurthermore, it’s increasingly clear that OpenAI is doing a “bottom-up” challenge to Microsoft and Google. I would not be surprised at all if OpenAI launches an email service to compete with Gmail, imbued with a fine-tuned model that is optimized specifically for working with email. And then a document editor… and a spreadsheet… etc. There is huge money in productivity software. Microsoft 365 generates the bulk of the “cloud” revenue on Microsoft’s P&L. IIRC, worldwide revenue from Google Workspace and Microsoft 365 - and whatever other minnows can survive underneath them - is supposed to reach $40B by 2030. I apologize for not providing the source.
- mbforbes 3y agoI'm interested by the first pull quote: > "...analyzing customer data, which has become too large and complex for Excel. It helps me sift through massive datasets..." The emphasis here is on the size of the data, but I think that's a red herring. Excel can certainly handle way more data than you're going to want to repeatedly pipe through an LLM. I'm betting it's the diversity of---or even lack of---schemas. Big piles of tables and unstructured data you'd normally have to normalize and join. I spent years doing data analysis slowly with Python (pandas), and it took me a long time to accept that getting better at Excel was just more efficient. Hard to accept that code isn't always a task's best interface. Automating some Excel work sounds even better.
- serjester 3y agoCan you elaborate on what you found Excel better for?
- mbforbes 3y agoNothing capability-wise! Just speed and ease of manipulation. Maybe an analogy is doing image processing. One could write filters and other manipulations in code, or use something like Photoshop. It turns out Photoshop is a great interface for many of those tasks. I think the same thing is true for more data analysis than I'd realized because of my poor Excel skills. Still want to improve my spreadsheet abilities though. There's a fun video called You Suck at Excel by Joel Spolsky I'm halfway through [1]. Would love to know of more like this. [1] https://www.youtube.com/watch?v=JxBg4sMusIg https://www.youtube.com/watch?v=JxBg4sMusIg
- simonw 3y agoYou don't pipe the data directly through an LLM with this tool - it writes Python code that manipulates the data. So this will handle millions of rows of data quite happily. I've used it extensively with SQLite in the past - you can upload SQLite databases to it and have it run SQL against them. You can also ask it to save data to SQLite for you to download.
- 3y ago
- worstspotgain 3y agoI picture every AI founder instantly shivering in cold sweat when OpenAI news break. Deer Hunter, Hayes Valley style.
- skadamat 3y agoI love that the "Authors" section just lists "OpenAI". For a split second, I thought it was written entirely by ChatGPT :)
- fblp 3y agoI'd love to see this for finance statements and data. Is anyone working on this?
- Valerie_Wilson 3y ago[dead]
- numbers 3y agohmm, the current charts generated are pretty basic and kinda ugly so I'll continue using Excel/Sheets but I'm hoping this can be used to generate charts out of tables for presentations.
- chocoboaus2 3y agoJust more proof that OpenAI is now a product led company and not a research led company (obviously they will continue to research but that will lead to consumer product). Big pivot.
- jp0d 3y agoYes, looks great for small businesses and individuals. I don't any big enterprise would handover their confidential data to OpenAI.
- culopatin 3y agoIs data analysis what I should use if I have multiple files I want to chat about? What if I have a long multipage document? It’s starting to become obfuscated what version I should use for what.
- pottertheotter 3y agoThere's no difference these days. It's just part of any other chat. It used to be that you had to start a chat with data analysis. Now you just pick your model (3, 4, or 4o).
- hermitcrab 3y agoIf you are using an LLM to write code, because you aren't skilled enough to do it yourself, how are you going to know if what it is producing is correct?
- carlosbaraza 3y agoOne interesting point of this feature is that it acknowledges that natural language is not a sufficiently good interface, we still need custom UI for particular use cases. As long as humans are in the driver seat, multiple UIs for the same problem will be created and used by many, enabling the SaaS ecosystem to thrive with this new LLM tooling backend.
- mritchie712 3y ago(note: bias because I'm founder of https://www.definite.app/ https://www.definite.app/) Completely agree, chat is not going take over every UI that's been developed over the past decades. One example: are you going to build a "Company Dashboard" in ChatGPT? ChatGPT is good for "last mile" adhoc analysis (e.g. you already have all your data in a single file and you want to ask a few questions). But you're not going to build dashboards and standard reports in it just like you wouldn't run your CRM in it.