5 ms·
PySheets – Spreadsheet UI for Python
- echidne 3y ago[dead]
- systemz 3y agoGreat idea, easy to use GUI for non-tech and Pandas for data oriented at same time. Is there some similar project but selfhosted? I would be uncomfortable with uploading health related data to external service.
- mackrevinack 3y agogrist is sort of similar. its a spreadsheet/database hybrid that lets you use python for formulas, and they have a self-hosted option: https://www.getgrist.com/product/self-managed https://www.getgrist.com/product/self-managed
- starkparker 3y agoHeavy emphasis on "sort of"; it enforces data types on columns, which is a significant difference from both spreadsheets and pysheets. This enables/requires more database-like behavior and planning (which is great for a lot of applications), but importing spreadsheets is much less intuitive and spreadsheet competence won't get you very far. Grist's closer to "what if Access had an interface that was more like Excel". Pysheets is more like "what if Python data structures had a GUI that looked like Excel". To put it another way, I love Grist but _would not_ recommend people who are using spreadsheets to try to bring their spreadsheets into it. I also love pysheets and _would_ recommend it for that usage.
- jurimasa 3y agoNot exactly the same but Spyder IDE has very nice spreadsheet functionality for data. Maybe it works for you.
- laffra 3y agoThe PySheets server runs anywhere, for example: my laptop, Google AppEngine, and DigitalOcean. I designed it with on-prem in mind, so that PySheets could be deployed at companies that do not want to share data with external services. That said, only the data stored in the sheet itself is stored in PySheets. Most use cases will load data from another place, filter and convert it, and then render a result. Still, self-hosting would be an interesting use case.
- bnc319 3y agoThere’s a cool one I’ve used called MitoSheet[0]. Runs locally and has some great features, though it doesn’t support TSV files last time I checked. It’s being actively developed still. I believe it was developed with YCombinator funding. [0] https://www.trymito.io/ https://www.trymito.io/
- paddy_m 3y agoI created buckaroo [1] as a better dataframe viewer for jupyter with built in summary stats. It's built to bring a better dataframe experience to people already using pandas/polars. All of it is extensible [2] so that you can customize stats and transformations to your workflow. [1] https://github.com/paddymul/buckaroo https://github.com/paddymul/buckaroo [2] https://youtu.be/GPl6_9n31NE https://youtu.be/GPl6_9n31NE
- paddy_m 3y agoIn the docs for my own project in this space, I created a whole related projects page. I figured if someone makes it to my docs, and buckaroo doesn't solve their problem, they should find something that does help them. https://buckaroo-data.readthedocs.io/en/latest/articles/related_projects.html https://buckaroo-data.readthedocs.io/en/latest/articles/rela...
- laffra 3y agoThat's nice. I will do the same for PySheets, once the dust settles on the original launch.
- krebby 3y agoAnother good option is Neptyne. Integrates with Google Sheets (provided you're comfortable storing your data there)
- prashp 3y agoWhat's the tech stack?
- nmstoker 3y agoI think the underlying platform (built by that team) was posted here only a week or so ago... I'll see if I can find it EDIT: found it! LTK: https://github.com/pyscript/ltk https://github.com/pyscript/ltk
- laffra 3y agoBrowser > JS > WebAsm > PyOdide/MicroPython > PyScript > LTK > PySheets > Your Python.
- runningpig 3y agoawesome
- laffra 3y agoThanks! - the author of PySheets
- echoangle 3y agoFor a non-browser python based spreadsheet application: https://pyspread.gitlab.io/ https://pyspread.gitlab.io/
- laffra 3y agoThe author of PySheets here: The app is written entirely in Python, running on PyScript, using PyScript-LTK, with two Python VMs, MicroPython and PyOdide. Web server is minimal logic, running on gunicorn on DigitalOcean. Storage is on Firestore. The App can be easily packaged up as a standalone, "on-prem" app, but I have not given that too much priority for now. Would love to hear what you all thing of writing web apps in the browser in Python.
- laffra 3y agoLTK, a Python library to create browser UIs, is part of the open-source PyScript project. See https://github.com/pyscript/ltk https://github.com/pyscript/ltk. Anyone planning to visit PyCon US in Pittsburgh, I will be in the Anaconda booth most of the time. See you there.
- deleted 3y ago[deleted]
- cl42 3y agoWow, PyScript has come a long way. I remember when loading it into the browser would take 5-10 seconds. This seems much faster. Great work!!
- laffra 3y agoLots of blood, sweat, and tears. And MicroPython!
- mairusu 3y agoWhy no ISO26300 support?
- laffra 3y agoMost people will import external sheets using Pandas. It has numerous conversion methods for table-structured data sources, such as https://pandas.pydata.org/docs/reference/api/pandas.read_excel.html https://pandas.pydata.org/docs/reference/api/pandas.read_exc....
- benrutter 3y agoThis looks like a great and very polished project! Leveraging python in soeadsheets is a great idea - probably why excel are doing it already, but it's nice to see an implantation that's so clear and easy to use. It's hardly a criticism of pysheets specifically, but I wish spreadsheets were more restrictive (I.e. force sheets into a table format) so that people could build out spreadsheets in an org without creating an unholy mess that needs to be picked apart and reversed engineered in something that isn't a spreadsheet.
- laffra 3y agoI envisioned many of the use cases not to store data in the sheet, but to use PySheets as a better Jupyter Notebook: Import data, convert to Dataframes, massage, analyze, learn, and export. A good example is how I have a sheet that loads PySheets usage metrics, converts to dataframes, plots in graphs and then renders as live charts on the pysheets.app landing page.
- thomasfl 3y agoPython is the new Excel. And now PySheets is the the Python.
- laffra 3y ago:-)
- breckognize 3y agoShameless plug: If you have bigger data sets, check out rowzero.io. We implemented something like PySheets initially where the formula language was full Python. But we found the Python interpreter to be the bottleneck during (e.g.) large CSV imports, and the GIL prevented parallelizing evaluation. It was also harder for business users to adopt due to small syntactic differences between Python and the Excel formula language. So we implemented the spreadsheet engine and formula language in Rust. We have a Python code window that allows you to write arbitrary Python functions. Those functions can be called as formulas from any spreadsheet cell. We seamlessly marshall Pandas dataframes from Python land to spreadsheet land and back. It gives you 90% of the benefits of pure Python without compromising on performance.
- laffra 3y agoRowzero is a better spreadsheet, while PySheets is a better Jupyter Notebook. Although they converge in certain aspects, their distinct target audiences set them apart. This divergence may create some overlap, but it also leaves ample room for user preference. PySheets currently runs inside the browser, on top of WebAsm, and the limitations there are bigger than just Python's slowness. You have only 4G addressable memory, including the interpreter and libraries. Network bandwidth is also a limiting factor for client-side computation. That said, PySheets can render a sheet based on a 50,000-row Excel sheet in 0.5s and needs about 20s to do a full end-to-end recompute run. There are limits to what you can do in the browser without using an external kernel that can run Polars on large datasets. But, I think most people will be fine with what PySheets can let them do. Finally, as the author of PySheets I am honored that a "competitor" sees us as a threat. I am quite impressed by Rowzero myself. Nice work :-)
- breckognize 3y agoKudos on the technical achievement. We considered the thick client approach you're doing, and one of the reasons we punted was because it was so hard. One really nice thing about your approach is it minimizes infrastructure cost. That positions you well for embedding use cases, like New York Times visualizations, that we struggle to do economically. Best of luck!
- mahoro 3y agoThis is awesome, and client-side Python is magic :-)
- laffra 3y agoThanks, much appreciated.
- stefanha 3y agoAny chance of a video walkthrough or tutorial? I can't figure out what the workflow is and which use cases PySheets addresses from looking at the landing page. I don't want to register an account just to find out.
- programmertote 3y agoVery interesting software/app. My current company has a lot of Excel files with a lot of business logic embedded as Excel formulas in them. When we import Excel file to PySheets, does it also recognizes formulas in the original Excel file? Are there any videos that show what PySheet can do? Thank you.
- laffra 3y agoTry cut-and-pasting a sheet from Google Sheets to PySheets. It works quite well. At the moment, PySheets does not handle Excel functions. This is on our possible roadmaps, but we just did not get to it yet. I really only worked on PySheets for about 3 months, since resigning from my last job in February.
- programmertote 3y agoThank you. As someone else has also commented here, a video walkthrough would be very helpful for us to get a sense of what the app can offer.
- anothernewdude 3y agoThat's not what I hoped it was. Also it's weird to shove AI into this. I was hoping for spreadsheets I could integrate into Jupyter.
- laffra 3y agoYou can load spreadsheets into Jupyter today. With Pandas or Polars, you can import CSV or Excel sheets quite easily. PySheets is reimagining what Jupyter Notebooks would look like if you use a DAG, not a linear execution flow. Just like CoPilot or Sourcegraph's Cody is used in VS Code, PySheets uses OpenAI to suggest the Python code to write when the sheet contains a Pandas data frame of a certain shape. The AI accelerates figuring out what APIs to call and when. I myself find Matplotlib and Pyplot highly confusing, and a coding assistant that writes my code in this niche, makes me a lot more productive. It is cool to say, "Take the dataframe in E13 and generate an orange bar graph for it," and see the code generated.
- anothernewdude 3y agoNo no no. I can do grids of data with Pandas. What I can't do (or don't know how to) is to have the data presented in an editable and interactive sheet inside Jupyter. I've tried the widgets, and they're generally painful to use, or maintain the extensions required.
- jimmcslim 3y agoIn the '00s and early '10s there was a London startup, Resolver Systems [1] , that was trying to bring Python and spreadsheets together. Alas they didn't make it but I wonder if that was because Python had a much smaller mindshare back then. [1] http://www.resolversystems.com http://www.resolversystems.com
- vram22 3y agoYes. They actually had a product, and IIRC, I had downloaded and tried it. I think they are some of the same folks who later founded PythonAnywhere, which I had also tried. I read recently somewhere that they were acquired by Anaconda.
- robertlagrant 3y agoI'm a big fan of PythonAnywhere. The team are great.
- laffra 3y agoAnaconda is also a heavy sponsor of PyScript. The https://pyscript.com https://pyscript.com website is an online IDE for quickly trying out PyScript and building a website. If you like PythonAnywhere, you will love pyscript.com as well.
- jaredandrews 3y agoThis looks pretty cool, I am someone who gets annoyed by excel, sheets, numbers for not just letting you code it in a nice language like python and then visualize/query after that. But then I see "AI-driven", which I should note is the _third_ line of text on the web page. I assume it is an important feature for the author of the page. I control-f, "ai-driven", it is only used one other time on the page: "Perform easy AI-driven visualization with Matplotlib" There is no further elaboration on the home page and I have been unable to find additional docs. (Someone please post a snarky RTFM response with a link to the manual, cuz like I said I am very interested in this. I did google "pysheets docs" which uhh linked to a python library with the same name...) Last week, for the first time ever, I used noted "AI" ChatGPT to review a resume I had written. I wouldn't normally do this, but the company I was applying for heavily emphasized that they use chatgpt to generate code and review things. Ever the skeptic, I decided to try it myself. I have to say I was impressed with the results. EXCEPT, ChatGPT, pointed out a grammar error in my resume which literally did not exist. Like the sentence it was critiquing in it's feedback was not found anywhere in my resume nor was there anything similar (from my perspective, I'm sure 1000 layers deep in it's network there was some similarity to something that had the error and wouldn't it be cool if we could effectively debug that). ANYWAY, when I see ai-driven without elaboration in a spreadsheet program, I am very concerned that my data might be "hallucinated" and I would encourage the author to explain what exactly this means. Will my charts be correct 99% of the time but sometimes a hallucination? What's going on here? I would probably be signing up for the beta right now if I had any idea. Thanks. (final snark: funny that one of the authors is named Kurt Vile, what are the odds https://www.youtube.com/watch?v=4uAXMl-Bfiw https://www.youtube.com/watch?v=4uAXMl-Bfiw)
- laffra 3y agoIf you sign up for PySheets, we give you 7 tutorials. Two explain how to use AI to import data, convert it to Dataframes, and visualize them using Matplotlib. The generated code is impressive and can help novice data scientists explore the Pandas and Pyplot APIs. The AI is used to generate Python code, not to analyze or generate data in the sheet. I will clarify that on the landing page. Hopefully, that will inspire you to try it out. This is a different Kurt Vile :-)
- Tazcollings 3y agoInteresting.
- laffra 3y agoThanks!
- ktownv 3y agoA all python DAG with an spreadsheet interface for taking inputs and displaying output to end users? Sweet!
- laffra 3y agoAnd it all runs in your own browser without needing any cloud kernels.
- echidne 3y ago[dead]
- mharig 3y agoFor the non-GUI folks: There is visidata for Python&Spreadsheets&On-Prem(&SQL) as a TUI. visidata.org
- toddofficeguru 3y agoI just sent 30 minutes with rowzero and pysheets. RowZero seems to support huge datasets. I have been using quadratichq as a python spreadsheet but now I think RowZero has more features (and a cheaper price point). I thought pysheet might be opensource but it seems to be closed and 2x the price and it is limited to 50 rows. Finally i was not able to figure out how to import https://www.w3resource.com/python-exercises/pandas/excel/SaleData.xlsx https://www.w3resource.com/python-exercises/pandas/excel/Sal... into pysheets. I didn't know about visidata this is incredible. Thanks everyone for the informative post.