paddy_m

12 ms·

151.
by paddy_m 2y ago
I have a tool [1] that is tackling some of the same problems in a different way. I had some core views that shaped what I built. 1. When doing data manipulation, especially initial exploration and cleaning, we type the same things over and
152.
by paddy_m 2y ago
This looks good, especially the data ingest. A couple of questions: What type of data person are you aiming this tool to be useful for, data analyst, data scientist, or data engineer. I'm guessing data analyst who wants to use PyData
153.
by paddy_m 2y ago
> Lisp needs braces You're a troll, but I'll feed you. I adapted Peter Norvig's excellent lispy2.py [0] to read json. I call it JLisp [1]. Lispy2 is a scheme implementation, complete with macros that executes on top of p
154.
by paddy_m 2y ago
Not on topic, but related. I made a video explaining my side project - Buckaroo for my less technical friends and family. In 6 minutes I give a high level overview of why data scientists use NumPy and Pandas, how they use Jupyter Notebooks,
155.
by paddy_m 2y ago
And NY Cabs were actually generally trustworthy. Cabs were absolutely worse everywhere else in the US, with many more shenanigans.
156.
by paddy_m 2y ago
You're being a bit shy, I'll help :) Matt Harrison wrote Effective Pandas, the guide to writing elegant pandas code and avoiding many common pitfalls. Keep up the good work https://www.amazon.com/Effective-Pandas-P
157.
by paddy_m 2y ago
I'm using ag-grid for my project too. I did a bunch of work to make configuring it more declarative... so you can have pinned rows that read from a different data source for summary stats, so you can specify custom renderers for each
158.
by paddy_m 2y ago
I am working on Buckaroo[1] - the data table for jupyter/dataframes that I have always wanted. Buckaroo combines a performant table capable of scrolling through 1000s of rows, with summary stats and histograms. All configurable and e
159.
by paddy_m 2y ago
Also the Julia people wrote their own notebook system called Pluto. Which is so on brand for them. It might be technically better, but they miss out on the whole jupyter ecosystem, further isolating the language.
160.
by paddy_m 2y ago
Thank you. I saw that there's a wealth of other docs from Symbolics at archive.org. I will spend some time exploring. https://archive.org/search?query=creator%3A%22Symbolics%22
161.
by paddy_m 2y ago
The two can coexist. store libraries in python code that is versioned and deployed properly. Notebooks with their data ingest, code, then output should read cleanly. Making the ingest and code readable is the job of library writers. A cl
162.
by paddy_m 2y ago
Another issue is that jupyter, pandas, and polars don't take displaying tabular data seriously. Just have a better default table display widget. Look at ipydatagrid, perspective, or buckaroo (my project) for examples of how it could
163.
by paddy_m 2y ago
Ooh. That's a nice utility funtion that I will write soon. We tend to look at requirements as something we hope the package manager gets right, and then we ignore at runtime, but there are a bunch of errors we could avoid if we verif
164.
by paddy_m 2y ago
I take it that's supposed to be the pre-loading page to just look at the requests, not a full working UI? After cursory googling I couldn't find one, do you have a public notebook gallery?
165.
by paddy_m 2y ago
Impressive work. I love jupyter, but it's a bear to work on. What mix of JS packages do you see? Could that be built into one uber package?
166.
by paddy_m 2y ago
I once heard of a behavioral economics paper that said you can reliably predict a judge's ruling on a legal or ethics matter based on what is best for the legal profession.
167.
by paddy_m 2y ago
I love the mozilla UI for restoring all tabs after a crash. I wish I could see that regularly.
168.
by paddy_m 2y ago
I built something somewhat similar where I manipulate pandas dataframes through a gui [1]. The gui emits json-flavored lisp [2] (replaced parens with json square braces) which is then interpreted through two interpreters which have the sam
169.
by paddy_m 2y ago
I'm in a ski share house in the northeast. Last winter I organized a ski tuning clinic put on by the local ski shop that does race tunes. I thought that only the expert nerdy skiers in the house would be interested, but everyone was
170.
by paddy_m 2y ago
In the docs for my own project in this space, I created a whole related projects page. I figured if someone makes it to my docs, and buckaroo doesn't solve their problem, they should find something that does help them. https:/&#
171.
by paddy_m 2y ago
I created buckaroo [1] as a better dataframe viewer for jupyter with built in summary stats. It's built to bring a better dataframe experience to people already using pandas/polars. All of it is extensible [2] so that you can cu
172.
by paddy_m 2y ago
Also the Ultimate Wheel. A unicycle without a seat. https://www.youtube.com/watch?v=8WRzqlh3728
173.
by paddy_m 3y ago
Buckaroo started as a lowcode UI with an accompanying table. The low code UI lets you click on columns and perform actions (drop, fillNA, groupby). The dataframe is then modified, AND python code to perform the same action is emitted. Cont
174.
by paddy_m 3y ago
Past a certain table size, the JS libraries will use less memory. DOM elements take a lot of memory. Libraries like ag-grid only render a small portion of the total table at a time. The next performance gain web tables comes from using a
175.
by paddy_m 3y ago
Why do you want to render to canvas? Perspective seems to be the most performant html table. It is more focused on extremely fast updates than styling, although it looks good. Glide is a newcomer that also renders to canvas. https:/&#
176.
by paddy_m 3y ago
It's not AI generated. I have tracked the PR as they have worked on it. From what I have seen, the library has declarative elements that are similar to the grammar of graphics.
177.
by paddy_m 3y ago
Great tables has done some really nice work on python/jupyter tables. It looks like they are almost building a "grammar of tables" similar to a grammar of graphics. More projects should write about their philosophy and aims
178.
by paddy_m 3y ago
Glad to see it includes numpy (and presumably pandas). Getting those to work in constrained serverless environments can be a huge pain.
179.
by paddy_m 3y ago
There were tugs two tugs helping depart the dock and turn, until about 43 seconds in the video. 5:08 AM real time
180.
by paddy_m 3y ago
an outboard? that is very very different because you control the direction of thrust also.

More ›