Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
westandskif
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
20 ms
·
1.
▲
Show HN: Pydantic-based RPC with autogenerated TypeScript client
(synclane.readthedocs.io)
1 points
by
westandskif
3y ago
|
0 comments
2.
▲
Show HN: Table data stream processing – Python convtools
(convtools.readthedocs.io)
1 points
by
westandskif
5y ago
|
0 comments
3.
▲
Show HN: Everyday-use client-side map-aware Arch Linux mirror ranking tool
(github.com)
2 points
by
westandskif
6y ago
|
0 comments
4.
▲
by
westandskif
6y ago
https://github.com/itechart-almakov/convtools/
5.
▲
Show HN: Python convtools library – code generation for data transforms
(convtools.readthedocs.io)
8 points
by
westandskif
6y ago
|
2 comments
6.
▲
by
westandskif
6y ago
supports aggregations, joins + now optional collection items
7.
▲
by
westandskif
7y ago
Just to add my previous answer: the trivial native python equivalent doesn't have the same functionality, because it consumes data iterator 3 times in your case, while convtools would consume it only once.
8.
▲
by
westandskif
7y ago
Re: whether it's been a problem in my experience -- sort of - yes So now I'm doing my best to observe: PEP-20 the 2nd commandment with the hope that I'm not violating the 1st commandment badly :) https://www.python
9.
▲
by
westandskif
7y ago
In terms of the implementation, it's kind of trivial to implement the "magic", but it would be both confusing and inconsistent, see below. e.g. imagine a case where you'd want to call datetime.strptime, partially initial
10.
▲
by
westandskif
7y ago
We would need to bring the whole python into it :/
11.
▲
by
westandskif
7y ago
Pandas are great, but I had a few cases where I had frustrating experience -- dealing with Decimal & float columns is a pain (missing data without any signs when using both in calculations). However this was not the reason why I needed
12.
▲
by
westandskif
7y ago
It's not possible to skip the code generation part because a resulting converter is always compiled from the code written under the hood. Could you please share what is your concern about this? I'd really like to better understand
13.
▲
by
westandskif
7y ago
On exception it populates linecache so that tracebacks are normal and you can debug it normally with pdb post-mortem debugging - https://docs.python.org/3/library/pdb.html#pdb.post_mortem Nothing else at the momen
14.
▲
by
westandskif
7y ago
Thank you! I will add join and group_by examples shortly
15.
▲
by
westandskif
7y ago
oh, thanks, I'll add links to cheatsheet and quickstart pages to the README, it really makes sense! As for the magic-stuff, I was contemplating designing the API with this approach, but I changed my mind because it would be difficult t
16.
▲
by
westandskif
7y ago
thank you very much for the feedback! this is very valuable! :) Regarding the README, I'll improve it within the next few days. As for the approach, the main assumption was that everything is simple as long as you deal with expressions
17.
▲
Show HN: ConvTools – generates Python code of conversions, aggregations, joins
(github.com)
67 points
by
westandskif
7y ago
|
25 comments