akbo

4 ms·

1.
by akbo 6y ago
You can stream AVRO records. AVRO is a well defined, binary, space efficient serialization format that can be used to serialize individual records (for streaming) or a whole set of records (for file storage). That should cover all of the au
2.
by akbo 6y ago
I have a different perspective. In a drug trial you have to prove that a new drug is safe before handing it out to a bigger number of people. The default case (if you don't test the drug) is that nobody gets it. In this case, it is dif
3.
by akbo 6y ago
Have you tried remote development with VSCode? IT works really well! https://code.visualstudio.com/docs/remote/ssh
4.
by akbo 6y ago
I love it! What I always missed in, e.g., matplotlib, is the interactivity. I need to be able to zoom in and out without changing code. Hover information is another great feature coming to mind.
5.
by akbo 6y ago
I'll just leave this here: https://en.wikipedia.org/wiki/Ninety-ninety_rule
6.
by akbo 6y ago
This is the corresponding wiki, which is also apparently open source and can be self-hosted and lives in the same GitHub org as the editor: https://github.com/outline/outline
7.
by akbo 6y ago
I see where you're coming from. My use case is this: as a data scientist, I start new code bases all the time. Each project, simple experiment, data analysis, etc. needs its own cleanly separated dependency environment so I don't
8.
by akbo 6y ago
Sounds like you just need to train your colleagues to be a bit more disciplined with their package managing. It's not that hard to be clean about dependencies with conda. Maybe my take on it can inspire you here: https://hav
9.
by akbo 6y ago
Dependency management can be pretty overwhelming for a lot of people entering Python. This is especially true in the data science realm, where many don't have a SWE background. Even after you have selected a tool, it can be easy to use
10.
Why You Don’t Want to Use CSV Files(haveagreatdata.com)
4 points by akbo 6y ago|0 comments
11.
How I Manage Python Dependencies in Data Science Projects(haveagreatdata.com)
1 points by akbo 6y ago|0 comments
12.
by akbo 7y ago
> Also, I'm not sure why you called CSV unsafe. One example of it being unsafe that happened to me: I got a CSV file written by a program with a broken implementation of a CSV writer that didn't quote string fields when there w
13.
by akbo 7y ago
These tools probably do a good job at processing CSV/TSV/DSV (haven't tried them). However, I would love if we could just stop using delimiter-separated value files alltogether. Why? Because the file format is an underspecifi
14.
by akbo 8y ago
If you are interested in grading Sudokus by the difficulty of the human solving techniques required, you might want to check out the following two books: - "Sudoku Programming with C" [ https://www.apress.com/de&#x2