aynyc

7 ms·

61.
by aynyc 1y ago
To me, it's more than just reduce traffic, but a sign that government is investing in its people. In order for a traffic free/minimal zone to thrive, you need policies that promote affordable housing, policing policy that reduces
62.
by aynyc 1y ago
I think the tip here is defined as customer directly to employees. I'm sure an enterprising tax attorney can come up with ways to help your idea.
63.
by aynyc 1y ago
Don’t you wish we have a short sell reporting data so we can check if people in the know already shorted the stock?
64.
by aynyc 1y ago
In the US, the more exotic you are in your genetic make up, the more schools you can get it. That's our gaokao.
65.
by aynyc 1y ago
In the US, north east. Yes, two of my family members just graduated with CS degree and got job offers before the ceremony.
66.
by aynyc 1y ago
Personally, I don't believe they are the same. I view AI as the next natural update to worker productivity like PC and windows. It's like the old days where people put MS Office on their resume as a skill, prompt engineering or wh
67.
by aynyc 1y ago
A year? Yes, 10? Probably not.
68.
by aynyc 1y ago
I would choose time.
69.
by aynyc 1y ago
This is what Ford e-transit could’ve been. Another missed opportunity by Ford.
70.
by aynyc 1y ago
There is almost nothing in today’s Python world that follow that axiom. There is a new package manager every year. Language features are introduced every major release.
71.
by aynyc 1y ago
Just because this doesn’t magically solve the housing crisis, doesn’t mean it’s not a good start. We have to stop looking at magical solutions that will solve all our problems in one shot. We have to start somewhere.
72.
by aynyc 1y ago
The author must be talking about Sprint Kayak, which is incredibly unstable, must be in flat/calm water. Commercial paddling kayaks are incredibly stable, you have to try really, really hard to flip.
73.
by aynyc 1y ago
Is it? It was designed for damage control system on naval combat vessels. I have no idea what it does on a naval vessel, but I imagine there is certain level of safeness.
74.
by aynyc 1y ago
Be grateful of what you have, be hungry for what's ahead. I'm in my mid 40s, willingly neglected personal health for others because they needed more. It worked out and I'm back focusing on myself. I honestly considered myself
75.
by aynyc 1y ago
The scalable way forward is to vote, and to get your friends and family to vote. Not just national, but local elections.
76.
by aynyc 1y ago
What’s your batch size?
77.
by aynyc 1y ago
It’s just another tax cheap code. You won’t see significant change to hiring unless existing management thinking changes
78.
by aynyc 1y ago
I really like databricks at the beginning, Spark clusters magically appear whenever I needed them. No more thoughts were given on how to store the data, etc.. After a few years, I've grown, so did my skill set and my employer. Databric
79.
by aynyc 1y ago
Yes, the jitneys. There is the Hampton Jitneys which transport folks from NYC to the Hamptons during summer months. Those jersey buses are better than NJ Transit.
80.
by aynyc 1y ago
As a long time NYC resident who moved out during Covid but commute to work in the city. I definitely noticed less traffic on the streets and less noise. I see a lot of talk of other cities that don't have good public transportation. Fo
81.
by aynyc 1y ago
eBay is fairly cheap for commodity hardware. Especially the off-lease commercial desktop PCs.
82.
by aynyc 1y ago
Yes, on Athena, we process much larger CSV files. But the cost is too crazy. We also have ORC and Parquet files for other dataset which we process with EMR Spark. I really want to get off those distributed analytic engines whenever possible
83.
by aynyc 1y ago
We have a spark cluster too. Then switch to Athena. I just dislike the cost structure. The problem with disk based partition is keys are difficult to manage properly.
84.
by aynyc 1y ago
I was really surprised duckdb choked on 500GB. That's maybe a week's worth of data. The partitioning of partquet files might be an issue as not all data are neatly partitioned by date. We have trades with different execution dates
85.
by aynyc 1y ago
Wait, do you insert the data from S3 into duckdb? I was just doing select from file.
86.
by aynyc 1y ago
Wait, so I create a new file for every message?
87.
by aynyc 1y ago
I agree. That's how our data is produced. We constantly generate real time data into CSV. As far as I can tell, I can't append to parquet file.
88.
by aynyc 1y ago
No, clickhouse is not considered for some other reason. But I think I might revisit it sometime in the future.
89.
by aynyc 1y ago
No, the EC2 instance doesn't have 500GB of data. Does DuckDB require that? I actually downloaded the data from S3 to local EBS and still choked.
90.
by aynyc 1y ago
How big are the data sets? I've been trying to get duckdb to work in our company on financial transactions and reporting data. The dataset is around 500GB CSV in S3 and duckdb chokes on it.

More ›