ayazhan

8 ms·

31.
by ayazhan 6y ago
it's on our roadmap and will try to add support for multiple files and zip in the upcoming release
32.
by ayazhan 6y ago
- we use pandas to process data and load it to Postgres using .to_sql ( https://pandas.pydata.org/pandas-docs/stable/reference/api/p... ). for incremental loads, we set "if_exists" to "appen
33.
by ayazhan 6y ago
Thank you so much! Yes, we will offer non-profit and academic plans.
34.
by ayazhan 6y ago
I agree, parquet cannot be ignored and we're planning to support it. What would you be interested more in: loading data from parquet files or converting and storing your data in parquet?
35.
by ayazhan 6y ago
Spreadsheet view for all your data is on our roadmap. Integrating into user's file system is something we'll definately explore, it sounds quite interesting. These are great suggestions, thank you!
36.
by ayazhan 6y ago
yes, you can run regular sql queries on your database where you can join/group tables. if you want to join/group static files (like csv/excel), then you'd need import your files into dropbase DB first and then run sql qu
37.
by ayazhan 6y ago
Hey HN, We're happy to introduce Dropbase 2.0! It's a tool that helps you bring offline files, such as CSV, Excel, and JSON files, into Postgres database. You can also process your data before uploading it using a spreadsheet-like
38.
by ayazhan 6y ago
good idea, we'll add db connection string to credential details. yes, we were also thinking about converting multiple csvs into multiple table, it's on the roadmap. thanks for suggestions!
39.
by ayazhan 6y ago
Hey HN, we built a tool that uploads CSV files to a hosted PostgreSQL and gives you database credentials to query it. We recently built a number of database integrations for one of our products and had to manually create test databases with
40.
by ayazhan 7y ago
Thank you for recommending these! Our problems is not related to Lambda functions though, they can run for minutes. It is the API Gateway that shuts the connection after 30 seconds. We might just need to build our own web server.
41.
by ayazhan 7y ago
Great advice! We'll give it a try, thank you!
42.
by ayazhan 7y ago
Will do, thanks for advice!
43.
by ayazhan 7y ago
This is cool! Our vision is to simplify this experience with intuitive visual tools and advanced features, such as versioning, data governance, saved queries, and more.
44.
by ayazhan 7y ago
Thanks! 1. Yes, We learned that pretty quickly. Especially when working on postgres and mongoDB. And this is the value we’re trying to deliver. As a user, you don’t have to know technical differences between databases and query them all the
45.
by ayazhan 7y ago
Yes, data is returned directly from lambda. We’re working on the pro version and enterprise versions that will run queries in the backend and update sheets as you described. For that, we’d need to request for additional scopes, to be able t
46.
by ayazhan 7y ago
Ok, sounds good. we'll keep it generic and won't mention the source. Thank you for sharing! We think this is something AI companies can benefit from in the future.
47.
by ayazhan 7y ago
Thanks for your feedback ohazi! You are right that “No system should ever fail silently” and there are many ways to address this. However, we’ve seen cases where not enough attention is put into input data pipelines and similar mistakes are
48.
by ayazhan 7y ago
Thanks nostrademons, these are great examples. You're right, name and email are just for illustration. Would you mind if we use your feedback and some of your examples to improve the article? If yes, should we credit your HN account?
49.
by ayazhan 7y ago
In this article, we showed a scenario where a small change to the front-facing interface could dramatically reduce the accuracy/performance of a machine learning model powering the application