3 ms·

Can Clickhouse local query from files on AWS S3? We recently had some issues querying parquet files on AWS S3. I tried benchmarking various tools and DuckDB se

• qoega 4y ago
  Sure you can read from S3. You can define table that will look at your files like this https://clickhouse.com/docs/en/integrations/s3/s3-table-engine/ https://clickhouse.com/docs/en/integrations/s3/s3-table-engi... Or just use s3 table functions https://clickhouse.com/docs/en/integrations/s3/s3-table-functions/#reading-data-from-s3 https://clickhouse.com/docs/en/integrations/s3/s3-table-func... You can use it as a command line tool running one query at a time or in interactive mode.
  • denvrede 4y ago
    Do you know if it's possible to tell clickhouse-local (without the need of a config file) to use environment variables for AWS authentication? I know there is the "use_environment_credentials" property in the config, but I really don't want to create a config for easy use-cases like just querying some data in a private S3 bucket.