5 ms·
We just added Clickhouse sink support to SQLFlow: - https://github.com/turbolytics/sql-flow/issues/100 https://github.com/turbolytics/sql-flow/issues/100 - ht
by dm03514 2y ago
We just added Clickhouse sink support to SQLFlow:
- https://github.com/turbolytics/sql-flow/issues/100 https://github.com/turbolytics/sql-flow/issues/100
- https://github.com/turbolytics/sql-flow/pull/116 https://github.com/turbolytics/sql-flow/pull/116
The Clickhouse python API made this trivial thanks to supporting Arrow!
We have a tutorial explaining how to stream data from Kafka to Clickhouse using SQLFlow:
https://sql-flow.com/docs/tutorials/clickhouse-sink https://sql-flow.com/docs/tutorials/clickhouse-sink
Local benchmarks show 70,000 rows / second insert using a batch size of 50k!