4 ms·

Steampipe (https://steampipe.io https://steampipe.io) is an open source CLI to query cloud infrastructure using SQL (e.g. AWS, GitHub, Slack, k8s, etc). It also

Steampipe (https://steampipe.io https://steampipe.io) is an open source CLI to query cloud infrastructure using SQL (e.g. AWS, GitHub, Slack, k8s, etc). It also has a HCL language to define security benchmarks and controls (e.g. AWS CIS, etc). We are a Postgres FDW under the hood with Go-based plugins, so write would be possible, but we've chosen to focus on read only so far. Definitely interested to see how you approach create, update and delete in the SQL model! Notes: Not related to iasql. I'm a lead on the Steampipe project.

heinrichhartman 5y ago
Neat. Does that use steampipe services/API under the hood, or does it consume the AWS/GigHub APIs/... directly?
- nathanwallace 5y ago
  It talks directly to the cloud provider APIs. Plugins are written in go-lang (similar to Terraform providers). OSS plugins - https://github.com/topics/steampipe-plugin https://github.com/topics/steampipe-plugin Docs - https://hub.steampipe.io/plugins https://hub.steampipe.io/plugins
  - heinrichhartman 5y ago
    WOOT! That's awesome.
Aaronstotle 5y ago
As someone who has to do lots of compliance activities, this is a fantastic tool, thanks!
- nathanwallace 5y ago
  Great to hear :-) Please check out our open source mods (e.g. AWS Compliance, GitHub Sherlock, DigitalOcean Thrifty) - we'd love your feedback & help! https://hub.steampipe.io/mods https://hub.steampipe.io/mods
  - Aaronstotle 5y ago
    Will do! Thanks again
  - dddw 5y ago
    Ooh this looks really powefull, any plans to add hetzner and backblaze?
    - nathanwallace 5y ago
      Both seem to have reasonable Go SDK libraries, so it should be easy to create new plugins for them. I've added them to our internal backlog, but all our plugins are open source if you'd like to try building it yourself! The Linode plugin is a simple, similar example to use as a starting point [1]. We also have docs for writing plugins [2]. 1 - https://github.com/turbot/steampipe-plugin-linode https://github.com/turbot/steampipe-plugin-linode 2 - https://steampipe.io/docs/develop/writing-plugins https://steampipe.io/docs/develop/writing-plugins
yaldasoft 5y ago
We are using steampipe to connect 30 AWS accounts via SQL. In a single call we can query all our services. Using metabase to visualise it all. I highly recommend you give it a go
- nathanwallace 5y ago
  Awesome! Would love to hear more about your use case and any suggestions for improvements if you want to DM me.
- kspyy 5y ago
  How are you making the metabase<-->steampipe connection? Are you able to connect metabase directly to a running steampipe/ postgres server instance? or are you doing some ETL into metabase. Thanks in advance (metabase is new to me, but steampipe has been really handy)
  - nathanwallace 5y ago
    Use `steampipe service start` to run Steampipe in the background [1]. It will print out a standard Postgres connection string running on port 9193 of your local machine. You can then simply point Metabase (or any other DB visualization tool) at it using the standard Postgres setup. 1 - https://steampipe.io/docs/using-steampipe/service https://steampipe.io/docs/using-steampipe/service

heinrichhartman 5y ago

Neat. Does that use steampipe services/API under the hood, or does it consume the AWS/GigHub APIs/... directly?

nathanwallace 5y ago
It talks directly to the cloud provider APIs. Plugins are written in go-lang (similar to Terraform providers). OSS plugins - https://github.com/topics/steampipe-plugin https://github.com/topics/steampipe-plugin Docs - https://hub.steampipe.io/plugins https://hub.steampipe.io/plugins
- heinrichhartman 5y ago
  WOOT! That's awesome.

Aaronstotle 5y ago

As someone who has to do lots of compliance activities, this is a fantastic tool, thanks!

nathanwallace 5y ago
Great to hear :-) Please check out our open source mods (e.g. AWS Compliance, GitHub Sherlock, DigitalOcean Thrifty) - we'd love your feedback & help! https://hub.steampipe.io/mods https://hub.steampipe.io/mods
- Aaronstotle 5y ago
  Will do! Thanks again
- dddw 5y ago
  Ooh this looks really powefull, any plans to add hetzner and backblaze?
  - nathanwallace 5y ago
    Both seem to have reasonable Go SDK libraries, so it should be easy to create new plugins for them. I've added them to our internal backlog, but all our plugins are open source if you'd like to try building it yourself! The Linode plugin is a simple, similar example to use as a starting point [1]. We also have docs for writing plugins [2]. 1 - https://github.com/turbot/steampipe-plugin-linode https://github.com/turbot/steampipe-plugin-linode 2 - https://steampipe.io/docs/develop/writing-plugins https://steampipe.io/docs/develop/writing-plugins

yaldasoft 5y ago

We are using steampipe to connect 30 AWS accounts via SQL. In a single call we can query all our services. Using metabase to visualise it all. I highly recommend you give it a go

nathanwallace 5y ago
Awesome! Would love to hear more about your use case and any suggestions for improvements if you want to DM me.
kspyy 5y ago
How are you making the metabase<-->steampipe connection? Are you able to connect metabase directly to a running steampipe/ postgres server instance? or are you doing some ETL into metabase. Thanks in advance (metabase is new to me, but steampipe has been really handy)
- nathanwallace 5y ago
  Use `steampipe service start` to run Steampipe in the background [1]. It will print out a standard Postgres connection string running on port 9193 of your local machine. You can then simply point Metabase (or any other DB visualization tool) at it using the standard Postgres setup. 1 - https://steampipe.io/docs/using-steampipe/service https://steampipe.io/docs/using-steampipe/service