nathanwallace

11 ms·

61.
by nathanwallace 4y ago
We see users running Steampipe on their desktop, in pipelines (e.g. to scan Terraform files) and also as a central service. See "service mode" in the CLI for a Postgres endpoint and a dashboard web server [1] or try docker /
62.
by nathanwallace 4y ago
I'm biased, but writing plugins is really fun - and then you can create mods / dashboards for your users as well! Please give it a go - we have a guide [1], 84+ open source plugins to copy [2], many authors in our Slack community
63.
by nathanwallace 4y ago
Because it's just PostgreSQL, Steampipe works out of the box with SQL clients, BI tools and other integrations [1]. Please let us know how you go! 1 - https://steampipe.io/docs/query/third-party
64.
by nathanwallace 4y ago
Glad AWS worked. Sorry you hit a bump with tailscale - we'd love feedback / contributions for that plugin [1], we just released it this month so may be edges for more complex configurations :-( 1 - https://github.com&#x
65.
by nathanwallace 4y ago
"steampipe query" has auto-complete for SQL queries in the interactive terminal - https://steampipe.io/docs/query/query-shell#autocomplete "steampipe service" is a standard Postgres endpoint, s
66.
by nathanwallace 4y ago
Steampipe mostly exposes underlying APIs or data through SQL. So, "select * from aws_s3_bucket" will return bucket names, tags, policies, etc all together. But, bucket size is not a direct API so doesn't have a direct table.
67.
by nathanwallace 4y ago
Steampipe installs Postgres as an embedded database under the hood. We found that the initdb step kept failing on WSL1 and couldn't find a way to make it work (yet). Similar reports on StackOverflow below [1] [2]. Suggestions or PRs wo
68.
by nathanwallace 4y ago
You can run Steampipe CLI in "service mode", getting access to a Postgres endpoint and a dashboard web server [1]. Other users leverage docker / kubernetes to run it [2]. We also have a cloud hosted option with dashboard host
69.
by nathanwallace 4y ago
You kid, but we found that useful for scripts etc! So, in addition to a secure public Postgres endpoint [1], Steampipe Cloud workspaces have a rest API to run SQL queries and get results in JSON or other formats [2]. 1 - https://
70.
by nathanwallace 4y ago
Completely separate projects, with different goals. IaSQL is focused on infrastructure as code (like Terraform) in SQL. Steampipe is an "ops as code" platform to query, visualize and report on all your DevOps data (infra, SaaS, Ia
71.
by nathanwallace 4y ago
Yes - our users run queries across hundreds of AWS accounts and regions. TBH, we never expected it to scale that far when we started, but it has. Steampipe parallelizes the API calls out and performs appropriate backoff in throttling to gat
72.
by nathanwallace 4y ago
Yes, we've focused on SELECT for read only - which provides a lot of value as a "universal API" to live query these many sources. Steampipe is built on Postgres Foreign Data Wrappers [1] under the hood, so could be extended t
73.
by nathanwallace 4y ago
Excited to see Steampipe shared here - thanks kiyanwang! I'm a lead on the project, so sharing some quick info below and happy to answer any questions. Steampipe is open source [1] and uses Postgres foreign data wrappers under the hood
74.
by nathanwallace 4y ago
Readers may also enjoy Steampipe [1], an open source CLI to live query Stripe [2] and 80+ other services with SQL (e.g. AWS, GitHub, CSV, AirTable, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc across th
75.
by nathanwallace 4y ago
Readers may also enjoy Steampipe [1]. It's an open source "ops as code" CLI to query 83+ services with SQL (AWS, GitHub, Terraform, etc) that comes with hundreds of ready to use benchmarks (CIS, NIST, Cost) and dashboards bui
76.
by nathanwallace 4y ago
The Steampipe open source project and community are managed by Turbot [1]. We also have Steampipe Cloud [2] in preview if you'd prefer a hosted version focused on teams. 1 - https://turbot.com 2 - https://cloud.s
77.
by nathanwallace 4y ago
Readers may also enjoy Steampipe[1], an open source [2] tool that uses Postgres FDW's for live SQL queries against Jira, Confluence, GitHub, GitLab, AWS, Slack and many more tools [3]. 1 - https://steampipe.io 2 - https:&#
78.
by nathanwallace 4y ago
Steampipe [1] is an open source Postgres Foreign Data Wrapper with 73 plugins [2] including Google Sheets support [3]. A lot of our users use it to connect custom metadata with other systems - e.g. join ownership info in Google Sheets with
79.
Dashboards as Code with HCL and SQL(steampipe.io)
16 points by nathanwallace 5y ago|0 comments
80.
Why Steampipe over Boto3(medium.com)
1 points by nathanwallace 5y ago|0 comments
81.
by nathanwallace 5y ago
Turbot [1] is a bootstrapped company since 2014. Our namesake product is a cloud governance platform with a real-time CMDB, identity suite, policy engine and thousands of automated operations for tagging, security, deployment, etc. Steampip
82.
by nathanwallace 5y ago
Yes, the CLI, FDW, plugins and mods are all open source. Please let us know how you go - we thrive on feedback :-)
83.
by nathanwallace 5y ago
Steampipe [1] is an open source [2] project that uses Postgres FDWs to query 67+ cloud services (e.g. AWS, GitHub, Prometheus). The plugins [3] are written in Go similar to Terraform. We've found this approach very effective for DevOps
84.
by nathanwallace 5y ago
Steampipe [1] is an open source CLI to query cloud APIs (e.g. AWS, GitHub, Kubernetes) with SQL. It uses an embedded Postgres instance internally and is built with Foreign Data Wrappers. We install and leverage the Zonky Embedded Postgres B
85.
by nathanwallace 5y ago
AWS is trying to do this with Cloud Control [1]. It's a common interface for resource inventory and provisioning and seems to come out of internal APIs for the CloudFormation service. It currently seems better suited to provisioning us
86.
by nathanwallace 5y ago
Hi - I'm a lead on the Steampipe ( https://steampipe.io ) project. Rate limits are definitely an interesting challenge, but actually less of an issue for AWS than many of our other plugins. Because rate limits are separate ac
87.
Querying AWS at scale across APIs, regions, and accounts(aws.amazon.com)
84 points by nathanwallace 5y ago|12 comments
88.
Deep dive into AWS Cloud Control for asset inventory(steampipe.io)
5 points by nathanwallace 5y ago|0 comments
89.
by nathanwallace 5y ago
Use `steampipe service start` to run Steampipe in the background [1]. It will print out a standard Postgres connection string running on port 9193 of your local machine. You can then simply point Metabase (or any other DB visualization tool
90.
by nathanwallace 5y ago
I mentioned Steampipe [1] above, it has an open source OCI plugin [1] to query resources (no support for write operations). It's a Postgres FDW under the hood, and uses subset of Postgres types (bool, bigint, double, text, inet, cidr,

More ›