nathanwallace

14 ms·

91.
by nathanwallace 5y ago
Both seem to have reasonable Go SDK libraries, so it should be easy to create new plugins for them. I've added them to our internal backlog, but all our plugins are open source if you'd like to try building it yourself! The Linode
92.
by nathanwallace 5y ago
Awesome! Would love to hear more about your use case and any suggestions for improvements if you want to DM me.
93.
by nathanwallace 5y ago
Great to hear :-) Please check out our open source mods (e.g. AWS Compliance, GitHub Sherlock, DigitalOcean Thrifty) - we'd love your feedback & help! https://hub.steampipe.io/mods
94.
by nathanwallace 5y ago
It talks directly to the cloud provider APIs. Plugins are written in go-lang (similar to Terraform providers). OSS plugins - https://github.com/topics/steampipe-plugin Docs - https://hub.steampipe.io/pl
95.
by nathanwallace 5y ago
Steampipe ( https://steampipe.io ) is an open source CLI to query cloud infrastructure using SQL (e.g. AWS, GitHub, Slack, k8s, etc). It also has a HCL language to define security benchmarks and controls (e.g. AWS CIS, etc). We ar
96.
by nathanwallace 5y ago
It's a pure plugin model, none built in. On the home page we considered data source ~= API ~= table, sorry if that was not clear. I expanded more on this at https://news.ycombinator.com/item?id=28229700 . Having said th
97.
by nathanwallace 5y ago
I really appreciate that, we're working hard to make it as developer friendly as possible. If you (or anyone else here) can spare a few mins to discuss use cases for Steampipe in data pipelines please drop me a note (email in bio)!
98.
by nathanwallace 5y ago
Agreed. Unfortunately requirements for long term management / large scale deployment aren't a priority until a tool is widely adopted, which is best achieved by keeping it simple. An interesting trade off...
99.
by nathanwallace 5y ago
A completely fair point ... and one we debated at length. Ultimately we decided that the convenience for users and documentation of a single location outweighed the benefits of following the basedir spec, particularly when deployed across o
100.
by nathanwallace 5y ago
Steampipe is a new project we launched in Jan 2021. Turbot is leading the build, and has been working with cloud APIs since 2014. We're bootstrapped, and have a lot less than 100 people, but are hiring (engineering, marketing, tech wri
101.
by nathanwallace 5y ago
We currently have 37 open source plugins [1] like AWS, GCP, GitHub, Kubernetes, Hacker News, etc. More are in development by Turbot and community members [2]. Each plugin has many tables, e.g. 223 for AWS [3], 23 for GitHub [4]. The 200+ on
102.
by nathanwallace 5y ago
YOW! Data 2021 ( https://yowconference.com/data/ ) was an online conference held in May. Talks are all now available on YouTube ( https://www.youtube.com/playlist?list=PLIpl4GKFQR6e2iVY2DZbp... ).
103.
by nathanwallace 5y ago
If you are interested in Postgres FDWs, please check out Steampipe ( https://steampipe.io ). It's an open source project with a Go-based plugin model (similar to Terraform) to instantly query cloud services (AWS, GCP, GitHub,
104.
by nathanwallace 5y ago
Agree that adding NIST controls would be great - so far we've focused on CIS, PCI and HIPAA.
105.
by nathanwallace 5y ago
That's exactly one of the use cases we are targeting. Beyond the standard benchmarks, Steampipe has a simple HCL + SQL language to write your own controls [1]. It feels like writing Terraform, but is for operational and security contro
106.
by nathanwallace 5y ago
Steampipe has open source cost and compliance mods for AWS, Azure, GCP, GitHub and Zoom. Full docs are available at https://hub.steampipe.io/mods Disclaimer - I'm a lead on the team. We'd love your feedback and ar
107.
by nathanwallace 5y ago
Steampipe automatically installs and manages an embedded Postgres instance for you. It's shocking how lightweight that is - another way in which Postgres is awesome. Running "steampipe query" will start and run embedded Postg
108.
by nathanwallace 5y ago
As a child in Australia we had Danish backpackers come to stay at our place. I recall taking one set of visitors to the zoo, and specifically to see the Platypus since such an animal seemed too strange to be real. Thing is, the enclosure wa
109.
by nathanwallace 5y ago
If you like SQL interfaces then please also checkout Steampipe ( https://steampipe.io ). Use SQL to instantly query cloud resources like AWS, GitHub, Yahoo Finance, etc (no CSV yet). It's written in Go and uses Postgres Forei
110.
by nathanwallace 6y ago
I wrote a Postgres FDW in Go to query Twitter using SQL - https://hub.steampipe.io/plugins/turbot/twitter (Steampipe is an open source CLI to query cloud APIs using SQL. No DB required!)
111.
by nathanwallace 6y ago
Use SQL to query Hacker News with Steampipe - https://hub.steampipe.io/plugins/turbot/hackernews It's an open source Postgres FDW using Go - https://github.com/turbot/steampipe-plugin-hac
112.
by nathanwallace 6y ago
Cross-region replication of data is always significantly harder, definitely consider if cross-AZ would be sufficient for your case (which it often is). Postgres can definitely be configured for a cross-region scenario, but the approach vari
113.
by nathanwallace 6y ago
Postgres is incredibly flexible and scales beyond what most projects will ever need. We use it both as a very large scale CMDB store for https://turbot.com and as an small embedded DB for https://steampipe.io . Use ca
114.
by nathanwallace 6y ago
Joins are supported, both between the cloud tables and with local data. Local data can be created in the public schema, which is available for writing & table creation. Writing & updates to cloud tables are not supported. It works u
115.
by nathanwallace 6y ago
Agree! We've just been doing a simple Spotify playlist before all hands, shared over Zoom. Works great with everyone just quietly hanging out together for a while and sets the mood for the meeting. Most recent was a 1992 theme for our
116.
by nathanwallace 6y ago
True. It was an incredibly powerful model, but developers like files they can see. I mentioned in my earlier comment a "hand-drawn diagram of the architecture" - it was in fact a picture of the exact layout of this database includ
117.
by nathanwallace 6y ago
Fun fact ... "VisualAge for Java was implemented in Smalltalk and the Team facility used ENVY/Developer under the hood" [1]. Of course eventually that product and team morphed into Eclipse. I was lucky enough to play as small
118.
by nathanwallace 8y ago
Career change is often best one variable at a time. For example, change company size but stay in the same industry. Double jumps are generally harder. Perhaps, focus on startups that reduce the number of change variables. For example, start
119.
by nathanwallace 11y ago
The Google Calculator returns incorrect results for the range: 16384.69 - 16384.58 (0.10999999999) 16385.69 - 16385.58 (0.10999999999) ... 32766.69 - 32766.58 (0.10999999999) 32767.69 - 32767.58 (0.10999999999) Results are co
120.
Google Calc floating point error: 16384.69-16384.58=0.10999999999(google.com)
1 points by nathanwallace 11y ago|4 comments

More ›