bpchaps

31 ms·

271.
by bpchaps 9y ago
Agreed, but it's very unlikely to happen any time soon, though there are definitely things that can be done. If anyone wants to help out in collecting government communications using FOIA, please let me know. It's surprisingly e
272.
by bpchaps 9y ago
+1 for anything by Brendan Gregg. I wasn't aware of the polling limitations of sysdig, but it definitely explains some things I've seen in the past. This is definitely going in my toolkit. Cheers! Edit: dammit, spelled his name wr
273.
by bpchaps 9y ago
Yeah, I wish. I've done >50 FOIA requests for email communications' metadata across the US and one of the more common rejection reasons is specifically that email addresses are NOT public records. Sure, the domain name is, but
274.
by bpchaps 9y ago
Definitely crossed my mind, but I'm working on hosts where installing auditd isn't really easy. Broken yum and apt all over the place makes installing new packages almost impossible. Same goes for lsof, but its installed in "
275.
by bpchaps 9y ago
I'll see about getting it into a public repo soon and let you know.
276.
by bpchaps 9y ago
Yep. I'm specifically writing it to find any log file that isn't being pushed into our third party logging service. It's a surprisingly difficult problem, especially considering the amount of tech sprawl that's accumulat
277.
by bpchaps 9y ago
The code is behind my company's GH, but here's a rewrite of the collector script: https://github.com/red-bin/lsofer/blob/master/lsofer.sh
278.
by bpchaps 9y ago
Hah, apparently.
279.
by bpchaps 9y ago
Nice! I'm actually working on a similar project to push lsof and files from /proc into some postgres tables. Lets me do cool things like query log files across a ~6000 server infrastructure similar to: SELECT distinct(l.name)
280.
by bpchaps 9y ago
I'd be very interested if something like this could work well to complement the existing "civic tech" field. It has some pretty substantial problems in its current form and a movement towards co-ops looks pretty damn appealin
281.
by bpchaps 10y ago
Protip: Put your non-dominant hand over your dominant hand instead of locking your fingers together. That way if something falls on you, your dominant hand won't be crushed.
282.
by bpchaps 10y ago
I once raised a support ticket for a public SaaS printer that wasn't printing a resume. Not too long after, the tech on the other end tried to recruit me. Lesson learned to never use public printers.
283.
by bpchaps 10y ago
I've been doing it this way for years and it really, really works. Some places have reservations with it since its lack of formality is considered "risky" by some. Though, an alternative to switching to another language is us
284.
by bpchaps 10y ago
Agreed. It's probably save me over 100 hours of work in the past two months.
285.
by bpchaps 10y ago
In the Clojure side of things, I recently used this [1] to scrape/parse ~4m pages in a few hours. It's very plug-and-play, but maintains a pretty decent amount of extensibility. Parsing using Tika turned out to be extremely useful
286.
by bpchaps 10y ago
Been there, and can confirm. Six months of a restricted diet for $probably_similar_reasons does some interesting things to you. The body aches were definitely some of the worst parts, but for me, the worst part was the mental garbage that r
287.
by bpchaps 10y ago
So... is this good reason to stop posting WSJ on HN yet?
288.
by bpchaps 10y ago
Cool if I shoot a message to the address in your profile?
289.
by bpchaps 10y ago
Hey there! A big part of my project is to make FOIA a bit more accessible for larger scale requests, where $5 per-request would be a bit out of the question. I realize that FOIA machine can do a lot of that, but there's a pretty large
290.
by bpchaps 10y ago
Hey! Your API's been in the back of my head for a while now, so the help would be phenomenal. What's the best way to reach you?
291.
by bpchaps 10y ago
(I'm attempting to make something that does something similar, if anyone's interested in helping out in any way.)
292.
by bpchaps 10y ago
Fair enough. My personal workaround (though, hacky, I guess) is to use screen for preserving the shell. It has a slight advantage of being more accessible, since more people know screen than tmux.
293.
by bpchaps 10y ago
Well, I think a lot of it is because not everyone has historically had emacs mode defaulted in their shell. Lots of people who learned to use the shell in ksh (myself included) probably share similar feelings towards the emacs bindings. Wit
294.
by bpchaps 10y ago
I do 90% ops stuff and never have this issue with tmux, so I'm curious what your workflow's like. Why not just have tmux running on your host machine and ssh from a tmux window?
295.
by bpchaps 10y ago
Oh, hm. I reread it, and it still kind of looks like that's what you're implying. I guess I don't really understand the overall point you're trying to make outside of anecdata. Sorry :\.
296.
by bpchaps 10y ago
The absolute best interviews I've ever had either received no callback, or I was told that a better candidate was hired. Could you share your thoughts on why you think it was a race issue?
297.
by bpchaps 10y ago
This has been my experience with trying to get a foothold in the technical civics communities, so I don't think it's either. I've found that the bar gets set pretty high by folks who are willing to speak loudly about their ac
298.
by bpchaps 10y ago
Nice plug for gitlab ;). \0 is an insanely useful separator for this sort of thing and yeah, it definitely gets messy. I'm working on a similar project that uses clojure/chef to read proc files in a way that causes as little overh
299.
by bpchaps 10y ago
How does this help in situations where something rogue starts filling the disk? The idea makes sense in theory, but in practice, it doesn't work out that well. Ops work is significantly harder than many devs think..
300.
by bpchaps 10y ago
I'm curious, too. Proper disk space management and monitoring is probably the most difficult problem I know of in the ops field. I haven't seen anybody do it in a way that prevents 3am wakeup calls or a 24/7 ops team. For exa

More ›