11 ms·

Good CI/CD and SRE Blogs

207 points by 100011_100001 4y ago

Are there any good blogs that focus on CI/CD pipelines and SRE without a ton of fluff? I feel like the space moves fast, and I need a way to keep up with it better. In an ideal world I would want to see best practices for different tools, and pipelines so I can evaluate them and adopt what makes sense.

timcavel 4y ago
adamgordonbell 4y ago
I'm not sure about SRE specific or CI specific writing but at risk of answering another question, here's what comes to mind for me. In the Operations space my favorite writer is Charity Majors, although a lot of what she talks about isn't OPs specific: https://charity.wtf/ https://charity.wtf/ Rachel by the Bay is also great: https://rachelbythebay.com/w/ https://rachelbythebay.com/w/ Totally not related, but Phil Eaton's posts on how databases work are super interesting and lack fluff. https://notes.eatonphil.com/ https://notes.eatonphil.com/ In terms of CI and builds, I try to write some on this topic for the Earthly Blog. My Bazel article was recently on Hn. Here are my posts: https://earthly.dev/blog/authors/adam/ https://earthly.dev/blog/authors/adam/ Warning though, I also write about lots of other stuff. Are there specific CI topics you'd like to see covered?
- hashar 4y ago
  > https://earthly.dev/blog/bazel-build/ https://earthly.dev/blog/bazel-build/ That is a good read thank you.
- eatonphil 4y ago
  Kind of you to share, Adam! You have awesome podcast episodes as well!
eliranw 4y ago
Good question, would love to also know about some great blogs
excitednumber 4y ago
Same. Even just a maintained “start to finish” of what someone thinks is current best practice for project development would be a fantastic resource.
oneplane 4y ago
The biggest issue (for me when writing about it) is that it's really hard to do this when most keys and values in any source or screenshot are internal to the company. I could go and clean it up with placeholder data, but at that point I'm essentially doing my work twice.
privacywiki 4y ago
Check this out if you are into podcasts; https://sre.google/prodcast/ https://sre.google/prodcast/
TotoHorner 4y ago
- Quastor (https://www.quastor.org/ https://www.quastor.org/) - Moreso focused on backend engineering but they have a lot of SRE content too. It's a newsletter that looks at all the big tech engineering blogs and sends out summaries of the interesting posts. - SRE Weekly (https://sreweekly.com/ https://sreweekly.com/) - Curation newsletter on interesting links in SRE - SRE Prodcast (https://sre.google/prodcast/ https://sre.google/prodcast/) - Good podcast by Google on SRE. They pick a specific topic and then interview an expert on that so each episode is well focused. They also provide transcripts so you can just read through it instead of listening. - Resilience in Action (https://podcasts.apple.com/us/podcast/resilience-in-action/id1506828506 https://podcasts.apple.com/us/podcast/resilience-in-action/i...) - Another good podcast on SRE with interviews. If you just want a listen of resources, then you should check out the Awesome SRE repo on github - https://github.com/dastergon/awesome-sre https://github.com/dastergon/awesome-sre
- 100011_100001 4y ago
  Good stuff. Thanks. This seems to be along the lines of what I was looking for.
- ankaAr 4y ago
  Nice, thanks!
- ngauje 4y ago
  Great list, I propose 2 young YT channels that worth watching about reliability and observability - Slight Reliability (https://www.youtube.com/c/SlightReliability https://www.youtube.com/c/SlightReliability) Podcast from Stephen TOWNSHEND - Is it Observable (https://www.youtube.com/c/IsitObservable https://www.youtube.com/c/IsitObservable) from Henrik REXED
dev_0 4y ago
No Martin Fowler please. He doesn't work on real projects now
- 411111111111111 4y ago
  Martin Fowler has never worked in ci/CD and SRE, nor has he ever written anything on the subject.
  - dev_0 4y ago
    https://martinfowler.com/tags/continuous%20delivery.html https://martinfowler.com/tags/continuous%20delivery.html Wrong
    - Rexxar 4y ago
      It doesn't seems surprising a 2006 article is not up to date with latest ideas.
    - 411111111111111 4y ago
      Damn, i stand corrected. I've never come across any of these articles, even though I quiet often came upon his programming articles. Sorry for my ignorance.
- solarengineer 4y ago
  While it is true that Martin is not a full-time programmer, all his blog posts are reviewed in our software development mailing list. He solicits opinions, introduces amendments based on feedback and has on ocassion even stepped back from publishing an article. (Source: I am a Thoughtworker since 2006).
  - dev_0 4y ago
    His blogs are marketing for Thoughtworks......How things are in theory is different from the actual practices....
jeffwask 4y ago
https://www.youtube.com/c/AntonBabenkoLive https://www.youtube.com/c/AntonBabenkoLive
ledgerdev 4y ago
I like the tiny devops guy, lots of practical talk. https://www.youtube.com/channel/UC5UfX0EgUWlcdQ2RDsq_fcA https://www.youtube.com/channel/UC5UfX0EgUWlcdQ2RDsq_fcA https://jhall.io/media/ https://jhall.io/media/
sluongng 4y ago
I started a series recently https://sluongng.hashnode.dev/series/bazel-in-ci https://sluongng.hashnode.dev/series/bazel-in-ci with focus on setting up Bazel in CI. But I has been trying to write more about CI and the culture around DevX more than Bazel to provide the context for future posts.
oxff 4y ago
It seems always to be too specific to an org. to have a general transferable knowledge to share? Kind of.
- 100011_100001 4y ago
  Some specifics sure. I'm looking more into general trends like when creating a Docker image it's a good idea to X, Y, Z and we use this tool to satisfy X. Or Docker images have K, L problems that Podman doesn't have. However Podman has W issue so you have to decide which pain you want to live with. That kind of stuff.
upg1979 4y ago
Check this repo for SRE https://github.com/upgundecha/howtheysre https://github.com/upgundecha/howtheysre
tomfern 4y ago
I write a lot about CI/CD at my job (unsurprising as we are a CI service). While we do have some articles about our platform itself, most of the articles you'll find are more general: https://semaphoreci.com/category/engineering https://semaphoreci.com/category/engineering We also have a podcast about engineering that frequently touches CI/CD as a topic: https://semaphoreci.com/podcast https://semaphoreci.com/podcast
- tomfern 4y ago
  You'll find that most articles touch CI/CD if they are not outright about CI/CD fundamentals.
la_fayette 4y ago
https://m.youtube.com/c/TechWorldwithNana https://m.youtube.com/c/TechWorldwithNana
brettanomyces 4y ago
https://medium.com/wise-engineering/state-of-our-ci-cd-pipeline-part-1-dd5467803718 https://medium.com/wise-engineering/state-of-our-ci-cd-pipel... Disclaimer: I work for Wise
- 100011_100001 4y ago
  Out of curiosity, I see that opening a PR triggers an automatic branch build, when the code is merge into master is your build process repeated? If not, which is what the diagram implies, how do you handle two branches with two PRs trying to get merged in, since there is a chance that they will create conflicts with each other. Do you force branch tests sequentially?
  - brettanomyces 4y ago
    We don't allow stale merges so each branch must be fully up to date with master before it can be metged. This is a bit of a pain in busy repos
jjtang1 4y ago
For all things SRE and incident management: https://rootly.com/blog https://rootly.com/blog
riffic 4y ago
on a related note, but are there good resources for DevOps/SRE specifically in the public sector (state/county/city/federal gov)?
musha68k 4y ago
“Software at Scale” podcast often has great systems related interviews as well: https://www.softwareatscale.dev/podcast https://www.softwareatscale.dev/podcast
- ublaze 4y ago
  Thank you!
derfabianpeter 4y ago
https://microplatforms.de https://microplatforms.de is a growing collection of DevOps/Platform Engineering/SRE content.
thundergolfer 4y ago
https://gregoryszorc.com/blog/2021/04/07/modern-ci-is-too-complex-and-misdirected/ https://gregoryszorc.com/blog/2021/04/07/modern-ci-is-too-co... is the best article about CI/CD that I’ve ever read. Gregory gets it.
dhxt 4y ago
https://hodovi.cc/blog/ https://hodovi.cc/blog/
eon01 4y ago
You can read DevOpsLinks and The Chief I/O weekly newsletters. You'll find the best blog posts curated from the SRE/DevOps/CloudNative space. - DevOpsLinks (CI/CD, Cloud Computing, SRE, DevOps): https://faun.dev/newsletter/devopslinks https://faun.dev/newsletter/devopslinks - The Chief I/O (Distributed Systems, Kubernetes, Cloud Native DevOps): https://faun.dev/newsletter/the-chief-io https://faun.dev/newsletter/the-chief-io Disclaimer: I'm the founder.

207 points by 100011_100001 4y ago

timcavel 4y ago

adamgordonbell 4y ago

I'm not sure about SRE specific or CI specific writing but at risk of answering another question, here's what comes to mind for me. In the Operations space my favorite writer is Charity Majors, although a lot of what she talks about isn't OPs specific: https://charity.wtf/ https://charity.wtf/ Rachel by the Bay is also great: https://rachelbythebay.com/w/ https://rachelbythebay.com/w/ Totally not related, but Phil Eaton's posts on how databases work are super interesting and lack fluff. https://notes.eatonphil.com/ https://notes.eatonphil.com/ In terms of CI and builds, I try to write some on this topic for the Earthly Blog. My Bazel article was recently on Hn. Here are my posts: https://earthly.dev/blog/authors/adam/ https://earthly.dev/blog/authors/adam/ Warning though, I also write about lots of other stuff. Are there specific CI topics you'd like to see covered?

hashar 4y ago
> https://earthly.dev/blog/bazel-build/ https://earthly.dev/blog/bazel-build/ That is a good read thank you.
eatonphil 4y ago
Kind of you to share, Adam! You have awesome podcast episodes as well!

eliranw 4y ago

Good question, would love to also know about some great blogs

excitednumber 4y ago

Same. Even just a maintained “start to finish” of what someone thinks is current best practice for project development would be a fantastic resource.

oneplane 4y ago

The biggest issue (for me when writing about it) is that it's really hard to do this when most keys and values in any source or screenshot are internal to the company. I could go and clean it up with placeholder data, but at that point I'm essentially doing my work twice.

privacywiki 4y ago

Check this out if you are into podcasts; https://sre.google/prodcast/ https://sre.google/prodcast/

TotoHorner 4y ago

- Quastor (https://www.quastor.org/ https://www.quastor.org/) - Moreso focused on backend engineering but they have a lot of SRE content too. It's a newsletter that looks at all the big tech engineering blogs and sends out summaries of the interesting posts. - SRE Weekly (https://sreweekly.com/ https://sreweekly.com/) - Curation newsletter on interesting links in SRE - SRE Prodcast (https://sre.google/prodcast/ https://sre.google/prodcast/) - Good podcast by Google on SRE. They pick a specific topic and then interview an expert on that so each episode is well focused. They also provide transcripts so you can just read through it instead of listening. - Resilience in Action (https://podcasts.apple.com/us/podcast/resilience-in-action/id1506828506 https://podcasts.apple.com/us/podcast/resilience-in-action/i...) - Another good podcast on SRE with interviews. If you just want a listen of resources, then you should check out the Awesome SRE repo on github - https://github.com/dastergon/awesome-sre https://github.com/dastergon/awesome-sre

100011_100001 4y ago
Good stuff. Thanks. This seems to be along the lines of what I was looking for.
ankaAr 4y ago
Nice, thanks!
ngauje 4y ago
Great list, I propose 2 young YT channels that worth watching about reliability and observability - Slight Reliability (https://www.youtube.com/c/SlightReliability https://www.youtube.com/c/SlightReliability) Podcast from Stephen TOWNSHEND - Is it Observable (https://www.youtube.com/c/IsitObservable https://www.youtube.com/c/IsitObservable) from Henrik REXED

dev_0 4y ago

No Martin Fowler please. He doesn't work on real projects now

411111111111111 4y ago
Martin Fowler has never worked in ci/CD and SRE, nor has he ever written anything on the subject.
- dev_0 4y ago
  https://martinfowler.com/tags/continuous%20delivery.html https://martinfowler.com/tags/continuous%20delivery.html Wrong
  - Rexxar 4y ago
    It doesn't seems surprising a 2006 article is not up to date with latest ideas.
  - 411111111111111 4y ago
    Damn, i stand corrected. I've never come across any of these articles, even though I quiet often came upon his programming articles. Sorry for my ignorance.
solarengineer 4y ago
While it is true that Martin is not a full-time programmer, all his blog posts are reviewed in our software development mailing list. He solicits opinions, introduces amendments based on feedback and has on ocassion even stepped back from publishing an article. (Source: I am a Thoughtworker since 2006).
- dev_0 4y ago
  His blogs are marketing for Thoughtworks......How things are in theory is different from the actual practices....

jeffwask 4y ago

https://www.youtube.com/c/AntonBabenkoLive https://www.youtube.com/c/AntonBabenkoLive

ledgerdev 4y ago

I like the tiny devops guy, lots of practical talk. https://www.youtube.com/channel/UC5UfX0EgUWlcdQ2RDsq_fcA https://www.youtube.com/channel/UC5UfX0EgUWlcdQ2RDsq_fcA https://jhall.io/media/ https://jhall.io/media/

sluongng 4y ago

I started a series recently https://sluongng.hashnode.dev/series/bazel-in-ci https://sluongng.hashnode.dev/series/bazel-in-ci with focus on setting up Bazel in CI. But I has been trying to write more about CI and the culture around DevX more than Bazel to provide the context for future posts.

oxff 4y ago

It seems always to be too specific to an org. to have a general transferable knowledge to share? Kind of.

100011_100001 4y ago
Some specifics sure. I'm looking more into general trends like when creating a Docker image it's a good idea to X, Y, Z and we use this tool to satisfy X. Or Docker images have K, L problems that Podman doesn't have. However Podman has W issue so you have to decide which pain you want to live with. That kind of stuff.

upg1979 4y ago

Check this repo for SRE https://github.com/upgundecha/howtheysre https://github.com/upgundecha/howtheysre

tomfern 4y ago

I write a lot about CI/CD at my job (unsurprising as we are a CI service). While we do have some articles about our platform itself, most of the articles you'll find are more general: https://semaphoreci.com/category/engineering https://semaphoreci.com/category/engineering We also have a podcast about engineering that frequently touches CI/CD as a topic: https://semaphoreci.com/podcast https://semaphoreci.com/podcast

tomfern 4y ago
You'll find that most articles touch CI/CD if they are not outright about CI/CD fundamentals.

la_fayette 4y ago

https://m.youtube.com/c/TechWorldwithNana https://m.youtube.com/c/TechWorldwithNana

brettanomyces 4y ago

https://medium.com/wise-engineering/state-of-our-ci-cd-pipeline-part-1-dd5467803718 https://medium.com/wise-engineering/state-of-our-ci-cd-pipel... Disclaimer: I work for Wise

100011_100001 4y ago
Out of curiosity, I see that opening a PR triggers an automatic branch build, when the code is merge into master is your build process repeated? If not, which is what the diagram implies, how do you handle two branches with two PRs trying to get merged in, since there is a chance that they will create conflicts with each other. Do you force branch tests sequentially?
- brettanomyces 4y ago
  We don't allow stale merges so each branch must be fully up to date with master before it can be metged. This is a bit of a pain in busy repos

jjtang1 4y ago

For all things SRE and incident management: https://rootly.com/blog https://rootly.com/blog

riffic 4y ago

on a related note, but are there good resources for DevOps/SRE specifically in the public sector (state/county/city/federal gov)?

musha68k 4y ago

“Software at Scale” podcast often has great systems related interviews as well: https://www.softwareatscale.dev/podcast https://www.softwareatscale.dev/podcast

ublaze 4y ago
Thank you!

derfabianpeter 4y ago

https://microplatforms.de https://microplatforms.de is a growing collection of DevOps/Platform Engineering/SRE content.

thundergolfer 4y ago

https://gregoryszorc.com/blog/2021/04/07/modern-ci-is-too-complex-and-misdirected/ https://gregoryszorc.com/blog/2021/04/07/modern-ci-is-too-co... is the best article about CI/CD that I’ve ever read. Gregory gets it.

dhxt 4y ago

https://hodovi.cc/blog/ https://hodovi.cc/blog/

eon01 4y ago

You can read DevOpsLinks and The Chief I/O weekly newsletters. You'll find the best blog posts curated from the SRE/DevOps/CloudNative space. - DevOpsLinks (CI/CD, Cloud Computing, SRE, DevOps): https://faun.dev/newsletter/devopslinks https://faun.dev/newsletter/devopslinks - The Chief I/O (Distributed Systems, Kubernetes, Cloud Native DevOps): https://faun.dev/newsletter/the-chief-io https://faun.dev/newsletter/the-chief-io Disclaimer: I'm the founder.