Jonathan Magen
4y ago
Computers and Stuff
In order to achieve CI/CD which meets your needs and doesn't inspire intense self hatred, you're going to need to play around with what works for you, your team, and your product.
As a computer scientist working for a large US corporation, I am constantly on the lookout for tools which will make folks lives better. I put together this grab bag list of stuff I hope I get to try out more ASAP. Hopefully others can benefit from what I've already been having some light success with in different environments. I haven't vetted all of these in as much detail as I wish I could, but maybe some will be a help or an inspiration for you!
Bors.Tech: Strict mode for your CI/CD
The times when I've been most frustrated (and the most confused) with my CI/CD pipelines have been when I got unexpected results. While I've written elsewhere about why Git has caused issues for me in the past, tools like Bors.Tech can help. Drop it into your workflows and it'll help improve merge and test predictability.
Earthly: Make your CI/CD workflow portable
I've been following Earthly for a long time but their recent strides in both maturity and adoption of a proper FOSS license are what make it a viable option today.
Earthly lets you define your pipeline with an Earthfile which is half way between a Makefile and a Dockerfile. Then you can run it wherever you have Docker. This makes it very well suited to testing on your local machine and then running it, reliably and repeatably, on a shared CI server.
This makes the inner loop of the developer workflow much shorter, tighter, and more testable. Who doesn't love fewer surprises?
SLSA: keep your supply chain safe and transparent
SLSA stands for Supply chain Levels for Software Artifacts and it's a multi-tiered framework to guide projects in establishing desirable security properties. For CI/CD, the tools available have gotten just that good. Honestly the incredible strides made by the efforts adjacent to supply chain security are nothing short of awe-inspiring. Advocates on Twitter (like Dan Lorenc) have done just as a fantastic job of educating folks about supply chain security as they have evangelizing work like the Sigstore project.
Using Sigstore tools (like Cosign for signing container images) can not only give your users and consumers confidence, but will help establish internal oversight. For highly-regulated entities, the ability to show chain of custody might be the difference between passing or failing an audit!