#office-hours (2022-05)
Meeting password: sweetops
Public “Office Hours” are held every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers! https://cpco.io/slack-office-hours
Public “Office Hours” are held every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers!
https://cpco.io/slack-office-hours
Meeting password: sweetops
2022-05-01
How many of you don’t commit .terraform.lock.hcl to source control? I’ve read the docs but I’m still a bit confused on why i should use it over required_version within my provider definition. OR, should i be using both?
I use both. I keep the lock file in source control so my CI builds are using the same versions I use locally.
2022-05-02
Sharing is caring. :)
2022-05-03
For office hours: easy-to-follow set of instructions for a strategy that minimizes the cost of NAT gateways in ec2. I’ve seen suggestions about using using a lambda to terminate the nat gateway once the deployment of the server is complete, switching to other gateway types like internet gateways, and using vpc endpoints. But these are quite overwhelming to me because I’m not an aws guru and the nat gateway endpoints are from a sample cloudformation template I used which doesn’t explicitly create the gateways… so feels like I can’t find their direct source.
2022-05-04
@here office hours is starting in 30 minutes! Remember to post your questions here.
Linda Pham has joined Public “Office Hours”
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
Ralf Pieper has joined Public “Office Hours”
dag viggo lokoeen has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
Mikael Fridh has joined Public “Office Hours”
Matt Calhoun has joined Public “Office Hours”
Allen Lyons has joined Public “Office Hours”
Scott Mathson has joined Public “Office Hours”
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
Andrew Vitko has joined Public “Office Hours”
Michael Jenkins has joined Public “Office Hours”
Hmm weird the link isn’t working for me .
Rob Newsome has joined Public “Office Hours”
Jim C has joined Public “Office Hours”
Matt Gowie has joined Public “Office Hours”
Eric Berg has joined Public “Office Hours”
Linda Pham has joined Public “Office Hours”
Naija ninja has joined Public “Office Hours”
Lucas Andrade has joined Public “Office Hours”
Guilherme Borges has joined Public “Office Hours”
Michael Sew has joined Public “Office Hours”
Paul Bullock has joined Public “Office Hours”
Mohammed Almusaddar has joined Public “Office Hours”
Chocks Subramanian has joined Public “Office Hours”
Connor High has joined Public “Office Hours”
Abraham Quintero has joined Public “Office Hours”
Sherif Abdel-Naby has joined Public “Office Hours”
Benjamin Smith has joined Public “Office Hours”
Justin Davis has joined Public “Office Hours”
Mauricio Wyler has joined Public “Office Hours”
Isaac M has joined Public “Office Hours”
Isa Aguilar has joined Public “Office Hours”
Tim Gourley has joined Public “Office Hours”
Ehimah Obuse has joined Public “Office Hours”
I mentioned this in the context of possibly replacing it with dagger.io
Amer Zec has joined Public “Office Hours”
Andrew Thompson has joined Public “Office Hours”
2022-05-05
Would love to discuss this next week + hear from anybody who has had the chance to kick the tires. https://www.pulumi.com/docs/intro/languages/yaml/
I’m in another Slack (https://randsinrepose.com/welcome-to-rands-leadership-slack/) and there’s a staff eng there from Pulumi who worked on this feature and is planning on doing an AMA sometime soon
One can also use cue lang with this https://www.pulumi.com/blog/pulumi-yaml/#yaml-as-a-compilation-target-and-cue-support
I also was very interested in this although we haven’t had anything in Pulumi yet - all Terraform. And since we are the Java shop the announcement of Java support also made some buzz:)
Some statements about Pulumi YAML use cases (from Pulumi Slack)
2022-05-07
2022-05-09
2022-05-11
Hi, a question for office-hours. (I don’t think I can make the session time unfortunately)
What API Gateways are you guys using for your Kubernetes clusters? Searching through the slack history here I see:
• Kong
• Ambassador Edge Stack - (looks like you have to pay for JWT use though)
• Amazon API Gateway
• Istio? We use EKS with ArgoCD and Istio and a legacy nginx proxy sitting in front of this. The API gateway would replace the nginx proxy. We’d like to add an API gateway to handle JWT token validation, and then forward on requests to micro-services.
For Ambassador Edge Stack - I think you can run the gateway part (emissary) for free as it’s open source: https://www.getambassador.io/docs/emissary/latest/tutorials/getting-started/
fwiw, the general direction of things (for those who use istio) is to collapse everything into istio - that is what GCP is doing with Anthos, and what Tetrate and Solo are doing.
Solo have custom envoy modules for things like WAF, Tetrate I think added mod security to upstream envoy itself. Tetrate are exploring some of this zero trust stuff with NIST.
Those vendors/approaches might be too early/expensive for your situation. Ambassador probably a good bet though to keep things simple.
I’d probably bet on this becoming the defacto standard for north-south with Ambassador Labs, Fidelity, Tetrate and VMWare combining efforts using envoy and the Gateway API (which GCP also use).
Solo have (currently better) proprietary APIs but assuming this gathers a community that will be gradually eroded.
https://blog.envoyproxy.io/introducing-envoy-gateway-ad385cc59532 https://www.cncf.io/blog/2022/05/16/introducing-envoy-gateway/
@here office hours is starting in 30 minutes! Remember to post your questions here.
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
Allan Mohr has joined Public “Office Hours”
Vlad Ionescu has joined Public “Office Hours”
Dale-Kurt Murray has joined Public “Office Hours”
Emile Fugulin has joined Public “Office Hours”
Yusuf has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
Justin Davis has joined Public “Office Hours”
Ben Smith (Cloud Posse) has joined Public “Office Hours”
@Erik Osterman (Cloud Posse) Please invite feedback on dynamic-subnets PR 159 currently available to test as v2.0.0-rc1
Also please invite people to join discussion about VPC Endpoints and discussion about Transit Gateway
Jeremy (Cloud Posse) has joined Public “Office Hours”
Linda Pham has joined Public “Office Hours”
Alexander Goya has joined Public “Office Hours”
Mazin Ahmed has joined Public “Office Hours”
Matt Gowie has joined Public “Office Hours”
Nick Keam has joined Public “Office Hours”
Kris Musard has joined Public “Office Hours”
Andrew Vitko has joined Public “Office Hours”
Paul Bullock has joined Public “Office Hours”
Matt Calhoun has joined Public “Office Hours”
Eric Berg has joined Public “Office Hours”
Mohammed Almusaddar has joined Public “Office Hours”
Mikael Fridh has joined Public “Office Hours”
Yusuf has joined Public “Office Hours”
links from today’s session
• https://github.dev/cloudposse/geodesic
• https://github.blog/changelog/2022-05-09-github-actions-enhance-your-actions-with-job-summaries
• https://github.com/cloudposse/atmos/releases/tag/v1.4.13
• https://github.com/craftvscruft/tfrefactor
• https://www.hashicorp.com/blog/announcing-the-hashicorp-releases-api
• https://github.com/cloudposse/terraform-aws-dynamic-subnets/pull/159
Connor High has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
Sherif Abdel-Naby has joined Public “Office Hours”
Jeremy Bouse has joined Public “Office Hours”
tyler stilwagne has joined Public “Office Hours”
Jim Park has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
Olad Oke has joined Public “Office Hours”
Dave Gregory has joined Public “Office Hours”
Dave Gregory has joined Public “Office Hours”
A V has joined Public “Office Hours”
Uzuazoraro Etobro has joined Public “Office Hours”
The ultimate comparison
Topic: GitOps developer experience
@Jeremy G (Cloud Posse) @matt
Yes, we saw this before. Not a huge deal. Means we can manage AWS SSO in the identity account now, along with all the other SSO.
yep - which is nice, since we previously had it in the root, which was a little confusing
2022-05-12
That service works absolutely flawlessly.. couldn’t recommend it highly enough
2022-05-16
2022-05-17
2022-05-18
@here office hours is starting in 30 minutes! Remember to post your questions here.
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
At my company, we have have “on-demand environments” (we call ODE), which just means for any candidate change (PR), we deploy an environment automatically. This allows for project managers, developers, QA engineers, etc to view this version of code in an isolated and live environment. Also, we run QA automation against these environments using browser automation technology. After merging a PR, changes are deployed to production.
This has been working great for developer velocity with our client / server architecture. We have two repositories in play, one client (react) one server (rails). In a candidate change to either repository, both client and server are deployed in an ODE, selecting the main branch of the other repository. For example in branch cloudposse-rocks in server, we would deploy client main branch and the cloudposse-rocks branch of server.
Now, our company is moving into microservices. I have a challenge to make “ODEs for microservices”, but I am having some trouble with this project. In the current ODE design, basically all services are re-deployed for a candidate change in any other repo (in this case the client and server repositories). Also, the database for server repository is deployed from scratch and seeded fresh for each branch. This doesn’t seem wise in the case of microservices to deploy everything for any change, so maybe some sharing should be involved, for example one could imagine sharing server for any client change. I have had trouble making this work seamlessly.
I’m curious what kinds of patterns cloudposse has seen work for “On demand” environments, for microservices?
This is something I’ve been battling to come up with a sensible strategy for… one of our teams have over 40 microservices… oh 41, many with their own datastore. I struggle to see that the added overhead (cost, time, complexity) of trying to create (and destroy) a copy of the entire system, infrastructure and all is really worth it. Frontends or user facing APIs, may be worth it. Some people might disagree or have other thoughts, I’ll find out when I catch up on the recording.
Hi Steven, we aren’t as advanced in our automated deployments as you as we are a young start up. But we do deployments very similarly to you. Front and backend split. We got a handful of APIs deployed in the backend, and our nodejs fronted deployed in vercel. We have put everything into a mono-repo. At first I was scared about how complex it would be to manage, but it has resulted in being super easy to do full deployments as all developers are always working with the most current version of main and deploying from any feature branch makes sure all services are deployed in the correct version. Also for changes there requires both front and backend changes are done in the same branch making the deployment of the new feature a breeze.
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
Charles Smith has joined Public “Office Hours”
dag viggo lokoeen has joined Public “Office Hours”
Allan Mohr has joined Public “Office Hours”
Brian Pauley has joined Public “Office Hours”
Yasir Karam has joined Public “Office Hours”
Ralf Pieper has joined Public “Office Hours”
Matt Calhoun has joined Public “Office Hours”
Steven Miller has joined Public “Office Hours”
Luis Masaya has joined Public “Office Hours”
Linda Pham has joined Public “Office Hours”
Isaac M has joined Public “Office Hours”
Jack Louvton has joined Public “Office Hours”
Kris Musard has joined Public “Office Hours”
Ben Smith (Cloud Posse) has joined Public “Office Hours”
Kris Musard has joined Public “Office Hours”
Mikael Fridh has joined Public “Office Hours”
Matt Gowie has joined Public “Office Hours”
Arthur Dent has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
Andy Roth has joined Public “Office Hours”
Nick Keam has joined Public “Office Hours”
links from today’s session
• https://github.com/infrahq/infra
• https://news.ycombinator.com/item?id=31417993
• https://aws.amazon.com/blogs/security/getting-started-with-aws-sso-delegated-administration/
• https://www.appvia.io/blog/self-service-of-cloud-resources
• https://github.com/weaveworks/tf-controller
• https://github.com/rancher/terraform-controller
• https://atlasgo.io/blog/2022/05/04/announcing-terraform-provider
Matt Gowie has joined Public “Office Hours”
Sean O’Dell has joined Public “Office Hours”
Michael Holt has joined Public “Office Hours”
Mohammed Almusaddar has joined Public “Office Hours”
Tim Gourley has joined Public “Office Hours”
Amer Zec has joined Public “Office Hours”
Stevan Arychuk has joined Public “Office Hours”
Andrew Hall has joined Public “Office Hours”
Muthu has joined Public “Office Hours”
Mikael Fridh has joined Public “Office Hours”
Thanks all!
@Erik Osterman (Cloud Posse) referred in the office hours to a past convo about preview environments. Does anyone know if we were talking about this Office Hours? https://sweetops.slack.com/archives/CHDR1EWNA/p1636576569085000 Thanks again so much for great insight @matt and Erik
2022-05-19
Apologies for missing yesterday’s call I totally forgot to write here that I’ll miss it
We missed you! But we’ll talk about gitops experience next week.
2022-05-20
2022-05-24
2022-05-25
@here office hours is starting in 30 minutes! Remember to post your questions here.
Steven Hopkins (Cloud Posse) has joined Public “Office Hours”
Eric Berg has joined Public “Office Hours”
Michael Bottoms has joined Public “Office Hours”
Steven Vargas has joined Public “Office Hours”
David Hawthorne has joined Public “Office Hours”
Alexander Goya has joined Public “Office Hours”
Ralf Pieper has joined Public “Office Hours”
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
Steven Miller has joined Public “Office Hours”
Andrew Elkins has joined Public “Office Hours”
Dave Lundgren has joined Public “Office Hours”
Isa Aguilar has joined Public “Office Hours”
Oliver Schoenborn has joined Public “Office Hours”
Matt Calhoun has joined Public “Office Hours”
Yusuf has joined Public “Office Hours”
Ryan Housand has joined Public “Office Hours”
Vlad Ionescu has joined Public “Office Hours”
Luis Masaya has joined Public “Office Hours”
Michael Jenkins has joined Public “Office Hours”
Manish Sawlani has joined Public “Office Hours”
Yasir Karam has joined Public “Office Hours”
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
Tim Gourley has joined Public “Office Hours”
Jian Gong has joined Public “Office Hours”
Brian Pauley has joined Public “Office Hours”
Jeremy Bouse has joined Public “Office Hours”
Tony Scott has joined Public “Office Hours”
Matt Calhoun has joined Public “Office Hours”
Tony Scott has joined Public “Office Hours”
News/discussion topic: Pinning containers in CI configurations with Ratchet: https://github.com/sethvargo/ratchet
Yusuf has joined Public “Office Hours”
Josh B has joined Public “Office Hours”
Isaac M has joined Public “Office Hours”
Andrew Elkins has joined Public “Office Hours”
Andrew Vitko has joined Public “Office Hours”
Mohammed Almusaddar has joined Public “Office Hours”
Ben Smith (Cloud Posse) has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
Paul Bullock has joined Public “Office Hours”
Kris Musard has joined Public “Office Hours”
Marc Tamsky has joined Public “Office Hours”
himans sharm has joined Public “Office Hours”
Oscar Blanco has joined Public “Office Hours”
2022-05-30
I do not like it….much……
https://github.com/mineiros-io/terramate
I am considering exploring this tool ? Anyone tried it before ? Sounds interesting if you’re into managing your own Terraform apply ( not using Something like Spacelift)
I never liked Terragrunt very opinionated way of doing things anyway
Not sure if I’ll be able to make it to this week’s officehours tho will listen to the recording