#office-hours (2021-10)
“Office Hours” are every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers! https://cloudposse.com/office-hours
Public “Office Hours” are held every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers!
https://cpco.io/slack-office-hours
Meeting password: sweetops
2021-10-06
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
@here office hours is starting in 30 minutes! Remember to post your questions here.
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Sahil Kamboj has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Michael Jenkins has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Alexandr Vorona has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Benjamin Smith has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Florain Drescher has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Ross Rfd has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
David Hawthorne has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Vlad Ionescu has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Michael Manganiello has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Ryan Ryke has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Justin Davis has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Erin Angerer has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Yusuf has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Adam Blackwell has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mukesh Sharma has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Nate Faerber has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Tim Gourley has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mike Crowe has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Antarr Byrd has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Arjun Venkatesh has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mike Crowe has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Andrew Thompson has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matt Calhoun has joined Public “Office Hours”
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
links from today’s session:
• https://twitter.com/lukehoban/status/1443658655467900936?s=21
• https://github.com/hashicorp/terraform-provider-awscc
• https://www.hashicorp.com/blog/announcing-terraform-aws-cloud-control-provider-tech-preview
• https://www.pulumi.com/blog/announcing-aws-native/
• https://blog.cloudflare.com/introducing-r2-object-storage/
• https://github.com/cloudposse/terraform-aws-config/tree/master/modules/conformance-pack
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Erin Angerer has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Tony Scott has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Geoff Weinhold has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Patrick Joyce has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Chocks Subramanian has joined Public “Office Hours”
![Vlad Ionescu (he/him) avatar](https://avatars.slack-edge.com/2020-10-03/1417676895681_ea45b3f22e5fea04f2fc_72.png)
![attachment image](https://github.blog/wp-content/uploads/2019/03/blog-card.png?fit=5001%2C2626)
GitHub Actions: DRY your GitHub Actions configuration by reusing workflows
![Adam Blackwell avatar](https://avatars.slack-edge.com/2022-12-15/4527352804052_97936f81bdd1cc839a4b_72.jpg)
So excited about this!!
![attachment image](https://github.blog/wp-content/uploads/2019/03/blog-card.png?fit=5001%2C2626)
GitHub Actions: DRY your GitHub Actions configuration by reusing workflows
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
https://www.hashicorp.com/blog/announcing-terraform-aws-cloud-control-provider-tech-preview https://www.pulumi.com/blog/announcing-aws-native/
![attachment image](https://www.datocms-assets.com/2885/1633031784-site-merchaws-cloud-control-apiblog.png)
This new provider for HashiCorp Terraform — built around the AWS Cloud Control API — is designed to bring new services to Terraform faster.
![attachment image](https://www.pulumi.com/blog/announcing-aws-native/aws_native_launch.png)
New Pulumi AWS Native Provider offers same-day support for all new AWS features, building on the AWS Cloud Control API
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oscar Blanco has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Zadkiel AHARONIAN has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mohammed Yahya has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Patrick Joyce has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oscar Blanco has joined Public “Office Hours”
![Nate Faerber avatar](https://avatars.slack-edge.com/2021-09-17/2505641499475_9981afca1daa6025aee7_72.jpg)
@matt, I feel like I hit a related issue regarding encrypted AMI (or at least EBS volume) in EKS using eksctl. I ended up falling back to some defaults that got me by so I can’t say this would have solved my problem but maybe it’s a data point: https://github.com/weaveworks/eksctl/issues/952#issuecomment-507219406
Is the principal listed here one you have tried?
Why do you want this feature? To be able to adhere to corporate security policies regarding encryption of certain datasets. What feature/behavior/change do you want? A method by which the CloudForm…
![Nate Faerber avatar](https://avatars.slack-edge.com/2021-09-17/2505641499475_9981afca1daa6025aee7_72.jpg)
Must be since this links back to official AWS docs which I assume you have checked. I’ve had issues with ASGs using encrypted AMI cross-account that I never solved so your story was bringing back bad memories. I’d like to know the solution when you figure it out.
Why do you want this feature? To be able to adhere to corporate security policies regarding encryption of certain datasets. What feature/behavior/change do you want? A method by which the CloudForm…
![matt avatar](https://avatars.slack-edge.com/2018-07-25/406075857847_5022e8879911a823838f_72.jpg)
Thanks, I’ll take a look and make sure I didn’t miss anything.
![matt avatar](https://avatars.slack-edge.com/2018-07-25/406075857847_5022e8879911a823838f_72.jpg)
For this particular customer, they have HIPAA requirements and have an org policy that doesn’t allow any EBS volumes that are unecrypted, so I don’t have any choice but to use the encrypted AMIs for packer
![Nate Faerber avatar](https://avatars.slack-edge.com/2021-09-17/2505641499475_9981afca1daa6025aee7_72.jpg)
yeah. Makes sense.
![SweetOps avatar](/assets/images/custom_emojis/sweetops.png)
2021-10-12
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Agnello Dsouza has joined Public “Office Hours”
2021-10-13
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
@here office hours is starting in 30 minutes! Remember to post your questions here.
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oscar Blanco has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matteo Migliaccio has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Jim Park has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mukesh Sharma has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Phillip Hocking has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oscar Blanco has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Carlos Ybere Rodrigues has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Ian Bartholomew has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Tim Gourley has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matt Calhoun has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Benjamin Smith has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
venkata mutyala has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Daniel Miller (CloudPosse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Justin Davis has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
emem peace has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Michael Manganiello has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Sarah Donehower has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Jason Skidmore has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Agnello dsouza has joined Public “Office Hours”
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
James Haughey has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Patrick Joyce has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oskar Maria Grande has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mauricio Wyler has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Othman Musleh has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Florain Drescher has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Marc Slayton has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
yong chen has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Andrew Thompson has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
yong chen has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Ian Bartholomew has joined Public “Office Hours”
![Jim Park avatar](https://secure.gravatar.com/avatar/e166c478c5b78e93a5fb116d92a2dc7e.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0022-72.png)
I feel like Theo Schlossnagle’s Art and Science of the Service Level Objective is a solid reference: https://www.circonus.com/whitepapers/art-and-science-of-the-service-level-objective.pdf
![Ian Bartholomew avatar](https://avatars.slack-edge.com/2021-07-21/2292724183222_e41407b9b5ff33bf9fea_72.jpg)
I also like the SLO chapter from the Google SRE book: https://sre.google/sre-book/service-level-objectives/
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Ian Bartholomew has joined Public “Office Hours”
![Jim Park avatar](https://secure.gravatar.com/avatar/e166c478c5b78e93a5fb116d92a2dc7e.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0022-72.png)
![matt avatar](https://avatars.slack-edge.com/2018-07-25/406075857847_5022e8879911a823838f_72.jpg)
![SweetOps avatar](/assets/images/custom_emojis/sweetops.png)
2021-10-20
![Blaise Pabon avatar](https://secure.gravatar.com/avatar/9db34d0c21fdaf687b05eff5422bd7cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0014-72.png)
Does anyone have a demo app framework to recommend? Something along the lines of https://codebase.show/projects/realworld but with an emphasis on infrastructure?
A collection of codebase examples using various languages, libraries, and frameworks to help you create your next project.
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
via @Vlad Ionescu (he/him) https://github.com/poc-hello-world/greeter-service
PoC app that returns a greeting like 'Hello' for 'Hello world!' - GitHub - poc-hello-world/greeter-service: PoC app that returns a greeting like 'Hello' for 'Hello world…
![Blaise Pabon avatar](https://secure.gravatar.com/avatar/9db34d0c21fdaf687b05eff5422bd7cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0014-72.png)
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
KHAI Anis has joined Public “Office Hours”
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
@here office hours is starting in 30 minutes! Remember to post your questions here.
![nnsense avatar](https://avatars.slack-edge.com/2021-11-13/2724381855556_9b369968ac638fae65f2_72.png)
Hi, about the layered infrastructure, the first layer (fundamental infrastructure) and EKS (which we consider platform, right?) are into different tf dirs. Would terragrunt be a valid option to maintain these two, or that would be overkilling and a terraform_remote_state
could suffice to get the resources from the first terraform (into the EKS) one.. what’s the best approach for you?
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oliver Schoenborn has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Guilherme Borges has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
David Hawthorne has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Charles Sperbeck has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Vicken Simonian has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Vlad Ionescu has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
venkata mutyala has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mike Cox has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mauricio Wyler has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matt Calhoun has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Jason Skidmore has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Ian Bartholomew has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Nate Faerber has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Jim Park has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Aleksandr Fofanov has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Sarah Donehower has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Daniel Miller (CloudPosse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matteo has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Tim Gourley has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matt Gowie has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Justin Davis has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Eric Berg has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Antarr Byrd has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Marc Tamsky has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Yusuf has joined Public “Office Hours”
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
links from today’s session:
• https://github.com/mitchellh/terraform-provider-multispace
• https://www.pulumi.com/blog/introducing-pulumi-registry/
• https://github.com/FairwindsOps/saffire
• https://registry.terraform.io/providers/hashicorp/time/latest
• https://blog.cloudflare.com/automatic-remediation-of-kubernetes-nodes/
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mukesh Sharma has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Obi One has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Eric Berg has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Florain Drescher has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Vicken Simonian has joined Public “Office Hours”
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
i say this with humility because we are building a framework
![Blaise Pabon avatar](https://secure.gravatar.com/avatar/9db34d0c21fdaf687b05eff5422bd7cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0014-72.png)
… even more humility since it reads like it was written this morning and not 1~5~6 years ago….
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
![attachment image](https://assets.serverless-extras.com/website/general/social-card-serverless-cloud.png)
The new Serverless App Platform that’s fast, familiar & forkable. Instantly fork and deploy APIs, static sites, scheduled tasks & more across your team for rapid delivery.
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
Extend support on AWS Proton to enable defining and provisioning infrastructure using Hashicorp Terraform
![SweetOps avatar](/assets/images/custom_emojis/sweetops.png)
![Andrew Nazarov avatar](https://avatars.slack-edge.com/2021-06-09/2146832855878_fbb84e3b2832cc494a93_72.jpg)
That was very informative. Thank to everybody involved! I’m missing being there live though))
2021-10-27
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
Yo, Sherif here
I am looking forward to join today’s office hours, I just discovered cloudposse community (although I’ve been using the modules for quite sometime )
I work as a SRE/DevOps/Infa/Platform ( whatever the name is it’s confusing )
I apologies for the wall of text
My current work is moving our Infrastructure to a more modern setup, this include using Terraform, Kubernetes, and all the things in between. We’ve built something very cool and I am proud of it.
We do have a Production, Staging and QA Environments ( 1 Per QA Member, about ~30 in total), and we have about 30 Service.
Ironically I modeled our Infrastructure in a way very similar to SweetOps 4 Layer model. Aside from the Foundational, Platform, and Shared Services part, my main point of struggle that I am very eager to improve is the Application Layer.
Especially the Application Infrastructure (call it AppInfra) which are the Application 1-to-1 Infrastructure components such as S3 Buckets, RDS, CloudFront. and Let me explain what I want to achieve.
I just made a deal with my workplace to give me a AWS Account to build a Greenfield virtual company that I’ll try to explore good practices using. And I am trying to solve some problems we’re already having (but without caring so much about disturbing business, it will be a greenfield project)
So
Our current way
- Applications are Deployed using Push Model, thus mean, CI (jenkins sadly ) will Apply the Terraform part, then proceed with Applying the Helm Chart.
- We use Terraform to release the helmchart, which is a very intuitive combo in theory especially when passing Terraform outputs to the Helm Values. My Goals:
- GitOps GitOps GitOps… I want to implement GitOps ( the reconciliation part is what is missing atm)
- Implement Feature Branch Preview Environments
- I tried to shift any thing possible to Kubernetes, using the service’s helm chart (it’s just soo intuitive imo), this includes the: a. All application components like Webservers, Consumers, Jobs, and CronJobs are in the Chart. b. Route53 Records using External DNS c. Monitoring and Alerting Using Prometheus Operator d. Grafana Dashboard using Grafana Operator e. And of course Kubernetes stuff like Autoscaling, KEDA, etc are all part of the Helm Chart.
- However… I can’t use Helm Chart for AppInfra yet… a. I looked into Crossplane.io, and AWS Operator, but they’re not there yet imo. Infrastructure is different, The CRDs are fine for the optimistic situations, but letting my Kubernetes Operator do RDS Restore, Scaling, or other tricky Infrastructure tweaks ( The DB Migration analogy comes to mind), I don’t feel Kubernetes Operator pattern is the best method here. b. Using Terraform to deploy changes in the PRs (before merging and before Argo does its sync) seems fine. We won’t deploy our App to Kubernetes unless Terraform is in sync. c. However… This breaks when dealing with highly dynamic environments, when I have like ~5 interdependent services, each one has their own AppInfra, I can’t use GitOps methods to just point Argo to sync them. I’ll need to deploy them 1 by 1, as well as Cleaning Them Up. d. And now I will use my CI to handle this deployments and ask it to trigger 5 services, then ask it later to go destroy them too. and I am drifting away from Kubernetes, and more coupled to my CI to do all the operations. I am asking, is there is a better way to do it ? What do you think ?
Questions ( for OfficeHours)
- How do I deploy on-demand environments (say ~5 interdependent services) using GitOps & Terraform together ? a. Using: i. Terraform to Apply the App Infrastructure (1-to1 Infra) ii. ArgoCD for syncing the Chart itself. b. And avoiding maintaining the services dependency tree and triggering my CI in specific sequence to provision an environment ?
- How to pass information between Terraform and the Helm Chart (deployed via Argo) ? a. For Testing/QA we have DB Snapshot Volumes that we will use Terraform to clone, and pass it for the HelmChart b. The HelmChart then uses to create a PV & PVC for the DB Pod.
![Zachary Loeber avatar](https://avatars.slack-edge.com/2020-05-13/1115475485942_e68ae4d6556df390de70_72.jpg)
You take a look at env0 yet? That product squarely targets your ephemeral environment needs I believe
![tim.davis.instinct avatar](https://avatars.slack-edge.com/2020-12-16/1587108216052_575000f28ef3231c54d6_72.jpg)
Huge thanks for the shoutout @Zachary Loeber. @Sherif there are a few of us from env0 here in this community. We would be glad to setup a time to talk with you about your use case and how could help you solve the issues, if you’d like.
![tim.davis.instinct avatar](https://avatars.slack-edge.com/2020-12-16/1587108216052_575000f28ef3231c54d6_72.jpg)
For example, we have a blog about how to get the Feature Branch Previews you mentioned: https://www.env0.com/blog/from-feature-branches-to-feature-environments
![attachment image](https://assets-global.website-files.com/5dc3f52851595b160ba99670/5e9e2ff5a3f35e37c013e82d_1_KU7guPGya5qs0MifR80NVg.jpg)
When developing for the cloud, separate branches aren’t enough - you need full separate environments for whatever you’re working on.
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
Thanks @Zachary Loeber & @tim.davis.instinct I don’t think my company is ready yet to introduce yet again more components, they’re already still digesting the Kubernetes move and we’ve only migrated 40% of our stack.
So as much as I’d love to have a talk ( Let’s set this up! ), I don’t think we can get an approval yet.
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
Also, the enthusiastic engineer in me also wanna have a discussion about implementing this setup using purely OSS tools, that’s why I got an approval under the learning budget to have a separate AWS Account for a greenfield project that I can use for the “”radical”” changes
![tim.davis.instinct avatar](https://avatars.slack-edge.com/2020-12-16/1587108216052_575000f28ef3231c54d6_72.jpg)
That’s totally fair. A lot of folks can get overloaded with all the new stuff. But, if you are trying to get to GitOps or other methodology, the tools can always help you get there faster, vs trying to get there then implementing the tools. We’re here to help in any way we can, even if it’s just having a call and helping you answer some high level questions that aren’t env0 product related. We’re all about helping out the community and sharing our knowledge any way we can :)
![tim.davis.instinct avatar](https://avatars.slack-edge.com/2020-12-16/1587108216052_575000f28ef3231c54d6_72.jpg)
Hah, fair call on the OSS tools. Honestly, a lot of customers that end up looking at our platform, attempted to use all OSS or build their own, and then realized that it’s easier to let someone else do all the hard work. Re-inventing the wheel can be…less fun, sometimes
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
Yea, Practically if we’re going this path as a company, I’ll push to use a managed specialized service myself
![tim.davis.instinct avatar](https://avatars.slack-edge.com/2020-12-16/1587108216052_575000f28ef3231c54d6_72.jpg)
We’re more than happy to answer any questions you have anytime. It can be a long and complicated path sometimes, but always for the best. You seem to have a great handle on where you want to be.
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
I’ll definitely reach out and we can have a talk, I might try to introduce env0 to my team, we can definitely use it after we’ve migrated more of our stack to Kubernetes.
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
![Andrew Nazarov avatar](https://avatars.slack-edge.com/2021-06-09/2146832855878_fbb84e3b2832cc494a93_72.jpg)
@Sherif Cool introduction! I’m wondering how you create and delete these QA envs. Do you have a possibility to trigger the creation/deletion of the environment from CI by clicking buttons or your folks trigger it via CLI? Or they are permanent and created all together?
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
Right now, each app and its Infra can be deployed to any QA Environment, even if it didn’t exist before. ( will dynamically create everything ). And this is done through CI/CD jobs.
However dependencies between services is completely manually. Teams would go to each service and deploy it themselves until they “complete” their dependencies.
We tried building the dependency tree before and automate this part, however we didn’t find a neat solution for that yet.
![Andrew Nazarov avatar](https://avatars.slack-edge.com/2021-06-09/2146832855878_fbb84e3b2832cc494a93_72.jpg)
Thanx for sharing!
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
@here office hours is starting in 30 minutes! Remember to post your questions here.
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Emile Fugulin has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Emile Fugulin has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Yusuf has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Erik Osterman (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Vlad Ionescu has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Zachary Loeber has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Andy Miguel (Cloud Posse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Sherif Abdel-Naby has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Benjamin Smith has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Guilherme Borges has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Jim Park has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
James Haughey has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Oskar Maria Grande has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
David Hawthorne has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Justin Davis has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matt Calhoun has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
JB Beck has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Kyle Korth has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Yusuf has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Daniel Miller (CloudPosse) has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Antarr Byrd has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Matthew Zeemann has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Tim Gourley has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Jim Antoniou has joined Public “Office Hours”
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Mohammed Almusaddar has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
dario erregue has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Isa Aguilar has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Marc Tamsky has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Hao Wang has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Sam C has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Tony Scott has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Taylor M has joined Public “Office Hours”
![Jim Park avatar](https://secure.gravatar.com/avatar/e166c478c5b78e93a5fb116d92a2dc7e.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0022-72.png)
Github actions telemetry => Datadog by Scribd (https://github.com/scribd/github-action-datadog-reporting)
Contribute to scribd/github-action-datadog-reporting development by creating an account on GitHub.
![Taylor avatar](https://avatars.slack-edge.com/2021-09-30/2546256403910_3eed841697e6baf18389_72.png)
+1 on that one
Contribute to scribd/github-action-datadog-reporting development by creating an account on GitHub.
![Vlad Ionescu (he/him) avatar](https://avatars.slack-edge.com/2020-10-03/1417676895681_ea45b3f22e5fea04f2fc_72.png)
Trace GitHub Action workflows with Honeycomb . Contribute to kvrhdn/gha-buildevents development by creating an account on GitHub.
![matt avatar](https://avatars.slack-edge.com/2018-07-25/406075857847_5022e8879911a823838f_72.jpg)
As mentioned on the office hours call, Charity Majors, the founder of Honeycomb.io is prolific and a really good read on observability
![Vlad Ionescu (he/him) avatar](https://avatars.slack-edge.com/2020-10-03/1417676895681_ea45b3f22e5fea04f2fc_72.png)
https://aws.amazon.com/blogs/compute/accelerating-serverless-development-with-aws-sam-accelerate/ and https://aws.amazon.com/about-aws/whats-new/2021/10/aws-load-balancer-2-3-alb-ipv6-targets/
![attachment image](https://d2908q01vomqb2.cloudfront.net/1b6453892473a467d07372d45eb05abc2031647a/2021/10/26/main-1-1260x500.png)
Building a serverless application changes the way developers think about testing their code. Previously, developers would emulate the complete infrastructure locally and only commit code ready for testing. However, with serverless, local emulation can be more complex. In this post, I show you how to bypass most local emulation by testing serverless applications in the […]
![Erik Osterman (Cloud Posse) avatar](https://secure.gravatar.com/avatar/88c480d4f73b813904e00a5695a454cb.jpg?s=72&d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0023-72.png)
![attachment image](https://assets.serverless-extras.com/website/general/social-card-serverless-cloud.png)
The new Serverless App Platform that’s fast, familiar & forkable. Instantly fork and deploy APIs, static sites, scheduled tasks & more across your team for rapid delivery.
![fb-wow](/assets/images/custom_emojis/fb-wow.gif)
![sytten avatar](https://avatars.slack-edge.com/2019-03-01/564418310496_16e796635f1b40fcea36_72.jpg)
![attachment image](https://www.cockroachlabs.com/img/serverless-blog-header-1200x400-a.png)
CockroachDB Serverless gives you instant access to a distributed SQL database that spins up in seconds. PostgreSQL-compatible, and free up 5GB.
![sytten avatar](https://avatars.slack-edge.com/2019-03-01/564418310496_16e796635f1b40fcea36_72.jpg)
![attachment image](https://www.cockroachlabs.com/img/blog-header-serverless-architecture.jpg)
Cockroach Labs has just launched the first truly scalable serverless SQL database. Here’s how we made it happen.
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Patrick Joyce has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Sherif Abdel-Naby has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Michael Jenkins has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Anere Faithful has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Vicken Simonian has joined Public “Office Hours”
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Blaise pabon has joined Public “Office Hours”
![Vlad Ionescu (he/him) avatar](https://avatars.slack-edge.com/2020-10-03/1417676895681_ea45b3f22e5fea04f2fc_72.png)
Just (officially) announced: https://github.blog/changelog/2021-10-27-github-actions-secure-cloud-deployments-with-openid-connect/
![attachment image](https://user-images.githubusercontent.com/25389593/138510587-33253c06-a2c4-4276-ac6b-3214ca94c9e6.png)
GitHub Actions: Secure cloud deployments with OpenID Connect
![Zoom avatar](/assets/images/custom_emojis/zoom.png)
Eric Berg has joined Public “Office Hours”
![sytten avatar](https://avatars.slack-edge.com/2019-03-01/564418310496_16e796635f1b40fcea36_72.jpg)
![attachment image](https://github.githubassets.com/images/modules/open_graph/github-logo.png)
Use OpenID Connect within your workflows to authenticate with your cloud provider.
![sytten avatar](https://avatars.slack-edge.com/2019-03-01/564418310496_16e796635f1b40fcea36_72.jpg)
@Erik Osterman (Cloud Posse) you might like that
![sytten avatar](https://avatars.slack-edge.com/2019-03-01/564418310496_16e796635f1b40fcea36_72.jpg)
it is new
![Sherif avatar](https://avatars.slack-edge.com/2021-10-23/2664282541920_b2e41a70d69a1fda213a_72.jpg)
^ @Erik Osterman (Cloud Posse) I think the video is corrupted
![Andy Miguel (Cloud Posse) avatar](https://avatars.slack-edge.com/2021-01-31/1681606086343_27574601efa96f8283e4_72.png)
yeah, automation bit us hehe
![SweetOps avatar](/assets/images/custom_emojis/sweetops.png)