#office-hours (2021-05)
“Office Hours” are every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers! https://cloudposse.com/office-hours
Public “Office Hours” are held every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers!
https://cpco.io/slack-office-hours
Meeting password: sweetops
2021-05-03


Help us shape the future of DevOps and make your voice heard by completing the 2021 State of DevOps survey before June 11, 2021.
2021-05-04

Is terraform FIPS complaint?

terraform cloud?

FIPS compliance is usually required to in the context of encryption libraries. as far as I understand, the terraform binary itself is written in GO and you would have find providers that use FIPS compliant libraries, which aren’t used by default.

looks like some providers like oracle, have implemented fips encryption libraries at provider level: https://docs.oracle.com/en-us/iaas/Content/API/SDKDocs/fips_compatible_terraform_provider.htm#fips_compatible_terraform_provider
This topic describes how to use the Oracle Cloud Infrastructure Terraform provider and maintain FIPS compliance.

looks like there is at least one AWS provider has FIPS encryption option: https://registry.terraform.io/modules/terraform-aws-modules/redshift/aws/latest#input_use_fips_ssl
It is maintained by @antonbabenko so he is probably the best person to ask on the topic.

Thank you both! We are doing stuff that requires FIPS compliance in Azure and GCP, what you mentioned above sounds aligned with what I have on googled online over the past few hours.

It appears compliance is as simple as saying it’s compliant but validation requires a full end to end review and then getting list here . During my search I found that the AWS provider promotes FIPS but it’s build process doesn’t seem to use a validated library. From what I can gather online, golang by default doesn’t have any validated libraries so an option is to use a drop in compiler replacement for the crypto libraries. One option is go-toolset from redhat and another is BoringCrypto from google. So if “compliance” requires a validated library then I don’t even thing the AWS provider is fully compliant.

Use this form to search for information on validated cryptographic modules. Select the basic search type to search modules on the active validation list. Select the advanced search type to to search modules on the historical and revoked module lists.
Terraform AWS provider. Contribute to hashicorp/terraform-provider-aws development by creating an account on GitHub.
2021-05-05

@here office hours is starting in 30 minutes! Remember to post your questions here.

How do I keep a failed pod from being terminated, so we can do forensic evals? can I set/remove labels to do that?

Kerri Rist (Cloud Posse) has joined Public “Office Hours”

Dhaval Dedhia has joined Public “Office Hours”

Parthasarathi S has joined Public “Office Hours”

Robert Jackson has joined Public “Office Hours”

Venkata Mutyala has joined Public “Office Hours”

Sam C has joined Public “Office Hours”

Vicken Simonian has joined Public “Office Hours”

Ian Bartholomew has joined Public “Office Hours”

Colton Wrisner has joined Public “Office Hours”

Tim Davis has joined Public “Office Hours”

Eric Berg has joined Public “Office Hours”

Jeremy (Cloud Posse) has joined Public “Office Hours”

Vlad Ionescu has joined Public “Office Hours”

Ayrton Araújo has joined Public “Office Hours”

Kristopher Flint has joined Public “Office Hours”

Lionel LONKAP has joined Public “Office Hours”

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Hao Wang has joined Public “Office Hours”

Matt Calhoun has joined Public “Office Hours”

Leia Renée has joined Public “Office Hours”

Patrick Joyce has joined Public “Office Hours”

Scott Mathson has joined Public “Office Hours”

Mohammed Yahya has joined Public “Office Hours”

James Haughey has joined Public “Office Hours”

Florain Drescher has joined Public “Office Hours”

PePe Amengual has joined Public “Office Hours”

Ray Myers has joined Public “Office Hours”

Michael Padgett has joined Public “Office Hours”

Joaquin Menchaca has joined Public “Office Hours”

Gonzalo Acosta has joined Public “Office Hours”

David Lozano has joined Public “Office Hours”

Stan M has joined Public “Office Hours”


Jeremy Parker has joined Public “Office Hours”

Jeff Lanza has joined Public “Office Hours”

Jeff Vier has joined Public “Office Hours”

Michael Londeen has joined Public “Office Hours”


With Amazon CloudFront, you can securely deliver data, videos, applications, and APIs to your customers globally with low latency and high transfer speeds. To offer a customized experience and the lowest possible latency, many modern applications execute some form of logic at the edge. The use cases for applying logic at the edge can be […]

Gabriel Boie has joined Public “Office Hours”

Question: ELK or Prometheus? Or Both where Prometheus is used for metrics and ELK is used for log collection and analysis? What is the suitable approach for central alerting?

They are two different things. Elasticsearch is first and foremost an indexer, while prometheus is a time series database.

We have both. ELK for logs, Prometheus for metrics, then Grafana which aggregates data from Prometheus and ElasticSearch

Loki might be considered as an alternative for logging

CNCF SIGs are TAGs now: https://github.com/cncf/toc/pull/654/files
SIGs have changed names to TAGs as of 5/5/2021, this should resolve all of that in this repo. Changes proposed to the rest of the TAGs today. Also need to rename the repos below: SIG Security | L… |

tamsky has joined Public “Office Hours”

uwaila adams has joined Public “Office Hours”

Pod dump for forensics: https://github.com/keikoproj/kube-forensics and https://github.com/ThreatResponse/margaritashotgun
https://aws.github.io/aws-eks-best-practices/security/docs/incidents/ is also pretty nice

EphemeralContainers
is an alpha
Feature Gate (default false) available starting with 1.16 and according to the latest docs still alpha and defaulting to false through the current 1.21
This page contains an overview of the various feature gates an administrator can specify on different Kubernetes components. See feature stages for an explanation of the stages for a feature. Overview Feature gates are a set of key=value pairs that describe Kubernetes features. You can turn these features on or off using the –feature-gates command line flag on each Kubernetes component. Each Kubernetes component lets you enable or disable a set of feature gates that are relevant to that component.


Want to know what’s really going on in your Kubernetes cluster? Pixie, which just became a Cloud Native Computing Foundation program, can help.

Steven Hopkins has joined Public “Office Hours”


eBPF is a revolutionary technology that can run sandboxed programs in the Linux kernel without changing kernel source code or loading a kernel module.

Luis Masaya has joined Public “Office Hours”

Andy Roth has joined Public “Office Hours”



jason thomas has joined Public “Office Hours”

Jason Valencia has joined Public “Office Hours”

Build your expertise in the BPF virtual machine in the Linux kernel with this practical guide for systems engineers. You’ll not only dive into the BPF program lifecycle but also … - Selection from Linux Observability with BPF [Book]


Links around eBPF (with pretty pictures):
• Falco: https://sysdig.com/blog/sysdig-and-falco-now-powered-by-ebpf/
• Pixie home page: https://pixielabs.ai/
• Cillium Home page: https://cilium.io/
• Article of diff solutions: https://cilium.io/


A nice article about philosoby of Alerting by Rob Ewaschuk, based on his observations while he was a Site Reliability Engineer at Google https://docs.google.com/document/d/199PqyG3UsyXlwieHaqbGiWVa8eMWi8zzAn0YfcApr8Q/edit#

To ensure that resources are distributed across the Availability Zones for a Region, we independently map Availability Zones to names for each account. For example, the Availability Zone us-east-1a for your AWS account might not have the same location as


shu-ha-ri 守破離
• 守 protect, obey - traditional wisdom - learning fundamentals, techniques, heuristics, proverbs
• 破 detach, digress - breaking with tradition - breaking with tradition—detachment from the illusions of self
• 離 leave, separate - transcendence - there are no techniques or proverbs, all moves are natural, becoming one with spirit alone without clinging to forms; transcending the physical

The way people learn skills changes as their ability in the skill grows.

Related, found this, looks funny: https://www.scruminc.com/scaling-scrum-lufthansa-scrum-day-stuttgart-may-2017/

In May I attended the Lufthansa Project Management Workshop near Frankfurt and then ScrumDay in Stuttgart. My keynote for both conferences was on the Shu, Ha, Ri of Scaling Scrum. At the Scrum Gathering in San Diego, I gave an earlier version of this presentation and polled the audience of over 1000 people. Two-thirds of […]

Community of about 200 Moken sea gypsies on Thailand’s South Surin Island lost most of their boats and all of their homes to tsunami, but people themselves escaped virtually unharmed to hills when tsunami barreled through Thailand’s South Surin Island on way to mainland; elders taught chief Salama Klathalay to expect tsunami whenever tide receded far and fast, and he raised alarm when he witnessed such a low tide; one disabled man who could not run was drowned; Moken will rebuild on different spot to avoid bad luck; map; photos (M)

Gabriel Boie has joined Public “Office Hours”

Agility is Inefficient … Klaus Bucka-Lassen Closing Keynote GOTOpia Chicago April 20th, 2021 https://files.gotocon.com/uploads/slides/conference_44/1765/original/Agility%20is%20inefficient%20%28GOTOpia%29%20-%20Handout.pdf



https://www.harbott.com/why-squads-and-tribes-probably-wont-work/ Key quote:
"Even at the time we wrote it, we weren't doing it. It was part ambition, part approximation. People have really struggled to copy something that didn't really exist."
Joakim Sundén, agile coach at Spotify 2011–2017

Unless you are a Swedish streaming company, founded in 2006, the Spotify squads and tribes is unlikely to work for your company’s unique context and culture.

Bash script to tail Kubernetes logs from multiple pods at the same time - johanhaleby/kubetail

2021-05-12

@here office hours is starting in 30 minutes! Remember to post your questions here.

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Patrick Joyce has joined Public “Office Hours”

Scott Mathson has joined Public “Office Hours”

Jacob Evans has joined Public “Office Hours”

Emile Fugulin has joined Public “Office Hours”

Andy Miguel (Cloud Posse) has joined Public “Office Hours”

Kevin Ryan has joined Public “Office Hours”

Andrew Grube has joined Public “Office Hours”

Steven Hopkins has joined Public “Office Hours”

Harold R has joined Public “Office Hours”

Dave Hill has joined Public “Office Hours”

mb Branski has joined Public “Office Hours”

Nate Selzer has joined Public “Office Hours”

Leo Zavala has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

katrina walker has joined Public “Office Hours”

Stevan Arychuk has joined Public “Office Hours”

Gilberto Michishita Junior has joined Public “Office Hours”

Sri has joined Public “Office Hours”

Venkata Mutyala has joined Public “Office Hours”

links from today’s announcements:
• https://www.infoq.com/news/2021/05/atlassian-open-devops/

Atlassian has released Open DevOps, their new platform offering integrating Atlassian products and partner offerings. Open DevOps integrates Jira Software, Confluence, Bitbucket, and Opsgenie into a single project. It is possible to integrate with other tools, such as GitHub and Datadog, with minimal integration.
IT engineers pride themselves on the skill and care they put into building applications and infrastructure. However, as much as we all hate to admit it, there is no such thing as 100% uptime. Everything will fail at some point, often at the worst possible time, leading to many a ruined evening, birthday party, or […]
This is a draft proposal for how Helm 4 development can proceed. Signed-off-by: Matt Butcher [email protected]
Closes #26838 This allows us to fully deprecate the template provider by allowing us to templatize a string. ✗ go install . ✗ ~/go/bin/terraform console > templatestring("Hello, $${name}!&q…

John Mitchell has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

Matt Calhoun has joined Public “Office Hours”

Luis Masaya has joined Public “Office Hours”

Alex Siegman has joined Public “Office Hours”

James Haughey has joined Public “Office Hours”

PePe Amengual has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

David Lozano has joined Public “Office Hours”

Andrew Way has joined Public “Office Hours”

Igor Bronovskyi has joined Public “Office Hours”

mb Branski has joined Public “Office Hours”

Michael Londeen has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

Isa Aguilar has joined Public “Office Hours”

mb Branski has joined Public “Office Hours”

Eric Berg has joined Public “Office Hours”

In this essay I go through a few steps that describe how to implement a read-only private Terraform registry, serving custom providers privately to be used with Terraform, using Python and Flask.

• anthology - Private Terraform registry implementation as an alternative to the official registry.
• citizen - Private Terraform Module Registry
• terraform-simple-registry - Simple implementation of the Terraform registry protocols.
A private Terraform registry implementation as an alternative to the official registry. - erikvanbrakel/anthology
A Private Terraform Module Registry. Contribute to outsideris/citizen development by creating an account on GitHub.
Contribute to apparentlymart/terraform-simple-registry development by creating an account on GitHub.

uwaila adams has joined Public “Office Hours”

Andy Roth has joined Public “Office Hours”

would like to hear some thoughts on AWS ECS copilot if anyone has given it a try
Develop, Release and Operate Container Apps on AWS.

Andrew Thompson has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

Michael Jenkins has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

Andrew Thompson has joined Public “Office Hours”

Here’s the beginning of the thread on Twitter about the different levels of answers for the same interview question that I mentioned:
https://twitter.com/QuinnyPig/status/1390802669321658369
Here’s the one I was talking about:
This is a terrific question that deserves a thread of its own. https://twitter.com/santi1524/status/1390746069643022339
@QuinnyPig @DuckbillGroup @awscloud Are you folks planning to hire junior level in the future?
Let me give an example of an interview question we used when filling our Principal Cloud Economist role:
“You’ve got $1m/mo in spend for a large Kubernetes cluster. What do you do to find ways to decrease the cost?”
I will pause here; hit reply and tell me your answers.

, I’m a fan of Corey Quinn also. I’ve been away for a few weeks, has @Erik Osterman (Cloud Posse): re-surfaced the discussion about k8s resource usage accounting?
This is a terrific question that deserves a thread of its own. https://twitter.com/santi1524/status/1390746069643022339
@QuinnyPig @DuckbillGroup @awscloud Are you folks planning to hire junior level in the future?
Let me give an example of an interview question we used when filling our Principal Cloud Economist role:
“You’ve got $1m/mo in spend for a large Kubernetes cluster. What do you do to find ways to decrease the cost?”
I will pause here; hit reply and tell me your answers.

The founder of cloudskiff contacted for feedback on driftctl (infra drift detection tool), https://github.com/cloudskiff/driftctl
Detect, track and alert on infrastructure drift. Contribute to cloudskiff/driftctl development by creating an account on GitHub.

Hi folks I’m part of the team. Happy to jump in whenever you discuss it
Detect, track and alert on infrastructure drift. Contribute to cloudskiff/driftctl development by creating an account on GitHub.

Just putting it out here if people want to try it and we can discuss it next office hour

2021-05-18
2021-05-19


I see that Hashicorp has v0.2 of Boundary (https://www.boundaryproject.io/). Maybe worth discussing in office hours and see if anyone has used it.

Boundary is an open source solution that automates a secure identity-based user access to hosts and services across environments.


I’m definitely interested in app runner. reminds me of GCP Cloud Run which is a super simple way to get a container image running in no time flat (in my experience).

@here office hours is starting in 30 minutes! Remember to post your questions here.

:question: : what is the best practice to get Terraform to pick up changes to modules? I am finding that unless I remove the .terraform/modules/x
` directory where the module is installed to force a new download/install, TF may or may not pick up changes to an unpinned module.

did you try terraform get -update
?

nope! TIL!

thanks

Michael Jenkins has joined Public “Office Hours”

Brandon vh has joined Public “Office Hours”

Mike Marseglia has joined Public “Office Hours”

Michael Londeen has joined Public “Office Hours”

Joe Hosteny has joined Public “Office Hours”

Luis Masaya has joined Public “Office Hours”

links from today’s session:
• https://www.hashicorp.com/blog/default-tags-in-the-terraform-aws-provider
• https://alex.kaskaso.li/post/terraform-plan-rce
• https://finance.yahoo.com/news/aws-announces-general-availability-aws-231000856.html
• https://krebsonsecurity.com/2021/05/try-this-one-weird-trick-russian-hackers-hate/
• https://github.com/hashicorp/terraform-provider-aws/pull/14714

Jeff Lanza has joined Public “Office Hours”

Brandon vh has joined Public “Office Hours”

what Allow operator to define a list of permitted users who can trigger atlantis commands why Currently, the only way to restrict access is by adding/revoking users from a repository altogether. We…

Brandon vh has joined Public “Office Hours”

Matt Calhoun has joined Public “Office Hours”

Vicken Simonian has joined Public “Office Hours”

Michael Jenkins has joined Public “Office Hours”

Scott Mathson has joined Public “Office Hours”

Anton Babenko has joined Public “Office Hours”

Eric Berg has joined Public “Office Hours”

Mike Marseglia has joined Public “Office Hours”

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Isa Aguilar has joined Public “Office Hours”

Michael Londeen has joined Public “Office Hours”

Luis Masaya has joined Public “Office Hours”

Andy Miguel (Cloud Posse) has joined Public “Office Hours”

Jacob Evans has joined Public “Office Hours”

Joaquin Menchaca has joined Public “Office Hours”

Nick James has joined Public “Office Hours”

Igor Bronovskyi has joined Public “Office Hours”

Steven Hopkins has joined Public “Office Hours”

Steven Hopkins has joined Public “Office Hours”

Jeff Lanza has joined Public “Office Hours”

Alex Siegman has joined Public “Office Hours”

Patrick Joyce has joined Public “Office Hours”

Florain Drescher has joined Public “Office Hours”

Eric Berg has joined Public “Office Hours”

Michael Padgett has joined Public “Office Hours”

Joe Hosteny has joined Public “Office Hours”

Prasanna Venkataraman has joined Public “Office Hours”

David Lozano has joined Public “Office Hours”

James Haughey has joined Public “Office Hours”

Rashid has joined Public “Office Hours”

Eric Berg has joined Public “Office Hours”

Universal dependency update tool that fits into your workflows. - renovatebot/renovate

Terraform question, you upgrade new minor version of terraform
, and suddenly, when doing terraform apply, it wasn’t to recreate your VPC, EKS, etc. Will this ever be fixed? Example, v0.12.30
to v0.12.31
.

Hao Wang has joined Public “Office Hours”

Emile Fugulin has joined Public “Office Hours”

Reverse Proxy web caching looks interesting, can work with nginx, apache, traefik… https://github.com/Darkweak/Souin
A cache system built on top of different reverse-proxy to cache data easily and save precious ms compatible with @traefik, @caddyserver, @nginx and @apache - Darkweak/Souin

Pasted that a few days ago, https://github.com/cloudskiff/driftctl wanted to know if people used it on large production system

Guard offers a policy-as-code domain-specific language (DSL) to write rules and validate JSON- and YAML-formatted data such as CloudFormation Templates, K8s configurations, and Terraform JSON plans…

Learn how to create resource types for use in CloudFormation templates.

would like to hear some thoughts on AWS ECS copilot if anyone has given it a try
Develop, Release and Operate Container Apps on AWS.

2021-05-20

2021-05-21
2021-05-24
2021-05-25
2021-05-26

@here office hours is starting in 30 minutes! Remember to post your questions here.

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Florain Drescher has joined Public “Office Hours”

Andy Miguel (Cloud Posse) has joined Public “Office Hours”

Eric Berg has joined Public “Office Hours”

Michael Sew has joined Public “Office Hours”

Gilberto Michishita Junior has joined Public “Office Hours”

links from today’s announcements:
• https://www.techradar.com/news/why-system-backups-no-longer-shield-against-ransomware

Backups no longer provide the protection against ransomware that they once did

AWS recently released Warm Pools for EC2 Auto Scaling, which reduces the time and cost to scale out (aka horizontal scaling) applications by maintaining a pool of pre-initialized instances.

The Terraform AWS provider now supports predictive scaling policy, a machine learning based scaling mechanism of Amazon EC2 Auto Scaling.

Tim Gourley has joined Public “Office Hours”

James Haughey has joined Public “Office Hours”

emem umoh has joined Public “Office Hours”

Stevan Arychuk has joined Public “Office Hours”

Patrick Joyce has joined Public “Office Hours”

Brian Ojeda has joined Public “Office Hours”

Vlad Ionescu has joined Public “Office Hours”

Wilson Chan has joined Public “Office Hours”

Amelia Graycen has joined Public “Office Hours”

Mohammed Yahya has joined Public “Office Hours”

looks like my connection died again

Andrey Nazarov has joined Public “Office Hours”

Erik Osterman (Cloud Posse) has joined Public “Office Hours”


We are currently building AWS regions in Australia, Indonesia, Spain, India, and Switzerland. UAE in the Works I am happy to announce that the AWS Middle East (UAE) Region is in the works and will open in the first half of 2022. The new region is an extension of our existing investment, which already includes […]

- AWS Container Day @ DockerCon!

Stan M has joined Public “Office Hours”

Hao Wang has joined Public “Office Hours”

DockerCon’21 is starting tomorrow:)) https://docker.events.cube365.net/dockercon-live/2021

Attend DockerCon 2021 to see how Docker helps make it easy for you to focus more of your time on coding the next great application: from code to cloud. Submit your registration now to attend DockerCon 2021– designed for developers by developers.

Michael Jenkins has joined Public “Office Hours”

PePe Amengual has joined Public “Office Hours”

Mazin Ahmed has joined Public “Office Hours”

Oliver Schoenborn has joined Public “Office Hours”

Rajiv Ranjan has joined Public “Office Hours”

Joe Hosteny has joined Public “Office Hours”

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

imran.hussain has joined Public “Office Hours”

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

PePe Amengual has joined Public “Office Hours”

ASIS SETHI has joined Public “Office Hours”

ASIS SETHI has joined Public “Office Hours”

Older presentation video/review for copilot video: https://www.youtube.com/watch?v=Ay8iUFWzF4U. There was a new Copilot video today at AWS Container Day. It should be up on YouTube tomorrow

Jailson Silva has joined Public “Office Hours”

Andy Roth has joined Public “Office Hours”

Copilot pipeline link, as requested: https://github.com/aws/copilot-cli/blob/da8967617d9d0d299d1e03e4559aa15367ae62c6/site/content/docs/concepts/pipelines.en.md
The AWS Copilot CLI is a tool for developers to build, release and operate production ready containerized applications on AWS App Runner, Amazon ECS, and AWS Fargate. - aws/copilot-cli

Anybody have experience restoring RDS snapshots, using Terraform? I’m just starting to look into this and I’m wondering how subsequent TF applies are impacted by setting snapshot_identifier
, but what about subsequent applies? I saw some comments about setting ignore_changes
for snapshot_identifier
, whcih I’m thinking I should include as a variable for the TF, to manage it that way, rather than the data aws_db_snapshot
source

I did before and it always recreated the RDS instance no matter what snapshot_identifier
is used

it should be a bug

David Lozano has joined Public “Office Hours”

Blaise Pabon has joined Public “Office Hours”

A V has joined Public “Office Hours”


driftctl is a free and open-source CLI that warns of infrastructure drift and fills in the missing piece in your DevSecOps toolbox.

question 1, how to use for_each
with TF?

Great tutorial here https://learn.hashicorp.com/tutorials/terraform/for-each

Provision similar infrastructure components by iterating over a data structure with the for_each argument. Duplicate an entire VPC including a load balancer and multiple EC2 instances for each project defined in a map.


uwaila adams has joined Public “Office Hours”
