#office-hours (2023-01)

“Office Hours” are every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers! https://cloudposse.com/office-hours

Public “Office Hours” are held every Wednesday at 11:30 PST via Zoom. It’s open to everyone. Ask questions related to DevOps & Cloud and get answers!

https://cpco.io/slack-office-hours

Meeting password: sweetops

2023-01-03

Oleksandr Lytvyn avatar
Oleksandr Lytvyn

Hello everyone, i would like to ask about deployment of AWS Config in AWS Organizations. From what i can see in documentation, YouTube, and in Google’s results overall - there are a lot of examples of deployment using CloudFormation StackSet’s. But in our company we’re using Terraform (and not using CloudFormation).

Question: did anyone tried to deploy AWS Config in AWS Organizations (i.e. multi-region + multi-account) features as Conformance Packs and overall enforcing 1 rule to all AWS Org member accounts (and selected regions)? Is there any caveats or limitations / features (compared to deploying same setup, but with CloudFormation StackSet’s)?

(PS. Maybe i asked question in wrong chat, I’m new here )

David avatar

Would love to offer suggestions but I don’t understand your question clearly

David avatar

I’d say you should go with terraform for provisioning as one of the major points it has for it as against cloudformation is the avoidance of vendor lock-in

Oleksandr Lytvyn avatar
Oleksandr Lytvyn

In short: could it be done (deploying AWS Config in AWS organizations, across multiple accounts & multiple regions) via Terraform (while almost all if not all examples that i’ve seen so far are CloudFormation StackSets)?

David avatar

Yes, can be done with terraform using the right providers and resources

David avatar

here are some helpful links

David avatar
Terraform on AWS: Multi-Account Setup and Other Advanced Tipsattachment image

Terraform has been developed from the ground up to be multi-cloud and supports a vast array of providers that can be used within a given set of scripts.

David avatar

Hope these help

Oleksandr Lytvyn avatar
Oleksandr Lytvyn

Thank you

1
Eric Berg avatar
Eric Berg

@Erik Osterman (Cloud Posse), re deploying ingress controller crds, where are those examples of deploying multi-doc yaml manifests, using the kubernetes_manifest resources instead of kubectl_manifest?

2023-01-04

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
07:00:37 PM

@here office hours is starting in 30 minutes! Remember to post your questions here.

Sean Turner avatar
Sean Turner

Reposting from above, I got missed a few weeks ago ha.

Q: What are some good ways to update an application in argo with the new docker tag?

Some options… • image updater sounds great and it’s on the roadmap to be added to argocd • eventbridge watching docker pushes which triggering lambda container with a git library doing the replacement on values.yaml? • CI mechanism building images does the replacement in values.yaml and makes a commit?

1
Sean Turner avatar
Sean Turner
#11787 docs: image updater first class status proposal

Signed-off-by: Jaideep Rao [email protected]

Note on DCO:

If the DCO action in the integration test fails, one or more of your commits are not signed off. Please click on the Details link next to the DCO action for instructions on how to resolve this.

Checklist:

☑︎ Either (a) I’ve created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this does not need to be in the release notes. ☑︎ The title of the PR states what changed and the related issues number (used for the release note). ☐ I’ve included “Closes [ISSUE #]” or “Fixes [ISSUE #]” in the description to automatically close the associated issue. ☐ I’ve updated both the CLI and UI to expose my feature, or I plan to submit a second PR with them. ☐ Does this PR require documentation updates? ☐ I’ve updated documentation as required by this PR. ☑︎ Optional. My organization is added to USERS.md. ☑︎ I have signed off all my commits as required by DCO ☐ I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged. ☐ My build is green (troubleshooting builds).

Zoom avatar
Zoom
07:30:11 PM

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:26 PM

Omry Hay has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:34 PM

Andy Roth has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:37 PM

Brian Pauley has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:43 PM

Ralf Pieper has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:43 PM

Linda Pham (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:44 PM

Sean Turner has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:48 PM

Maura Rowell has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:58 PM

Andrew Vitko has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:03 PM

Andy Wortman has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:20 PM

Luis Masaya has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:53 PM

Michael Jenkins has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:10 PM

Joe Caulfield has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:13 PM

Charles Smith has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:03 PM

Stevan Arychuk has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:09 PM

Roy Sprague has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:33 PM

dag viggo lokoeen has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:48 PM

Guillermo Gutierrez has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:52 PM
Zoom avatar
Zoom
07:35:57 PM

Steven Vargas has joined Public “Office Hours”

Zoom avatar
Zoom
07:39:57 PM

Harold Sphinx has joined Public “Office Hours”

Zoom avatar
Zoom
07:40:20 PM

Guelor Emanuel has joined Public “Office Hours”

Zoom avatar
Zoom
07:40:51 PM

Isa Aguilar has joined Public “Office Hours”

Zoom avatar
Zoom
07:41:46 PM

Mazin Ahmed has joined Public “Office Hours”

Zoom avatar
Zoom
07:42:39 PM

Isaac M has joined Public “Office Hours”

Zoom avatar
Zoom
07:43:53 PM

Peter L has joined Public “Office Hours”

Zoom avatar
Zoom
07:44:10 PM

Oliver Schoenborn has joined Public “Office Hours”

Zoom avatar
Zoom
07:46:47 PM

Sergei Valevka has joined Public “Office Hours”

Zoom avatar
Zoom
07:49:24 PM

Paul Bullock has joined Public “Office Hours”

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
gofireflyio/aiac

Artificial Intelligence Infrastructure-as-Code Generator.

Zoom avatar
Zoom
08:13:01 PM

Salvador Montiel has joined Public “Office Hours”

Zoom avatar
Zoom
08:16:14 PM

David Ekpo has joined Public “Office Hours”

2023-01-05

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
Microsoft Bing With ChatGPT Reportedly Launching In Marchattachment image

Microsoft’s Bing search engine is set to get a boost with the integration of OpenAI’s ChatGPT chatbot technology.

3

2023-01-11

Vlad Ionescu (he/him) avatar
Vlad Ionescu (he/him)

S3 caching, among others, is now in mainline buildkit and buildx!

fiesta_parrot1
Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
07:00:34 PM

@here office hours is starting in 30 minutes! Remember to post your questions here.

Zoom avatar
Zoom
07:29:40 PM

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:43 PM

Brian Pauley has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:46 PM

Oliver Schoenborn has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:50 PM

Vlad Ionescu has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:55 PM

Linda Pham (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:01 PM

Isaac M has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:29 PM

Jeremy White has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:49 PM

Andrew Vitko has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:36 PM

Trina King has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:58 PM

Bryan Dady has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:07 PM

Eric Berg has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:26 PM

Matt Calhoun has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:29 PM

Sumeet Agarwal has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:51 PM

Greg Bouwens has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:01 PM

Jim Park has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:03 PM

Arthur Dent has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:54 PM

Ashley Delbridge has joined Public “Office Hours”

Zoom avatar
Zoom
07:34:32 PM

Salvador Montiel has joined Public “Office Hours”

Zoom avatar
Zoom
07:35:10 PM

Yusuf has joined Public “Office Hours”

Zoom avatar
Zoom
07:36:02 PM

Andy Roth has joined Public “Office Hours”

Zoom avatar
Zoom
07:36:24 PM

Harold Sphinx has joined Public “Office Hours”

Zoom avatar
Zoom
07:38:47 PM

Igor M has joined Public “Office Hours”

Zoom avatar
Zoom
07:39:20 PM

Alex Siegman has joined Public “Office Hours”

Zoom avatar
Zoom
07:44:57 PM

Paul Marcelin has joined Public “Office Hours”

Zoom avatar
Zoom
07:47:49 PM

Roy Sprague has joined Public “Office Hours”

Zoom avatar
Zoom
07:48:48 PM

Ashwin Jacob has joined Public “Office Hours”

Zoom avatar
Zoom
07:48:59 PM

Joe Perez has joined Public “Office Hours”

Zoom avatar
Zoom
07:50:27 PM

Paul Bullock has joined Public “Office Hours”

Zoom avatar
Zoom
07:52:15 PM

Michael Jenkins has joined Public “Office Hours”

Zoom avatar
Zoom
07:53:33 PM

Brad Curfman has joined Public “Office Hours”

Zoom avatar
Zoom
07:56:00 PM

Roy Sprague has joined Public “Office Hours”

Zoom avatar
Zoom
08:02:21 PM

Michael Sew has joined Public “Office Hours”

Zoom avatar
Zoom
08:03:49 PM

Martin Mazurik has joined Public “Office Hours”

Zoom avatar
Zoom
08:07:10 PM

David Ekpo has joined Public “Office Hours”

Zoom avatar
Zoom
08:10:38 PM

PePe Amengual has joined Public “Office Hours”

2023-01-18

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
07:00:47 PM

@here office hours is starting in 30 minutes! Remember to post your questions here.

party_parrot1
sweetops1
venkata.mutyala avatar
venkata.mutyala

For autogenerating Helm chart README.md’s what do you folks use? I came across the following options, does anyone have another recommendation?

https://github.com/norwoodj/helm-docs

https://github.com/bitnami-labs/readme-generator-for-helm

norwoodj/helm-docs
bitnami-labs/readme-generator-for-helm
1
Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

@Igor Rodionov

norwoodj/helm-docs
bitnami-labs/readme-generator-for-helm
Zoom avatar
Zoom
07:27:41 PM

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:28:49 PM

Marc Tamsky has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:28 PM

Jonathan Poczatek has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:07 PM

Brad Curfman has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:10 PM

Peter Luknar has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:28 PM

Linda Pham (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:28 PM

Paul Marcelin has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:34 PM

Michael Jenkins has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:47 PM

venkata mutyala has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:11 PM

Brian Pauley has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:19 PM

Geordan Liban has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:24 PM

Maura Rowell has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:35 PM

deniz gokcin has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:43 PM

Alex Atkinson has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:46 PM

Matt Reggler has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:56 PM

Isa Aguilar has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:59 PM

tyler has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:08 PM

Paul Bullock has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:21 PM

Matt Calhoun has joined Public “Office Hours”

deniz gökçin avatar
deniz gökçin

last minute question:

We are on GitHub Teams plan and I was wondering how are the folks here handling shared-actions. I have some workflows that are identical in all repos and I have some workfows that have minor differences in different repos. Although I am using dependabot to handle version bumps, it started to be super painful to update 30+ repos whenever I think of an enhancement. Any tips??

April avatar

We swapped from gitlab to github and now use reusable workflows.

April avatar
scientist-softserv/actions

Github CI Actions Repo

April avatar
name: "Build Lint Test"
on:
  push:
    branches:
      - main
  pull_request:
    branches:
      - main
  workflow_dispatch:
    inputs:
      debug_enabled:
        type: boolean
        description: 'Run the build with tmate debugging enabled (<https://github.com/marketplace/actions/debugging-with-tmate>)'
        required: false
        default: false

jobs:
  build:
    uses: scientist-softserv/actions/.github/workflows/[email protected]
    secrets: inherit
    with:
      platforms: "linux/amd64"
      target: hyku-base
      worker: true
      workerTarget: hyku-worker
  test:
    needs: build
    uses: scientist-softserv/actions/.github/workflows/[email protected]
    with:
      worker: true
  lint:
    needs: build
    uses: scientist-softserv/actions/.github/workflows/[email protected]
    with:
      worker: true

Zoom avatar
Zoom
07:34:14 PM

Jim Park has joined Public “Office Hours”

Zoom avatar
Zoom
07:34:15 PM

Ashwin Jacob has joined Public “Office Hours”

Zoom avatar
Zoom
07:34:25 PM

Soren Jensen has joined Public “Office Hours”

Zoom avatar
Zoom
07:34:43 PM

Andrew Vitko has joined Public “Office Hours”

Zoom avatar
Zoom
07:34:44 PM

Ashwin Jacob has joined Public “Office Hours”

Zoom avatar
Zoom
07:35:55 PM

Isaac M has joined Public “Office Hours”

Zoom avatar
Zoom
07:35:57 PM

Harold Sphinx has joined Public “Office Hours”

Zoom avatar
Zoom
07:37:34 PM

Christopher Pieper has joined Public “Office Hours”

Zoom avatar
Zoom
07:40:46 PM

Matt Ouellette has joined Public “Office Hours”

Zoom avatar
Zoom
07:40:48 PM

Harold Sphinx has joined Public “Office Hours”

Zoom avatar
Zoom
07:53:25 PM

Matt Ouellette has joined Public “Office Hours”

Zoom avatar
Zoom
08:01:31 PM

PePe Amengual has joined Public “Office Hours”

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
Hello kubectl cost: monitoring Kubernetes spend from the command line!

If you’re terminal-loving engineers using Kubernetes like us, kubectl is your constant companion. That’s why the Kubecost team built a new CLI for interacting with Kubernetes cost data. Today, we’re announcing kubectl cost, an open-source extension that fits directly into your workflow.

2023-01-21

omerfsen avatar
omerfsen

Hello guys, Is there a tool that i can search and list versions of docker image on dockerhub ? docker search searches for versions but do not list available image versions/tags

omerfsen avatar
omerfsen
#!/bin/bash

set -e

# User to search for
UNAME=${1}


# get token to be able to talk to Docker Hub
TOKEN=dckr_pat_XXXXXXXXXXXXXXXXXXXXXXXx
#TOKEN=$(curl -s -H "Content-Type: application/json" -X POST -d '{"username": "'${UNAME}'", "password": "'${UPASS}'"}' <https://hub.docker.com/v2/users/login/> | jq -r .token)

# get list of namespaces accessible by user (not in use right now)
#NAMESPACES=$(curl -s -H "Authorization: JWT ${TOKEN}" <https://hub.docker.com/v2/repositories/namespaces/> | jq -r '.namespaces|.[]')

# get list of repos for that user account
REPO_LIST=$(curl -s -H "Authorization: JWT ${TOKEN}" <https://hub.docker.com/v2/repositories/${UNAME}/?page_size=10000> | jq -r '.results|.[]|.name')

# build a list of all images & tags
for i in ${REPO_LIST}
do
  # get tags for repo
  IMAGE_TAGS=$(curl -s -H "Authorization: JWT ${TOKEN}" <https://hub.docker.com/v2/repositories/${UNAME}/${i}/tags/?page_size=10000> | jq -r '.results|.[]|.name')

  # build a list of images from tags
  for j in ${IMAGE_TAGS}
  do
    # add each tag to list
    FULL_IMAGE_LIST="${FULL_IMAGE_LIST} ${UNAME}/${i}:${j}"
  done
done

# output list of all docker images
for i in ${FULL_IMAGE_LIST}
do
  echo ${i}
done
omerfsen avatar
omerfsen

I have modified https://stackoverflow.com/a/60549026/7281491 to match my need … It works

How can I use Docker Registry HTTP API V2 to obtain a list of all repositories in a docker registry?

An external organization that I work with has given me access to a private (auth token protected) docker registry, and eventually I would like to be able to query this registry, using docker’s HTTP…

1

2023-01-22

managedkaos avatar
managedkaos

Interesting looking tool for simulating k8s clusters… https://kwok.sigs.k8s.io/

Home

KWOK (Kubernetes WithOut Kubelet) # kwok is a toolkit that enables setting up a cluster of thousands of Nodes in seconds. Under the scene, all Nodes are simulated to behave like real ones, so the overall approach employs a pretty low resource footprint that you can easily play around on your laptop. So far we provide two tools: Kwok: Core of this repo. It simulates thousands of fake Nodes. Kwokctl: A CLI to facilitate creating and managing clusters simulated by Kwok.

2023-01-23

jsreed avatar

Jesus… that’s gonna be the next step to containers… now they arent even “real”

jsreed avatar

it’s virtualization on top of virtualization on top of virtualization -> simulation aka the matrix LOOOOOL

2
10001
jsreed avatar

sounds like it’s just building a cluster completely in RAM

fast_parrot1
1
managedkaos avatar
managedkaos

And here’s another one. some sort of Vault-competitor, secrets management tool: https://infisical.com/ https://github.com/Infisical/infisical

Infisical an open-source end-to-end encrypted tool to sync secrets and configs across your team and infrastructure.attachment image

Infisical lets developers manage secrets and environments. Used by everyone from small teams to large corporations. Save time and improve security.

Infisical/infisical

Infisical is an open-source, end-to-end encrypted tool to sync secrets and configs across your team and infrastructure.

2023-01-25

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
07:00:42 PM

@here office hours is starting in 30 minutes! Remember to post your questions here.

Zoom avatar
Zoom
07:28:46 PM

Erik Osterman (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:38 PM

Brian Pauley has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:45 PM

Allan Mohr has joined Public “Office Hours”

Zoom avatar
Zoom
07:29:51 PM

Linda Pham (Cloud Posse) has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:42 PM

Nenna Salinas has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:46 PM

Ralf Pieper has joined Public “Office Hours”

Zoom avatar
Zoom
07:30:49 PM

Michael Jenkins has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:23 PM

Roy Sprague has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:32 PM

Harold Sphinx has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:47 PM

Matt Calhoun has joined Public “Office Hours”

Zoom avatar
Zoom
07:31:47 PM

Andy Wortman has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:19 PM

Jim Park has joined Public “Office Hours”

Zoom avatar
Zoom
07:32:46 PM

Gabriel Tam has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:18 PM

Isaac M has joined Public “Office Hours”

Zoom avatar
Zoom
07:33:28 PM

Dave Lundgren has joined Public “Office Hours”

Zoom avatar
Zoom
07:36:58 PM

Michael Pursifull has joined Public “Office Hours”

Zoom avatar
Zoom
07:37:00 PM

dag viggo lokoeen has joined Public “Office Hours”

Zoom avatar
Zoom
07:37:21 PM

Matt Gowie has joined Public “Office Hours”

Zoom avatar
Zoom
07:38:14 PM

David Ekpo has joined Public “Office Hours”

Zoom avatar
Zoom
07:42:44 PM

Paul Marcelin has joined Public “Office Hours”

Zoom avatar
Zoom
07:44:50 PM

Soren Jensen has joined Public “Office Hours”

Zoom avatar
Zoom
07:51:29 PM

Azar AKB has joined Public “Office Hours”

Zoom avatar
Zoom
08:10:32 PM

Marc Tamsky has joined Public “Office Hours”

Gabriel avatar
Gabriel

regarding the question yesterday about communication between (micro)services, maybe this article and the idea can help https://martinfowler.com/bliki/ParallelChange.html

“The API expand-contract pattern, sometimes called parallel change, will be familiar to many, especially when used with databases or code; however, we only see low levels of adoption with APIs. Specifically, we’re seeing complex versioning schemes and breaking changes used in scenarios where a simple expand and then contract would suffice. For example, first adding to an API while deprecating an existing element, and then only later removing the deprecated elements once consumers are switched to the newer schema. This approach does require some coordination and visibility of the API consumers, perhaps through a technique such as consumer-driven contract testing.” Thoughtworks

    keyboard_arrow_up