#random (2020-03)

Non-work banter and water cooler conversation

A place for non-work-related flimflam, faffing, hodge-podge or jibber-jabber you’d prefer to keep out of more focused work-related channels. Archive: https://archive.sweetops.com/random/

2020-03-31

Bart M. avatar
Bart M.

how ‘zero downtime’? ^^

2020-03-30

Joe Niland avatar
Joe Niland

This looks really interesting as a self hosted alternative to Zapier and similar https://www.furnace.io/

Furnace

A Modern Cloud Framework that you can leverage to build powerful data driven applications, rapidly, without being a cloud or Serverless expert.

chinedu2424 avatar
chinedu2424

any suggestions I need to build a microservice infrastructure. Need to have the following.

  • Postgres Database
  • Redis Database
  • Web Application

Create a zero downtime auto deployment plan for the web application and microservice

2020-03-29

vFondevilla avatar
vFondevilla

@Erik Osterman you’re using the slack-export-viewer for the archive.cloudposse.com no? I saw you had some issues with the original repo, I tried to use the cloudposse one but I keep having issues with the “TypeError: string indices must be integers” any hint?

Erik Osterman avatar
Erik Osterman

No we wrote our own

Erik Osterman avatar
Erik Osterman

Couldn’t get that one to work and it was over-architected

vFondevilla avatar
vFondevilla

Well good to know! Thanks for the info

2020-03-27

Erik Osterman avatar
Erik Osterman

Adding @ bot

discourse_forum avatar
discourse_forum
10:06:17 PM

@ has joined the channel

2020-03-26

Erik Osterman avatar
Erik Osterman
Humio announces $20M Series B to advance unlimited logging tool – TechCrunch attachment image

Humio, a startup that has built a modern unlimited logging solution, announced a $20 million Series B investment today. Dell Technologies Capital led the round with participation from previous investor Accel. Today’s investment brings the total raised to $32 million, according to the company.…

Pierre Humberdroz avatar
Pierre Humberdroz

does someone here know a similar tool like jq for yaml?

bradym avatar
bradym

There are a couple different tools called yq - I prefer this one: https://github.com/kislyuk/yq

kislyuk/yq

Command-line YAML and XML processor - jq wrapper for YAML/XML documents - kislyuk/yq

bradym avatar
bradym

It does require jq, as it’s just a jq wrapper

Pierre Humberdroz avatar
Pierre Humberdroz

I saw that one as well as oq which seems to have less features and is a rewrite.

Pierre Humberdroz avatar
Pierre Humberdroz

Thanks !

bradym avatar
bradym

I’ve also seen https://github.com/mikefarah/yq - might be worth a look as it has some sed-like commands that could be useful

mikefarah/yq

yq is a portable command-line YAML processor. Contribute to mikefarah/yq development by creating an account on GitHub.

Pierre Humberdroz avatar
Pierre Humberdroz

thanks that seems even better for my use case

Erik Osterman avatar
Erik Osterman

Yep, we use the one by mikefarah and distribute it here with our alpine packages https://github.com/cloudposse/packages/tree/master/vendor/yq

cloudposse/packages

Cloud Posse installer and distribution of native apps, binaries and alpine packages - cloudposse/packages

1

2020-03-22

Joe Hosteny avatar
Joe Hosteny

We are doing something similar with our pipeline. We have developed a pretty nice set of ansible modules for interacting with the github api, and are hoping to open source these. The yaml definitions also control deployment of artifactory permissions (and repositories, eventually), and credential injection into SSM for CI.

2020-03-21

Zachary Loeber avatar
Zachary Loeber

@sheldonh what did you use to parse your yaml file for such a construct? Willing to share?

sheldonh avatar
sheldonh

Sure! Basically what I did is I set up a QA and a prod folder. Each of the plans for each environment resided in this. This is different than some examples where you see a plan with a QA and prod folder in its own location.

Then in the parent QA folder I had a yellow file for default settings, and an override yaml in the folder below. Since merge function overrides existing matches you can override any default value in the child folder if required, otherwise you don’t have to define anything extra

sheldonh avatar
sheldonh

I use the yamldecode function and merge that are built into terraform

sheldonh avatar
sheldonh

After having done this more complicated project, I’m mixed on whether or not I would do it this way again. If I modify this I might consider just setting these as locals and having the overrides also be a local file, or more likely leverage auto.tfvars . Terraform cloud is a bit confusing so I didn’t know about the auto overrides option at the time.

sheldonh avatar
sheldonh

If I was doing this again I’d say explore QA.auto.tfvars. Would be a more standard way and what I’d likely do in the future

2020-03-20

sheldonh avatar
sheldonh

I have 40+ repos, but I try to keep them all single purpose focused to avoid mono repo format, esp with terraform modules. I just recently created a terraform CICD plan that takes a yaml file and creates the repos, establishes branch policies, notifications, merge/squash/rebase options etc. I don’t think count of repos should be too concerning if you have a way to manage them effectively.

Erik Osterman avatar
Erik Osterman

Is this also so that to create new repos someone opens a PR and updates the repo YAML config?

sheldonh avatar
sheldonh

Right now I’m trying to convince people to use it so it’s just for my team. As such I’m not doing any pull requests or more strict process. Adoption for any more structure is really just tough right now. I don’t think any of the teams use git with best practices at all right now. I was looking through some history and see no evidence of squashing commits to keep a nice clean history it’s all very messy

sheldonh avatar
sheldonh

I think reducing the overhead to submitting something is really important right now if I want to gain even this small win

sheldonh avatar
sheldonh

The main reason I like to create separate repos is for simplifying potential Azure DevOps pipelines. I might reconsider this soon and try to do more of a mono repo format for anything plan related, but most of the time it’s easier just to isolate the work into small repos for specific purposes

Erik Osterman avatar
Erik Osterman

makes sense

2020-03-19

Zachary Loeber avatar
Zachary Loeber

Your project has 30 repos. The origin of the initial commit for 20+ of them are from you….do you take pride or shame in that fact?

ikar avatar

Definitely! Unless your job position title is: Director of Creating New Repositories

MattyB avatar
MattyB

More context needed. I worked at a company that had over 150 repos. Most of them Java with under 20 commits, the rest DB related. They could definitely be consolidated into ~30 Java repos with 10 being parent repos. I’d give you $100 to slap the person that created all of them, followed by a good public shaming.

3

2020-03-17

Erik Osterman avatar
Erik Osterman
<https://devblogs.microsoft.com/oldnewthing/20200317-00/?p=103566 https://devblogs.microsoft.com/oldnewthing/20200317-00/?p=103566>
We called it RAID because it kills bugs dead | The Old New Thing

The history of defect tracking in the Windows team goes back to Windows 1.0, which used a text file. After Windows 1.01 released, a bunch of people in the apps division got together and threw together a bug tracking database. Because hey,

1

2020-03-16

Erik Osterman avatar
Erik Osterman
npm is joining GitHub - The GitHub Blog attachment image

We’re excited to announce that npm will be joining GitHub.

ikar avatar

Is this a good news or a bed news?

npm is joining GitHub - The GitHub Blog attachment image

We’re excited to announce that npm will be joining GitHub.

1

2020-03-13

2020-03-12

Nikola Velkovski avatar
Nikola Velkovski
Cognito Feedback · Issue #3495 · aws-amplify/amplify-js

From the issues created in this repo, the lack of responsiveness from the Cognito team which keep issues not being acknowledged, the state of the code for all the SDKs related to Cognito, and the i…

Maciek Strömich avatar
Maciek Strömich

Don’t get me even started on Cognito .

Cognito Feedback · Issue #3495 · aws-amplify/amplify-js

From the issues created in this repo, the lack of responsiveness from the Cognito team which keep issues not being acknowledged, the state of the code for all the SDKs related to Cognito, and the i…

Nikola Velkovski avatar
Nikola Velkovski

I have the feeling that everything on aws that is not S3, EC2, Route53 is crappish. Some services more than the others and then cognito :-D

Maciek Strömich avatar
Maciek Strömich

I mean basic functionality works. you can create users and authenticate them. ;D fun starts when you try to e.g. add federated identities or extend attribute schema with some custom attribs which then are not being returned within auth resp

Joe Niland avatar
Joe Niland

Do you guys prefer Auth0 or something else?

Pierre Humberdroz avatar
Pierre Humberdroz

I use keycloak a lot

Maciek Strömich avatar
Maciek Strömich

@Joe Niland hell no. Why do you want to give one of your assets (customer information) to some 3rd party?

Maciek Strömich avatar
Maciek Strömich

we were looking into using https://www.openiam.com/ but it’s not fitting out usecase so the idea to host it ourselves was dropped and we build sso solution based on Cognito serving as an identity provider and oauth2

Home - OpenIAM - Open Source Identity Governance, Web Access SSO, MFA, Privileged ID

OpenIAM provides a fully integrated Identity Governance and Access Management platform. Deploy on-premise or use as Identity-as-a-Service. Based in New York

:--1:1
Maciek Strömich avatar
Maciek Strömich

quick question: does archive.ubuntu.com work for anyone of you?

Alex Siegman avatar
Alex Siegman

was able to browse it just now in the browser

Alex Siegman avatar
Alex Siegman

and apt updates from [us-east-1.ec2.archive.ubuntu.com](http://us-east-1.ec2.archive.ubuntu.com) work just fine

Erik Osterman avatar
Erik Osterman

Wfm

Maciek Strömich avatar
Maciek Strömich

thanks. in the end it was my proxy configuration which was misbehaving

:--1:1
bradym avatar
bradym

Anyone use https://github.com/pusher/oauth2_proxy? I’ve been using it successfully in k8s with nginx-ingress for several months, and after deploying changes to an app (without touching the oauth2_proxy or ingress settings) I’m getting wierd redirect behavior I can’t figure out.

pusher/oauth2_proxy

A reverse proxy that provides authentication with Google, Github or other providers. - pusher/oauth2_proxy

Erik Osterman avatar
Erik Osterman

We used to use it before bitly’s version became EOL

pusher/oauth2_proxy

A reverse proxy that provides authentication with Google, Github or other providers. - pusher/oauth2_proxy

Erik Osterman avatar
Erik Osterman

Fork happened later (pusher repo)

Erik Osterman avatar
Erik Osterman

most recently @btai has been looking into it

Erik Osterman avatar
Erik Osterman

We moved to Keycloak + Gatekeeper instead. More robust (and complicated) solution.

bradym avatar
bradym

I’ve been quite happy with it, and now I’m just confused.

Erik Osterman avatar
Erik Osterman

Confused in what way?

bradym avatar
bradym

Everything was working perfectly, and without touching it I’m now getting wierd redirects.

Specifically if I go to https://example.com/page I’m being redirected to https://example.com/example.com/page

bradym avatar
bradym

I made some minor changes to the app running behind the proxy, did not touch the ingress definition or oauth2_proxy config at all.

bradym avatar
bradym

Oof. I’ve been looking in the wrong place. It was my changes.

1
bradym avatar
bradym

I’m annoyed that it took me so long to realize, but relieved it was my own fault.

bradym avatar
bradym

The alternative is… terrifying.

Zachary Loeber avatar
Zachary Loeber

I’d sooo rather find out something is my fault than have something randomly start working again

bradym avatar
bradym

Exactly! One is just “oh, I’m being a little dumb” the other is “what happened to reality?!”

2
Zachary Loeber avatar
Zachary Loeber

Way easier to explain to others as well. Telling someone that cloud gremlins are to blame just sounds like you are hiding something….

Zachary Loeber avatar
Zachary Loeber

#anti-cloudgremlins

bradym avatar
bradym

haha! Yeah, gotta keep that one in reserve for when the cloud gremlins really show up.

2020-03-11

2020-03-10

2020-03-09

Maciek Strömich avatar
Maciek Strömich

datadog vs newrelic. your thoughs? I’m using newrelic now but datadog seems cheaper in my setup so I’m looking for additional pros and cons of the two?

Zachary Loeber avatar
Zachary Loeber

Not certain on new relic anymore but the last time I used it there was more of a slant towards application monitoring instead of actual infrastructure monitoring.

Zachary Loeber avatar
Zachary Loeber

been a while though

Zachary Loeber avatar
Zachary Loeber

I’ve been implementing datadog via terraform recently and that has proven to be quite useful for lining up the deployed infra with baseline monitors for metrics and such

Zachary Loeber avatar
Zachary Loeber

the integration for datadog is pretty expansive as well

Zachary Loeber avatar
Zachary Loeber

pricing seems to be per host as well, they get a bit dismayed if you just use say azure integration and filter out all of your VMs….

Zachary Loeber avatar
Zachary Loeber

their logging costs aren’t too bad either I suppose

Andrew Jeffree avatar
Andrew Jeffree

datadog for monitoring. newrelic for apm.

:--1:1
Andrew Jeffree avatar
Andrew Jeffree

Datadog have an APM product but our experience with it hasn’t been great.

Maciek Strömich avatar
Maciek Strömich

thanks. need to check the datadog apm whether it fits our needs then

David avatar
David

How do y’all manage brew packages that you want everyone to have?

RB avatar

I use a Brewfile too. Here’s my personal one with my tf tools.

https://github.com/nitrocode/dotfiles/blob/master/macos/Brewfile#L196

Bananahands avatar
Bananahands

sweet! never knew of brewfile. i feel like i should though based on my use of Taskfile

2020-03-08

wattiez.morgan avatar
wattiez.morgan

2020-03-07

maarten avatar
maarten

2020-03-06

tolstikov avatar
tolstikov
monitoror/monitoror

Unified monitoring wallboard — Light, ergonomic and reliable monitoring for anything. - monitoror/monitoror

:--1:1
Zachary Loeber avatar
Zachary Loeber

This looks pretty sweet, pretty certain helm charting this would be not so hard.

monitoror/monitoror

Unified monitoring wallboard — Light, ergonomic and reliable monitoring for anything. - monitoror/monitoror

joshmyers avatar
joshmyers

dashing in golang

maarten avatar
maarten
3
2
Sebastian Cavedale avatar
Sebastian Cavedale

jajaja que bien!

2020-03-05

maarten avatar
maarten

wait for it..

1
Erik Osterman avatar
Erik Osterman
Remove Video Background – Unscreen attachment image

Remove the background of any video - 100% automatically, online & free! Goodbye Greenscreen. Hello Unscreen.

:--1:2
Erik Osterman avatar
Erik Osterman

Like https://remove.bg but for video (same company)

2020-03-04

Todd Lyons avatar
Todd Lyons

@Erik Osterman SCALE already added a comment about the state of emergency declaration:
COVID-19 and SCALE 18x
Submitted by Phil Dibowitz on Thu, 2020-02-13 21:42
UPDATE (March 4, 2020): We wanted to provide an update given there are now six known cases of Coronavirus in the Los Angeles area. While the LA County Board of Supervisors have declared a state of emergency, the goal of that move is to acquire additional funding for prevention and planning. The Mayor of Los Angeles’ office gave a statement this morning and said there is no proof of communal transmissions and importantly, that there are no plans to stop public gatherings. As always we are staying in touch with local officials and will keep on top of all developments and follow all authority guidelines to keep everyone safe. We look forward to seeing you all tomorrow!

Todd Lyons avatar
Todd Lyons

Standard advice from virologists still applies: Wash your hands they way you’re supposed to and keep your hands away from your face and don’t stand next to someone who looks like they’re fighting the flu.

RB avatar

in case anyone is petrified… fatality rates are low and extremely low if you’re young.

source: https://www.worldometers.info/coronavirus/

Coronavirus Update (Live): 95,161 Cases and 3,252 Deaths from COVID-19 Wuhan China Virus Outbreak - Worldometer

Live statistics and coronavirus news tracking the number of confirmed cases, recovered patients, and death toll by country due to the COVID 19 coronavirus from Wuhan, China. Coronavirus counter with new cases, historical data, and info. Daily charts, graphs, news and updates

RB avatar

150 total cases in the US, so far 11 fatal

grv avatar

altho the below link is a lil slow compared to above, but gives good insight for real time updates

:--1:1
MattyB avatar
MattyB

I’m mostly concerned about my kid that’s just a couple of months old. I’m WFH for the most part due to the Flu going around

:--1:1
2
Erik Osterman avatar
Erik Osterman

Ya, this is my concern as well…

Nikola Velkovski avatar
Nikola Velkovski
2

2020-03-03

Nikola Velkovski avatar
Nikola Velkovski

Checking out Janet’s bad cough. Started Jan. 4. We had just returned from China and may have both been patient zero in U.S. (@ West Coast Sports Institute in Santa Clara, CA) https://www.swarmapp.com/c/hCm8BltnwSp

    keyboard_arrow_up