#release-engineering (2020-11)

jenkins_ci All things CI/CD. Specific emphasis on Codefresh and CodeBuild with CodePipeline.

CI/CD Discussions

Archive: https://archive.sweetops.com/release-engineering/

2020-11-06

Darren Cunningham avatar
Darren Cunningham

In order to run docker in docker I need to run my primary task in privileged mode – it doesn’t appear that Codefresh supports this. I’m thinking about switching my pipelines that need this over to AWS CodeBuild but if body has recommendations I’d appreciate it.

Darren Cunningham avatar
Darren Cunningham

I’m using AWS CDK for my IaC and I’m using docker bundling to build my Lambdas. Works great locally.

Darren Cunningham avatar
Darren Cunningham

I could use local bundling and package NodeJS / Golang into my Dockerimage that I use for my build step at Codefresh, but that seems like I’m making more work for myself and loosing the benefit

pjaudiomv avatar
pjaudiomv

What about using kaniko

1
Jonathan Marcus avatar
Jonathan Marcus

We use Conducto (I’m the founder) to do our own CI/CD and it has docker-in-docker for a very similar situation. I’d be happy to show you how we do it, regardless of whether you use us or not.

Jonathan Marcus avatar
Jonathan Marcus

Also we tried Kaniko, and found it too finicky, and way slower than using Docker. Has anyone here had success with Kaniko?

Darren Cunningham avatar
Darren Cunningham

@Jonathan Marcus I ended up setting up local builds as it wasn’t that big of an undertaking and had the added benefit of speeding up local build times too – however I’m interested in learning more about Conducto, feel free to DM me

2020-11-07

2020-11-16

Darren Cunningham avatar
Darren Cunningham

Anybody know of a service that allows me to create e2e functional tests for a sign-up process?

I want to not just validate that my backend API returns the expected response, but that the test email is received and be able to assert details of that email. Subject, Received with X minutes, etc.

jose.amengual avatar
jose.amengual

you can use any synthetic testing tool, Datadog, AWS, pingdom, Newrelic have some tools fir this

Darren Cunningham avatar
Darren Cunningham

DD synthetics work for validating email received?

Darren Cunningham avatar
Darren Cunningham

it does! Nice, thanks

1
jose.amengual avatar
jose.amengual

np

Darren Cunningham avatar
Darren Cunningham

yup, that worked perfectly.

2020-11-17

loren avatar
Launching the Future of DevOps: GitOps 2.0 - Codefresh

Today marks our first step towards the future. Codefresh is launching a number of new features aimed at improving the experience and speed of continuous integration and deployment with GitOps. The features we’re launching today can help answer questions like “what’s running in production?” “What Jira tickets were just deployed?” and “Which change is causing … Continued

Matt Gowie avatar
Matt Gowie

Anyone have any recommendations for solid OSS tool or SaaS platform tools for load testing?

roth.andy avatar
roth.andy

jMeter or Gatling

roth.andy avatar
roth.andy

Gatling is much newer. It is what I would use if I were setting something up today

Yoni Leitersdorf (Indeni Cloudrail) avatar
Yoni Leitersdorf (Indeni Cloudrail)

Blazemeter is a convenient wrapper around jmeter

1
1
Matt Gowie avatar
Matt Gowie

Yeah, I’ve used Jmeter plenty. It feels like it’s continuing to stand the test of time, but it’s surprising.

Matt Gowie avatar
Matt Gowie

Gatling was on the list as well, but not interested in writing scala or having teams have to deal with scala.

jose.amengual avatar
jose.amengual

We use locust, built in Python

1
Matt Gowie avatar
Matt Gowie

Yeah… after discussion with a client team member we’re evaluating the following:

  1. Artillery
  2. K6
  3. Gatling
  4. Locust Client needs TCP support which is making it a complicated decision.
aaratn avatar

+1 for artillery and k6

Matt Gowie avatar
Matt Gowie

@aaratn have you used artillery? I think we’re leaning that direction because it support JS out of the box, is plugin friendly, and the client is a JS shop. Any thoughts on it real experience?

aaratn avatar

Yeah I’ve used both free and pro version, works well with fargate

Joe Niland avatar
Joe Niland
Nordstrom/serverless-artillery

Combine serverless with artillery and you get serverless-artillery for instant, cheap, and easy performance testing at scale. - Nordstrom/serverless-artillery

Matt Gowie avatar
Matt Gowie

Great info — thanks gents.

2020-11-18

bradym avatar

Anyone else using gitlab.com seeing really aggressive caching of .gitlab-ci.yml files lately? Been having to clear runner caches on multiple projects for the past few days to get changes made to reflect after fixing a bug in one of our common jobs.

Yoni Leitersdorf (Indeni Cloudrail) avatar
Yoni Leitersdorf (Indeni Cloudrail)

That literally just happened to me

bradym avatar

Sorry you’re also experiencing it, but also glad it’s not just me.

Yoni Leitersdorf (Indeni Cloudrail) avatar
Yoni Leitersdorf (Indeni Cloudrail)

I wonder if their issue tracker has something about this

bradym avatar

Man we are hitting this issue like crazy now, haven’t seen anything on the issue tracker yet but it’s a bit of a jungle in there.

Yoni Leitersdorf (Indeni Cloudrail) avatar
Yoni Leitersdorf (Indeni Cloudrail)

BTW - been having issues with CircleCI catching webhook from Github. They had an outage today which looks like it ended now. Not a good day for CI.

    keyboard_arrow_up