#codefresh (2020-04)

codefresh

Archive: https://archive.sweetops.com/codefresh/

2020-04-30

oriel avatar
oriel

Hey all, we are online now. Feel free to join us

2020-04-29

Harrison Heck avatar
Harrison Heck

Is the schema available somewhere for the typed Codefresh plugins? I need to see what argument types are available.

1
Kostis (Codefresh) avatar
Kostis (Codefresh)
Specification

The home of JSON Schema

Kostis (Codefresh) avatar
Kostis (Codefresh)

It should be number, string, object, boolean

Harrison Heck avatar
Harrison Heck

That’s json schema, that is not the schema of codefresh

Harrison Heck avatar
Harrison Heck

There’s a difference.

Harrison Heck avatar
Harrison Heck

We need a published version of CF’s JSON Schema

oriel avatar
oriel

Hey All! I wanted to use this great channel to invite you all to a “coffee with codefresh” session we’re hosting tomorrow (and every Thursday) at 11am PT where you can all ask questions our great @dustinvb and share knowledge, you can register here - https://codefresh.io/uncategorized/coffee-codefresh-live-qa/

Coffee with Codefresh - Live Q&A! - Codefresh

Welcome to the new Coffee with Codefresh — a Q&A live stream with members of the Codefresh team! We welcome you to a casual and relaxed question and answer session, where we can discuss everything and anything Codefresh and CI/CD… Whether it’s about Cloud automation, DevOps, Docker, Deployments, Rollbacks, Disaster recovery, best practices, or just … Continued

:--1:1

2020-04-23

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
01:34:53 PM

GitHub has reported an Incident. Apr 23, 13:30 UTC Investigating - Incident description from GitHub: “Currently observing issues affecting GitHub.com ?.”

This could affect your ability to login and sign-up using GitHub. Pipelines relying on GitHub services (git-clones, webhooks, etc.) are affected as well.

More information here: https://www.githubstatus.com/incidents/2y6v4ltq26g7

GitHub has reported an Incident.

Codefresh’s Status Page - GitHub has reported an Incident..

Incident on 2020-04-23 13:20 UTC

GitHub’s Status Page - Incident on 2020-04-23 13:20 UTC.

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
04:44:52 PM

GitHub has reported an Incident. Apr 23, 16:27 UTC Resolved - GitHub has reported that the incident has been resolved.Apr 23, 13:30 UTC Investigating - Incident description from GitHub: “Currently observing issues affecting GitHub.com ?.”

This could affect your ability to login and sign-up using GitHub. Pipelines relying on GitHub services (git-clones, webhooks, etc.) are affected as well.

More information here: https://www.githubstatus.com/incidents/2y6v4ltq26g7

GitHub has reported an Incident.

Codefresh’s Status Page - GitHub has reported an Incident..

Incident on 2020-04-23 13:20 UTC

GitHub’s Status Page - Incident on 2020-04-23 13:20 UTC.

Harrison Heck avatar
Harrison Heck

Does CF have plans to integration with GitHub checks?

Harrison Heck avatar
Harrison Heck

It sucks that this isn’t available at all

2020-04-21

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
04:14:55 PM

GitHub has reported an Incident Apr 21, 16:03 UTC Investigating - GitHub has reported an Incident. Incident description from GitHub: “We are investigating degradations to GitHub.com.”

This could affect your ability to login and sign-up using GitHub. Pipelines relying on GitHub services (git-clones, webhooks, etc.) are affected as well.

More information here: https://www.githubstatus.com/incidents/dsf2qtzh4jpz

GitHub has reported an Incident

Codefresh’s Status Page - GitHub has reported an Incident.

Incident on 2020-04-21 15:45 UTC

GitHub’s Status Page - Incident on 2020-04-21 15:45 UTC.

Harrison Heck avatar
Harrison Heck

Are env vars available in custom plugins? So that you do not have to pass everything as an arg? Right now we are doing that as I don’t recall seeing this work.

Harrison Heck avatar
Harrison Heck

?

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
05:24:55 PM

GitHub has reported an Incident Apr 21, 17:14 UTC Resolved - GitHub has reported their incident has been resolved.

More information here: https://www.githubstatus.com/incidents/dsf2qtzh4jpzApr 21, 17:05 UTC Monitoring - GitHub has applied a fix, and they’re currently monitoring their system.

More information here: https://www.githubstatus.com/incidents/dsf2qtzh4jpzApr 21, 16:03 UTC Investigating - GitHub has reported an Incident. Incident description from GitHub: “We are investigating degradations to GitHub.com.”

This…

GitHub has reported an Incident

Codefresh’s Status Page - GitHub has reported an Incident.

GitHub Status

Welcome to GitHub’s home for real-time and historical data on system performance.

2020-04-18

btai avatar

is there a way to surface what type of trigger happened in your pipeline? I want to merge my triggers into one (all push commits, push to master, github release) and would like to have conditionals in my pipeline config to run certain steps depending on the trigger type (i.e. deploy to prod only when the trigger step is github release)

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Personal preference has been to keep pipelines separated by trigger types so the scope of the pipeline definitions is reduced

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

So we generally have a release pipeline triggered in releases. That’s all it does.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

A build pipeline on merge to master.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

A destroy pipeline triggers on Pr closed or merged

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Etc

btai avatar

@Erik Osterman (Cloud Posse) thats what i currently have. we struggle w/ adding triggers to each pipeline for every new project we have.

btai avatar

ideally, new project = 1 new trigger

btai avatar

in other news, this page which i have visited many many times actually has the bit i was looking for that ive always overlooked i guess: https://codefresh.io/docs/docs/codefresh-yaml/variables/#github-release-variables

Variables

Codefresh is a Docker-native CI/CD platform. Instantly build , test and deploy Docker images.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

We are working on gitops of Codefresh pipelines

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

But it’s been a real pain to implement

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

We introduced a new file call app.yaml

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Then a Codefresh job that runs every 10 minutes and scans for repostories with that file and configured the triggers for the type of pipelines it wants

btai avatar

does your team struggle w/ trigger management? thats what im struggling with with your current approach

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

We call these build packs

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

So with the app.yaml they are setup automatically

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

But otherwise yes, that is a real PIA

btai avatar

for every new project (builds + feature branch, pr into develop, merge into master, github release)

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Especially when having used GitHub actions and it is so easy

btai avatar

thats for simple projects

btai avatar

exactly! i was looking at gh actions last night. I was tempted to actually use the gh actions triggers to trigger specific codefresh pipelines

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Codefresh needs to have the ease of use of GitHub actions for pipeline configuration

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Way too much clickops with Codefresh

btai avatar

yeah im trying to remove as much clickops as possible which is the exact reason i’m asking this question

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

So there is an example of using GitHub actions with Codefresh

btai avatar

i unfortunately became numb to it during implementation, but devs voiced their concerns w/ spinning up new projects

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

I think it might improve the developer experience

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Basically remove all triggers from pipelines in Codefresh

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Use GitHub actions to trigger all things in Codefresh

btai avatar

yep

btai avatar

thats exactly wat i was thinking of doing

btai avatar

then the gh repo has a single codefresh secret (api token)

btai avatar

and can use as repo template w/ base gh actions yaml config

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Also @Zachary Loeber informed me now that GitHub has an api for secrets

btai avatar

yeah i found that out yday when i was looking at gh actions. thats what i mean by codefresh secret

btai avatar

single codefresh secret.

gh action yaml would look somrhing like:

on:
  # Trigger the workflow on push or pull request,
  # but only for the master branch
  push:
    branches:
      - master
  # trigger codefresh build  and test pipeline
  pull_request:
    branches:
      - master
  # trigger merge to master pipeline
  release:
    types: # This configuration does not affect the page_build event above
      - created
   # trigger deploy to prod pipeline 
Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Ya

btai avatar

i might just do that.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

I think it’s definitely worth a try

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Zero trigger management then

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Just manage one secret per repo

btai avatar

yep that would be ideal

btai avatar

ima give that a shot

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

@Igor Rodionov

Kostis (Codefresh) avatar
Kostis (Codefresh)

@btai, @Erik Osterman (Cloud Posse) Have you seen this? https://github.com/marketplace/actions/codefresh-pipeline-runner

Codefresh pipeline runner - GitHub Marketplace

Github action that runs codefresh pipeline

btai avatar

@Kostis (Codefresh) yep, i forked it. it was a good start but def not quite usable for most pipelines that use the CF_* provided system variables

btai avatar

I’m also planning on allowing arbitrary variables to be passed in probably by using a prefix or something like CFVAR_{ENV_VAR_NAME} Let me know if you guys have better ideas

2020-04-16

Codefresh Release Notes avatar
Codefresh Release Notes
04:51:19 PM

Integration with Google Cloud Build - documentation () (Feed generated with FetchRSS)

2020-04-14

Codefresh Release Notes avatar
Codefresh Release Notes
04:31:22 PM

Trigger a Kubernetes Deployment from a Dockerhub Push Event - documentation () (Feed generated with FetchRSS)

2020-04-10

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Codefresh is launching their own office-hours segment every Thursday. Check it out!

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)
Codefresh posted on LinkedIn attachment image

Join us every Thursday at 11:00 am pacific for COFFEE WITH #Codefresh a LIVE question and answer season with our most talented staff. :star2:Click here to …

2020-04-08

Codefresh Release Notes avatar
Codefresh Release Notes
03:21:16 PM

New variable CF_BRANCH_TAG_NORMALIZED_LOWER_CASE - documentation () (Feed generated with FetchRSS)

2020-04-07

Codefresh Release Notes avatar
Codefresh Release Notes
03:11:25 PM

Scala: Hello World (updated) - documentation () (Feed generated with FetchRSS)

Harrison Heck avatar
Harrison Heck

Is there no way to have concurrency policies on each trigger? That is a crucial feature.

Harrison Heck avatar
Harrison Heck

The problem we have is that we need a currency of 1 for pushes to master, but for PRs, we want it to be unlimited

Harrison Heck avatar
Harrison Heck

So we separated our push pipeline from our pull-request pipeline, though it’s the same pipeline code

Harrison Heck avatar
Harrison Heck

The problem with this is that when you merge master to our production branch, both pipelines trigger, because there is no way to have it only triggered once

Harrison Heck avatar
Harrison Heck

We solved this in a slightly ugly way, but it works.

2020-04-06

Codefresh Release Notes avatar
Codefresh Release Notes
03:01:28 PM

Deploy to Heroku - documentation () (Feed generated with FetchRSS)

Harrison Heck avatar
Harrison Heck

How do you export a value from one step to another in a custom plugin? Because neither export nor cf_export seems to work

Harrison Heck avatar
Harrison Heck

Actually cf_export itself works, but echoing to ${{CF_VOLUME_PATH}}/env_vars_to_export doesn’t.

Harrison Heck avatar
Harrison Heck

But we can’t have the values output, which for some reason cf_export does

Harrison Heck avatar
Harrison Heck

The documentation around custom plugins is horrendous FYI. It needs a complete rewrite.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

@Vidhya Vijayakumar heads up re: documentation for custom plugins

Harrison Heck avatar
Harrison Heck

Do you know how to solve this though? I have 3 steps in our plugin. I need the value from the first step for the second and third.

Harrison Heck avatar
Harrison Heck

I do not see a way to do this without cf_export at the moment.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Haven’t done any custom plugins either. I really wanted to for one of our latest engagements. TBH, took a look at the docs and realized it was a bigger project than anticipated, so we punted on it.

dustinvb avatar
dustinvb

Can you try adding --global to your cf_export command?

@Vidhya Vijayakumar Can work with documentation team on new documentation. Vidhya, Dan and Oriel are discussing a webinar on custom step development. Maybe Kostis or Anna can lead a rewrite of custom step documentation.

@Harrison Heck It would be helpful for us to have more feedback on each item you find horrendous within the document, so we can take actions on specific items. For example, is this just formatting and readability or lack of examples?

Harrison Heck avatar
Harrison Heck

I think it would be easier to have a call about it. In generally, most of CFs documentation needs a refactoring.

Harrison Heck avatar
Harrison Heck

@dustinvb What does --global do? We already have cf_export working. What I don’t want is the output it gives.

Harrison Heck avatar
Harrison Heck

But doing the echo workaround doesn’t work

Harrison Heck avatar
Harrison Heck

cf_export should not ever echo out the value. I have no idea why that was done.

:--1:1
Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

ya, we were bit by this as well.

Harrison Heck avatar
Harrison Heck

If you want that, cf_export --show would make more sense. But the default should mimic export, which is safe.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

we exported secrets in clear text in the build logs

Harrison Heck avatar
Harrison Heck

Yeah, unfortunately CF feels very rushed and not always thought through.

dustinvb avatar
dustinvb

The global flag is used to return the output from the step to the pipeline level.

Harrison Heck avatar
Harrison Heck

I really don’t understand what that means.

Harrison Heck avatar
Harrison Heck

As I said, cf_export works. But it outputs the value, we don’t want that. So we’re trying to do the echo workaround. This is not sending the value to the next step in the plugin

dustinvb avatar
dustinvb
codefresh-io/steps

Contribute to codefresh-io/steps development by creating an account on GitHub.

dustinvb avatar
dustinvb

This sounds like an issue for support to discover why the method to export vars is not working.

Can you please open a ticket? https://support.codefresh.io

Harrison Heck avatar
Harrison Heck

I’ll try with /meta being hardcoded first

Harrison Heck avatar
Harrison Heck

Ok, that gets me further, it’s actually in the right place now. It seems like CF_ variables aren’t available in plugins, which really makes no sense.

Harrison Heck avatar
Harrison Heck

One issue I’ve found unrelated to this is that it seems yq -r is needed, not yq -y. Otherwise we had ... output after the github token. https://codefresh.io/docs/docs/codefresh-yaml/steps/git-clone/#reuse-a-git-token-from-codefresh-integrations

Git-Clone

Checkout code in your pipelines

Harrison Heck avatar
Harrison Heck

I got it working, but it’s definitely uglier than I would have hoped. The custom plugin stuff could definitely use some work on top of the documentation itself.

Harrison Heck avatar
Harrison Heck

I’m happy to have a call to discuss it all.

2020-04-05

Codefresh Release Notes avatar
Codefresh Release Notes
02:51:24 PM

Helm release text message - documentation () (Feed generated with FetchRSS)

2020-04-02

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
08:44:57 PM

GitHub has reported an Incident Apr 2, 20:31 UTC Update - We are continuing to investigate this issue.Apr 2, 20:30 UTC Investigating - GitHub has reported an Incident that could affect your builds at Codefresh.

More information here: https://www.githubstatus.com/incidents/80d0cs6kpsps

GitHub has reported an Incident

Codefresh’s Status Page - GitHub has reported an Incident.

Incident on 2020-04-02 20:20 UTC

GitHub’s Status Page - Incident on 2020-04-02 20:20 UTC.

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
09:45:01 PM

GitHub has reported an Incident Apr 2, 20:31 UTC Update - We are continuing to investigate this issue.Apr 2, 20:30 UTC Investigating - GitHub has reported an Incident that could affect your builds at Codefresh. Also, you may not be able to signup or login using your GitHub account.

More information here: https://www.githubstatus.com/incidents/80d0cs6kpsps

GitHub has reported an Incident

Codefresh’s Status Page - GitHub has reported an Incident.

Incident on 2020-04-02 20:20 UTC

GitHub’s Status Page - Incident on 2020-04-02 20:20 UTC.

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
10:05:01 PM

GitHub has reported an Incident Apr 2, 20:31 UTC Update - More information here: https://www.githubstatus.com/incidents/80d0cs6kpspsApr 2, 20:30 UTC Investigating - GitHub has reported an Incident that could affect your builds at Codefresh. Also, you may not be able to signup or login using your GitHub account.

More information here: https://www.githubstatus.com/incidents/80d0cs6kpsps

GitHub Status

Welcome to GitHub’s home for real-time and historical data on system performance.

Codefresh Status - Incident History avatar
Codefresh Status - Incident History
10:54:59 PM

GitHub has reported an Incident Apr 2, 22:35 UTC Resolved - GitHub has reported the incident has been resolved.Apr 2, 20:31 UTC Update - More information here: https://www.githubstatus.com/incidents/80d0cs6kpspsApr 2, 20:30 UTC Investigating - GitHub has reported an Incident that could affect your builds at Codefresh. Also, you may not be able to signup or login using your GitHub account.

More information here: https://www.githubstatus.com/incidents/80d0cs6kpsps

GitHub has reported an Incident

Codefresh’s Status Page - GitHub has reported an Incident.

Incident on 2020-04-02 20:20 UTC

GitHub’s Status Page - Incident on 2020-04-02 20:20 UTC.

    keyboard_arrow_up