#spacelift (2023-04)

2023-04-04

Managing Infrastructure at Scale | Spacelift Blog avatar
Managing Infrastructure at Scale | Spacelift Blog
10:12:30 AM

Introducing Spacelift Self-Hosted We are excited to announce that now it is possible to self-host an entire, fully-functional Spacelift platform within your AWS cloud.

Introducing Spacelift Self-Hostedattachment image

We are excited to announce that now it is possible to self-host an entire, fully-functional Spacelift platform within your AWS cloud.

1

2023-04-26

Managing Infrastructure at Scale | Spacelift Blog avatar
Managing Infrastructure at Scale | Spacelift Blog
12:32:38 PM

What Does Terraform Refresh Command Do – Overview Learn what the Terraform refresh is and why it is recommended not to use this command directly.

What Does Terraform Refresh Command Do - Overviewattachment image

Learn what the Terraform refresh is and why it is recommended not to use this command directly.

1
Alex Jurkiewicz avatar
Alex Jurkiewicz

@Erik Osterman (Cloud Posse) has CloudPosse built any tooling to manage the number of concurrent private workers running?

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Kind of? We use a primitive scaling technique increasing the number of runners in an auto scale group when there’s active utilization, and shrinking it when utilization drops. It’s conservative in both directions. Utilization is defined like 5-10% CPU; idle Is 0-1%. Then we set a ceiling and floor.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Ideally workers would be on demand.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

This has worked well, but customers can get dinged pretty badly if they use a lot of runners, as the cost per runner adds up. We manage security hub and guard duty in terraform in 17+ regions in 20+ accounts. When nightly drift detection kicks off, it spawns thousands of runs. If workers didn’t scale up, spacelift would be backlogged for hours and hours.

Alex Jurkiewicz avatar
Alex Jurkiewicz

yeah. We have lots of worker pools and want to manage the number of active workers intelligently across all of them

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

That makes sense, and the kubernetes implementation leaves a lot to be desired.

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

It should be implemented as a controller and be able to scale workers to zero

Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Cc @marcinw

marcinw avatar
marcinw

That’s pretty much what we’re building @Erik Osterman (Cloud Posse).

1
marcinw avatar
marcinw

I’m not going to go into implementation details on a public channel but if you’re interested in the preliminary design I will loop you in as a design partner for the feature?

1
Erik Osterman (Cloud Posse) avatar
Erik Osterman (Cloud Posse)

Great to hear! I know some customers would be interested in that. Will reach out.

2023-04-27

2023-04-29

    keyboard_arrow_up