Future of DevOps

A presentation at ACM Talks in March 2023 in by Sasha Czarkowski (Rosenbaum)

Slide 1

Slide 1

Future of DevOps Sasha Rosenbaum @DivineOps COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 2

Slide 2

Sasha Rosenbaum @DivineOps Dev Ops Product Sales Consulting @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 3

Slide 3

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 4

Slide 4

The Past @ergonauticly COPYRIGHT 2023. 2022. ALL RIGHTS RESERVED. Ergonautic

Slide 5

Slide 5

1990s: Getting a new server up: 3+ months @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 6

Slide 6

Backup @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 7

Slide 7

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 8

Slide 8

Date Release name 1990 SQL Server 1.1 (16-bit) 1992 SQL Server 4.2A 1993 SQL Server 4.21a 1995 SQL Server 6.0 1996 SQL Server 6.5 1998 SQL Server 7.0 2000 SQL Server 2000 2003 SQL Server 2000 64-bit 2005 SQL Server 2005 2008 SQL Server 2008 2010 Azure SQL database @ergonauticly Software release cadence: 2-3-year cycle COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 9

Slide 9

Merge hell Merging the development branches and completing the test procedures could take months @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 10

Slide 10

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 11

Slide 11

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 12

Slide 12

Every company ran its own email @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Source: IBM Global Services, Improving systems availability, 1998. Ergonautic

Slide 13

Slide 13

Software as a Service ● ● ● Hotmail Google Search Salesforce 1996 1998 1999 Revenue share in 1999 ● Application Service Providers ● Software Applications $933M $74B Source: https://www.inc.com/magazine/20000401/18093.html @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 14

Slide 14

Deployment Checklists COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 15

Slide 15

2000 27% of server market 41% of server market ● File-based OS ● Maintains configuration in files ● Every device is a file ● Executable-based OS ● Maintains configuration in registry ● Every device has a different driver mechanism COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 16

Slide 16

1990s: Maintenance windows @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 17

Slide 17

How many 9s is two weekends like that? < 99% @ergonauticly 3.65 days / year COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 18

Slide 18

Unavailable systems were estimated to have cost American businesses $4.54B in 1996. @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Source: IBM Global Services, Improving systems availability, 1998. Ergonautic

Slide 19

Slide 19

Traditional IT dev ops wall of confusion COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 20

Slide 20

@ergonauticly Dev Ops Speed Reliability COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 21

Slide 21

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 22

Slide 22

Darmok and Jalad at Tanagra @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 23

Slide 23

Patrick and Andrew at Agile TO 2008 COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 24

Slide 24

10 deploys per day: Dev and Ops collaboration at Flickr Velocity 09: John Allspaw and Paul Hammond COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 25

Slide 25

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 26

Slide 26

DevOpsDays Ghent 2009: Patrick Debois @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 27

Slide 27

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 28

Slide 28

“DevOps” Google Search Trend 2009-Present @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 29

Slide 29

Jez Humble and Dave Farley: 2010 @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 30

Slide 30

Continuous Integration (CI) The practice of merging code into the main branch several times a day; and automating the build and testing on every commit. @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 31

Slide 31

Continuous Delivery (CD) The approach in which teams produce software in short cycles, ensuring that the software can be reliably released at any time. @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 32

Slide 32

Nicole Forsgren. State of DevOps Report 2019 COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 33

Slide 33

Software delivery is like a muscle. The more you use it, the stronger it gets. @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly 37

Slide 34

Slide 34

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 35

Slide 35

The Present @ergonauticly COPYRIGHT 2023. 2022. ALL RIGHTS RESERVED. Ergonautic

Slide 36

Slide 36

Effective automation requires consistent APIs @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 37

Slide 37

OS-level APIs COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 38

Slide 38

PowerShell (Windows) configuration management framework and scripting language Jeffrey Snover, 2006 COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 39

Slide 39

Infrastructure-level APIs COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 40

Slide 40

Amazon Web Services: 2002 Amazon Cloud Computing: 2006 Azure Cloud Services: 2008 @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 41

Slide 41

@DivineOps 2005 2009 Infrastructure as code 2012 COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 42

Slide 42

@DivineOps Every wave of automation Enables the next wave of automation COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 43

Slide 43

Today @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 44

Slide 44

We have a lot more automation @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 45

Slide 45

We have a lot more automation tools @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 46

Slide 46

We have much higher availability @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 47

Slide 47

We have better on-call @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 48

Slide 48

We have better incident response @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 49

Slide 49

We deploy a lot more frequently @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 50

Slide 50

BUT @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 51

Slide 51

Many of us are bad at monitoring @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 52

Slide 52

Many of us are bad at CI @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 53

Slide 53

Continuous Integration (CI) The practice of merging code into the main branch several times a day; and automating the build and testing on every commit. @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 54

Slide 54

You cannot CI/CD Without Testing @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 55

Slide 55

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 56

Slide 56

We have convinced people that deploying faster is good We forgot to mention that increasing the Operational Burden is bad @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 57

Slide 57

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 58

Slide 58

SRE ≃ Google’s implementation DevOps @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 59

Slide 59

Why did SRE develop? @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 60

Slide 60

SaaS Market 2008-2020 @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 61

Slide 61

What is the most important thing about the SRE discipline? @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 62

Slide 62

SRE is about explicit agreements that align incentives @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 63

Slide 63

SLA, SLI, SLO @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 64

Slide 64

SLA = Financially-backed availability @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 65

Slide 65

Monthly downtime > 1.5 days means 100% refund COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 66

Slide 66

SLAs are about aligning incentives between Vendor & Customer COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 67

Slide 67

SLO = Targeted reliability @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 68

Slide 68

While SLA is a single metric, SLOs are a system of metrics COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 69

Slide 69

SLO = Business-approved reliability @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 70

Slide 70

SLOs are about explicitly aligning incentives between Business & Engineering @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 71

Slide 71

Error Budgets Acceptable level of unreliability Error budget = 1 - SLO EB = 1 – 99.99% = 0.01% ≃ 13 mins /quarter @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 72

Slide 72

Error budgets are about aligning incentives between Dev & Ops @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 73

Slide 73

If developers are measured on the same SLO, then when the error budget is drained developers shift focus from delivering new features to improving @ergonauticly Reliability COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 74

Slide 74

SLI = Actual reliability @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 75

Slide 75

Monitoring @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 76

Slide 76

Without monitoring, you have no way to tell whether your service even works! @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 77

Slide 77

Good Monitoring @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 78

Slide 78

Without good monitoring, you don’t know that the service does what users expect it to do! @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 79

Slide 79

The Future @ergonauticly COPYRIGHT 2023. 2022. ALL RIGHTS RESERVED. Ergonautic

Slide 80

Slide 80

Something we have to talk about @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 81

Slide 81

AI @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 82

Slide 82

AI will not [yet] take your job @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 83

Slide 83

AI will change jobs @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 84

Slide 84

Ethics @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 85

Slide 85

Like a Library @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 86

Slide 86

Current AI aggregates and synthesizes the results of decades of human work @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 87

Slide 87

Written works, code, art @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 88

Slide 88

Unlike a Library @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 89

Slide 89

Current AI charges its users for the content But it DOES NOT pay royalties or give attribution to the creators @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 90

Slide 90

Fairness usually loses to profit @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 91

Slide 91

Are people going to stop sharing? @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 92

Slide 92

Something else we have to talk about @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 93

Slide 93

DevOps is Dead @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 94

Slide 94

Is it though? @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 95

Slide 95

@ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 96

Slide 96

COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 97

Slide 97

Someone in your org is keeping your systems alive And their life might be hell COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 98

Slide 98

The future is already here. It’s just not evenly distributed ~ William Gibson @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 99

Slide 99

Renaming Teams Support -> Sys Admin -> Ops -> DevOps -> SRE -> Platform Eng (?) @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 100

Slide 100

seeking advantage seeking legitimacy COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 101

Slide 101

words cross the chasm before understanding and practice COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 102

Slide 102

Most organizations I encounter, even those running SaaS, have no SRE practice @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 103

Slide 103

Most Organizations today ● Don’t merge code frequently ● Don’t have quality testing during CI ● Don’t have informative monitoring ● Don’t enforce Error Budgets ● Don’t have a platform @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly

Slide 104

Slide 104

everyone wants DevOps well actually… COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 105

Slide 105

what they really want ● ● ● ● ● ● ● ● reliability availability scalability operability usability observability all for free without changing anything COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 106

Slide 106

without changing anything COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 107

Slide 107

without changing anything COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 108

Slide 108

without changing anything COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 109

Slide 109

Software Everyone wants this Platform When they haven’t solved this Infrastructure @ergonauticly Or even this COPYRIGHT 2023. 2022. ALL RIGHTS RESERVED. www.ergonautic.ly Ergonautic

Slide 110

Slide 110

Operating Model Everyone wants to deliver SaaS Software Dev Software Ops Software optimally delivered on PaaS Platform Dev Platform Ops Software too dependent on IaaS Infrastructure Dev Infrastructure Ops COPYRIGHT 2023. ALL RIGHTS RESERVED. Also, Software Ergonautic

Slide 111

Slide 111

Let’s bring the future to everyone COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 112

Slide 112

We don’t need new words We need to implement what we already know to work well COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 113

Slide 113

Let’s start small @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 114

Slide 114

This Not this COPYRIGHT 2023. ALL RIGHTS RESERVED.

Slide 115

Slide 115

The future is already here. It’s just not evenly distributed ~ William Gibson @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. Ergonautic

Slide 116

Slide 116

Thank you! Sasha Rosenbaum @DivineOps @ergonauticly COPYRIGHT 2023. ALL RIGHTS RESERVED. www.ergonautic.ly