Over a million developers have joined DZone.

A Case Study in Operations and Development Integration at Spotify

· DevOps Zone

The DevOps Zone is brought to you in partnership with Sonatype Nexus. The Nexus Suite helps scale your DevOps delivery with continuous component intelligence integrated into development tools, including Eclipse, IntelliJ, Jenkins, Bamboo, SonarQube and more. Schedule a demo today

Abstract Mattias Jansson, Noa Resare: We have lots of material to draw from talking about how we work with integration between operations and software development.

This talk will be around a narrative about how we have grown as a company and how our challenges has changed as the number of users has grown and the technical complexity of the service has increased.

We have learned lots of stuff about how we communicate efficiently and handle short term issues that arise in the production environment as well as how we do medium to long term planning in cooperation between the operations team and development teams.

Moving forward with new development at a fast pace while at the same time maintaining a high quality of service is a balancing act that requires communication and thinking hard about how the organization is set up.

We think that it would be possible to squeeze in one or two real world case studies about more or less catastrophic failures that we've had to deal with and how those experiences has shaped our processes.

devopsdays goteborg 2011 - Mattias Jansson and Noa Resare , A case study in operations and development integration at Spotify from devopsdays on Vimeo.

 

High level outline:

  • description of the spotify service, our organization and a very brief technical description of the backend systems
  • the early days: devs did everything
  • the conflict of interest between reliability and new features
  • how the ops team got overloaded with short term panicky stuff and how we're using kanban weekly retrospective and planning meetings to try to work around that
  • system owner responsibilities at operations, subsystem planning meetings
  • weekly scalability meetings to plan resource allocation and propagate information about incidents
  • how to keep devs happy: the #operations irc channel, quick response times via email
  • keeping track of incidents and that gets aggregated to service availability numbers
  • case study: cascading failures, analyzing subsystem dependencies one of the most important things we do. Strategies to be able to do partial deployments, and rolling back changes.

The DevOps Zone is brought to you in partnership with Sonatype Nexus. Use the Nexus Suite to automate your software supply chain and ensure you're using the highest quality open source components at every step of the development lifecycle. Get Nexus today

Topics:

Opinions expressed by DZone contributors are their own.

The best of DZone straight to your inbox.

SEE AN EXAMPLE
Please provide a valid email address.

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.
Subscribe

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}