How Do 200+ Scrum Masters Deal With Problems Outside Of Their Control?
Short answer: It ultimately comes down to team building.
Join the DZone community and get the full member experience.Join For Free
Changing the way we work is extremely difficult . We all know this. It requires us to find novel solutions to wicked challenges, to deal with cultural baggage (i.e. 'the way we do things here'), and to bring along the people needed to make a change successful. And yet, this difficult challenge is a core responsibility of Scrum Masters.
But how do Scrum Masters and Agile Coaches go about this? What strategies do they use to change the system? Who are their most important allies? And what else can we learn from them?
We managed to obtain responses from 201 Scrum Masters and Agile Coaches from organizations of varying sizes, varying levels of agility, and varying industries. These are our key findings:
- The most common successful strategies involved bringing people together to solve problems. Although it may sound obvious, it underscores how important it is to build networks and groups of people that can drive change together ; you can't do that on your own.
- The use of politics – building coalitions, using existing power structures, and finding sponsors – is considered a successful strategy in organizations that score low on agility, regardless of their size.
- As organizations become more agile, politics give way to the use of metrics, bringing people together and using facts and arguments to persuade and drive change.
- Team members, management, and stakeholders are considered the most useful allies by participants. Surprisingly, and contrary to what we expected, other Scrum Masters and Agile Coaches are far less likely to be considered allies. External consults are rarely considered to be useful allies and/or worth building relationships with.
About The Survey
Our sample consisted of 119 Scrum Masters and 82 Agile Coaches. On average, participants indicated a 4.4-year experience in their role and over 15 years in their industry in general.
The survey attained responses from a wide variety of organizations, of varying sizes (92 large, 86 medium and 32 small), and from various sectors (153 IT-oriented, 48 non-IT).
On a scale from one to 10, the average self-categorized level of agility of the companies was about halfway (4.8). We used an online survey (Google Forms ) to invite these participants to share with us the strategies that worked for them. Please note that the choice of the survey software may have influenced the outcome as not all organisations authorize the access of Google applications from company networks.
Most Common Strategies
We invited participants to categorize their successful strategies according to a predetermined set, while also adding a more detailed description afterward. Ranked from most to least frequent, we found the following:
It is clear that the most effective strategy for our participants is to bring people together to solve the problem. Over 82 percent reported an approach in this category.
Involving leadership is particularly relevant here. Several participants reported success by bringing together members from the leadership level in 'transition teams' or 'Agile working groups' that resolved organizational impediments beyond the control of individual Scrum teams.
Other successful strategies are education (52 percent), the use of metrics to make visible the impact of impediments (48 percent), and the use of facts and arguments to persuade (43 perent). One participant described these strategies as "visualizing, showing where the impediments affect the whole system's flow, and then working with all of the stakeholders to come up with a solution."
Another good example of these strategies was described as "articulating a 'deficit of done,' which shows the impact of the external problem (e.g. an impediment or dependency) on the team's ability to create increments of production quality."
Interestingly, the use of technology or software, the use of (external) experts, and politics were not considered successful, or at least not often used successfully.
Most Useful Allies
We can't change the environment of Scrum teams on our own. We need help from allies who can create space for new ways of working, and for people to break through traditions and habits ( technological, procedural, or political). We invited participants to select their most useful allies from a provided set of options:
Team members are, by and large, the most important allies of Scrum Masters and Agile Coaches in changing the environment of Scrum teams, as reported by over a third of our participants (35 percent). One participant described this as moving "the conversation and authority to where the information is. Those who have the most intimate understanding of the issue often also have the most effective suggestions for durable solutions."
After team members, the most important allies are sponsors in leadership positions (25 percent) and business stakeholders (13 percent). One interesting finding is that only 9 percent of participants consider their colleagues (Scrum Masters and Agile Coaches) to be allies. We would've expected this to be higher.
Furthermore, a very small number of participants (2 percent) considered external consultants to be useful allies. As most organizations employ external consultants of one kind or another, it would be interesting to explore why. Perhaps consultants don't frequently work with Scrum Masters and Agile Coaches enough. Moreover, given the temporary nature of their engagement, they might not be considered a good investment when seeking long-term allies.
When all is said and done, though, finding the right allies can be a challenging task, especially in larger organizations. One participant described this as "going into the jungle," employing a strategy of asking "Who knows the most about X?" in order to move up the organizational hierarchy to find key allies.
Differences between Organizations
We also employed more advanced statistical magic to explore if the use of strategies and allies depended on factors such as experience and/or the size and agility of organizations.
We found that politics is used more frequently to enact change in less agile organisations. As agility increases, though, so does the use of facts and arguments to persuade and drive further change. This seems to fit with the empirical process that underlies agility: gather data to validate assumptions and make decisions based on what you learn.
But to change organizations towards such a mindset, politics may be necessary initially. An interesting additional observation is that more agile organizations tend to bring people together more frequently to drive change.
We also found that as people become more experienced in their role, they increasingly rely on the use of metrics to enable change. They also focus more on educating others. The survey doesn't tell us what 'educating' looks like, but one can certainly hope that the use of metrics is an important strategy to educate others.
The size of the company did not significantly influence the use of strategies or allies.
So What Does this Mean?
In the end, the results from our survey bring us back to the principal question of any transformation: What pattern is driving change successfully? Do we need a visionary leader believing that Agile is the right way to go, initiating a top-down change initiative? Or do we need to foster a bottom-up approach from the trenches? Or shall we engage in the Agile pincer movement that combines both approaches to bypass the potential incumbents of middle management and make change happen?
The results from our survey suggest that participants feel that 'engaging in politics' is a helpful strategy during the early stages of agility. But as agility increases, so does the reliance on metrics and shared sense-making to create an increasingly Agile-friendly culture. This supports the pragmatism of the Agile pincer movement as a means of change, where bottom-up change is empowered by top-down support. Our results also show how critical the support of management and leadership is in any change initiative to become an agile organization.
The purpose of our survey was to explore what strategies Scrum Masters and Agile Coaches use to help organizations work more effectively with Scrum. We used broad strokes, both in the questions and the analysis, to identify interesting patterns. We'd love to explore these further. What kind of politics are used? What kind of metrics are used? How are people finding allies? When and why does the shift from politics to data occur? We hope to answer these questions in future research.
- We'd love to explore cultural differences in the use of strategies.
- We'd love to explore why it is that Scrum Masters don't consider other Scrum Masters and/or Agile Coaches as important allies.
- We'd love to dig more deeply into what kind of political strategies work. The use of politics often has a bad smell associated with it. But many kinds of politics, like the building of coalitions, finding allies, and building connections, are vital to change efforts.
Published at DZone with permission of Christiaan Verwijs, DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.