Which metrics should I choose for Change Management?
PDF E-mail
(average 5.00 out of 5)

Reader Question: Which metrics should I choose for Change Management?

Third Sky Expert Answer:

kaiKai Holthaus, Director of Consulting, Third Sky

That, of course, depends (favorite answer of ITIL Experts everywhere...).

Ask yourself what you want to achieve. When selecting a Critical Success Factor (CSF), Key Performance Indicator (KPI) and associated metrics, and starting to report on those metrics,you will experience two types of behavior in your organization. Most of your employees will want to be good team players, and they will work to meet the desirable metrics (and avoid undesirable ones). For example, if you start reporting on the number of changes implemented without proper authorization (could be discovered through Configuration Audits), and you start punishing people implementing changes without authorization, you will see the number of unauthorized changes go down (for most people). However, you will normally also find that some people will try to 'game the system'. In our current example, you may find people implementing changes without proper authorization, but then making it look like (in your tracking system) as if they had had the authorization.

Also keep in mind, that sometimes metrics can have unintended consequences. Sticking with the example of tracking (and trying to reduce) the number of unauthorized changes, you may be surprised to see your backlog of changes waiting to be approved grow, because your approval process was not yet ready to handle all the change that was going on in your environment. So, it's a good practice to be prepared to adjust your metrics accordingly. This also applies to metrics that have been in place for a while. If you have driven the number of authorized changes to zero, and have held it there for the last 12 months, you may want to consider to adjust your focus to other issues (but don't lose sight completely... unauthorized changes can quickly creep back in).

Finally, make sure that you can actually measure the things you need to measure to report on CSFs and KPIs. Setting a goal of no unauthorized changes is laudable, but will remain a goal until you have found a way to detect unauthorized changes.

Having said all of this, here are some examples of KPIs you may want to consider for your Change Management process:

KPI

Metrics

Increase in the percentage of changes that meet the customer's agreed requirements, e.g. quality, cost, time
  • Total number of changes
  • Number of changes that meet / do not meet customer requirements (for each quality, cost, time
Reduction in backlog of change requests
  • Number of backlogged changes
Increase in percentage of changes for which implementation time meets SLA targets
  • Total number of changes
  • Number of change implementations meeting SLA targets
Increase in in scores of survey of stakeholder satisfaction for the change management process
  • Stakeholder satisfaction scores
Reductions in the percentage of changes that are categorized as emergency changes
  • Total number of changes
  • Number of changes categorized as emergency changes
Increase in change success rate
  • Total number of changes
  • Number of changes implemented successfully
Reduction in number of changes where remediation is invoked
  • Number of changes that invoke remediation
Reduction in number of incidents attributed to changes
  • Number of incidents attributed to changes


More on Change Management