Measurement is ALWAYS necessary in order to make improvement. But, sometimes hard data is hard to come by. I’m a weather watcher and it occurred to me that there is a wonderful analogy about measurement in the story of the Beaufort Scale - a method for measuring the strength of wind.
As you might imagine, in the early days of sailing it was important to be able to communicate the strength of the wind but the tools for accurate empirical measurement had not yet been invented. So, in 1805 Sir Francis Beaufort created what came to be known, creatively, as the
Beaufort scale.
The Beaufort scale enables consistent determination and communication of wind speed based on observed conditions. There are 12 levels of wind strength on the Beaufort scale. A number 3 is also called a gentle breeze; sea observations include large wavelets, with crests beginning to break and scattered whitecaps; and on land leaves and smaller twigs are in constant motion. I have one of those amateur weather stations and it registers wind in kilometers per hour and cites the Beaufort scale number. I find myself referring to the Beaufort number and very seldom do I look to see the actual speed.
This concept can be applied to improvement in cases with you cannot measure the results of change directly, you may be able to create your version of the Beaufort scale. With care, a scale could be created and managed by a team for observations which lack a formal metrics. Not all change is improvement, make sure the changes you make measure up!