The Agile Data (AD) Method

Agile Data Logo

Data Quality: The Impact of Poor Data Quality

Data quality is a measure of how well your data meets or exceeds the criteria set for it. Unfortunately, many organizations suffer from poor quality data, what many refer to as data technical debt or simply data debt.  This is a serious problem for several reasons:

  1. Longer time to market for new customer offerings. It is much more difficult to work with low-quality data than high-quality data. This is due to increased effort to understand the data and then to fix it as best as possible to make it more usable.
  2. Increased cost to work with low-quality data. The increased time to work with lower-quality data results in increased cost to do so.
  3. Unpredictability of schedules and cost. Because most data technical debt is hidden it becomes difficult to predict how much effort it will be to work with, and to evolve, existing data. This is because you often do not know how big the mess really is until you at least investigate the situation.
  4. Poor decision support. The quality of your ability to make good decisions is directly impacted by the quality of the data available to you.  Garbage in, garbage out (GIGO).
  5. Poor quality artificial intelligence (AI). Similarly, the quality of your AI systems is directly influenced by the quality of the data used to train them. Once again, GIGO.
  6. Decreased collaboration. An indirect problem with poor quality data is that it can decrease collaboration between teams, which is unfortunate because data technical debt often requires cross-functional collaboration to remove. This decreased collaboration is often the result of “finger pointing,” the developers didn’t work with the source of record, the data people were too hard to work with, this team didn’t keep the documentation up to date, and so on.

The quality of your data has a material impact on your organization. This is why the Agile Data (AD) method advises you to be “quality infected” and to ensure the high data quality within your organization.

 

Recommended Reading

Choose Your WoW! 2nd Edition
This book, Choose Your WoW! A Disciplined Agile Approach to Optimizing Your Way of Working (WoW) – Second Edition, is an indispensable guide for agile coaches and practitioners. It overviews key aspects of the Disciplined Agile® (DA™) tool kit. Hundreds of organizations around the world have already benefited from DA, which is the only comprehensive tool kit available for guidance on building high-performance agile teams and optimizing your WoW. As a hybrid of the leading agile, lean, and traditional approaches, DA provides hundreds of strategies to help you make better decisions within your agile teams, balancing self-organization with the realities and constraints of your unique enterprise context.

 

I also maintain an agile database books page which overviews many books you will find interesting.