The Art of Data Usability
Tryggvi Björgvinsson
  • MEAP began June 2017
  • Publication in Early 2018 (estimated)
  • ISBN 9781617294716
  • 300 pages (estimated)
  • printed in black & white

You're planning a large event in Stockholm. It's important for you to know who is coming and when, but you don't need complete data about them-family history, employment status and property ownership is probably irrelevant. You need different things out of data for different situations. Crop forecasts are measured in days or weeks, while train schedules must be accurate within minutes or seconds. Knowing how data will be consumed and planning data projects accordingly is the essential art of data usability. Measures of data quality, such as precision, timeliness, format, and so on all depend on how those data are to be used.

Table of Contents detailed table of contents

Part 1: Introduction

1. Learn from the past

1.1. Base future improvements on past insights

1.2. The path to wisdom

1.2.1. Data

1.2.2. Information

1.2.3. Knowledge

1.2.4. Wisdom

1.2.5. DIKW hierarchy

1.3. A cozy and murderous project

1.3.1. Designing for different situations

1.3.2. Setting up the infrastructure

1.3.3. Collecting and processing data

1.3.4. Announcing the results

1.3.5. Wrapping things up

1.4. Summary

2. Create the perfect world

2.1. What exactly is quality?

2.1.1. Imitating Santa Claus

2.2. Managing quality

2.2.1. Planning and designing metrics

2.2.2. Implementing controls and changes

2.2.3. Analyzing the implementation

2.2.4. Establishing a new baseline

2.2.5. Document everything

2.2.6. The difference of data quality

2.3. Summary

Part 2: Designing a Data Project

3. Know what people want

3.1. Prioritize needs of users in situations

3.2. Identify and prioritize user groups

3.3. Identify and prioritize situations

3.4. Identify needs of users in situations

3.5. Prioritize needs of users in situations

3.6. Summary

4. Pick the right tools

4.1. Writing quality controls as monitoring plugins

4.2. Example monitoring tool

4.3. Summary

Part 3: Managing Data

5. Live with hardware failures

6. Cope with disasters

7. Trust and be trusted

Part 4: Data Collection

8. Get the right data

9. Get data more than once

Part 5: Processing Data

10. Deliver on time

11. Get the results you expect

Part 6: Dissemination of Data

12. Make yourself understood

13. Being transparent

Part 7: Closing a Data project

14. The right to be forgotten

15. Open up


Appendix A: Installing and using Python

A.1. Installation

A.1.1. GNU/Linux

A.1.2. Mac OS X

A.1.3. Microsoft Windows

A.2. Virtual environments

A.3. Create your first Python program

Appendix B: Data formats

B.1. CSV


About the book

The Art of Data Usability teaches you how to set up data projects in a way that maximizes their effectiveness for their intended users. In this interesting, practical guide, you'll master techniques for understanding the type and role of the data you have and preparing those data to maximize their value. With the help of dozens of real world examples that the author has faced before, you'll learn from them to piece together the perfect workflow for sorting through data for your clients, principles for establishing data projects, and techniques to apply to your datasets. Throw in a bit of coding, and you'll be more than prepared to get the data you have in the right shape, exactly when you need it.

What's inside

  • The attributes of quality data
  • Identifying user needs and requirements
  • Using Python for data quality monitoring
  • The correct way to disseminate your data
  • Best practices and methods to improve data usability

About the reader

Written for readers comfortable with data management and common data formats such as CSV and JSON. Some examples require novice-level programming skills.

About the author

Tryggvi Björgvinsson is the head of IT and dissemination at Statistics Iceland. He holds a Ph.D. in software engineering.

Manning Early Access Program (MEAP) Read chapters as they are written, get the finished eBook as soon as it’s ready, and receive the pBook long before it's in bookstores.
MEAP combo $44.99 pBook + eBook + liveBook
MEAP eBook $35.99 pdf + ePub + kindle + liveBook

FREE domestic shipping on three or more pBooks