Last time on the Data Knowledge Newsletter, we dove into how an analytics hub can bring all of your team’s critical data assets into one place, and help your organization begin to tame the entropy of the modern analytics environment. Today, we zoom in closer on the related challenges teams face in understanding how their assets are being utilized.
Most often, analytics teams have little information about what analytics assets are used, and drive decisions within the organization. In contrast to traditional software products, where there are many ways to collect data about adoption and value, data teams have little insight into usage and adoption.
In the context of the push to treat “data as a product,” how do data teams find themselves facing such a glaring blindspot?
With gaps in the solutions historically available to understand analytics adoption, teams have taken various approaches to understanding how analytics are being used. These are inspired by the methodologies applied by product and customer experience teams, and largely hand rolled:
Using NPS surveys to gauge satisfaction:
Conduct user interviews
Pulling native asset analytics:
“All of the effort that my team is doing, is it actually generating the output that the teams expect or that the team is actually able to use? Basically, limiting the amount of wasted work that our team is doing.”
— Michelle Ballen-Griffin, Head of Data Analytics, Future
When measuring the success of your data products, there are a few good questions to start with:
Answering the question of active users is both the simplest and the most important. If you do not know how many people are using your reports and dashboards, you have no guideposts for which assets are crucial to support, and which are not worth your time.
Discovering who is using your data assets provides additional insight beyond active use. A deeper level of understanding might include which reports your Chief Revenue Officer looks at every day, or which dashboards are most popular within your marketing organization.
Finally, contextual and relational data about how data is being consumed, and the decisions that it informs, directly connects your data to operations and business results. This might uncover a group of assets that are frequently used together, or help you realize that teammates have to use two or three reports to answer a single question.
All of this granular, quantitative, and contextual data mirrors what traditional product teams would consider table stakes for doing their job effectively – why should analytics teams expect anything less?
The unfortunate truth is that – until now – there has been no solution that collected and exposed this data in a single place. There has been no equivalent of a CDP that allowed for either client or server side tracking across all of the data assets in your environment.
But luckily, thanks to the new capabilities of data products analytics, this information is now available to any data team.
“I would say that the data team’s mandate is not just ‘produce the data,’ ‘produce a data warehouse,’ or ‘produce reports.’ I kind of think the data team is accountable for how data is used across the entire organization, and creating a culture where the entire organization is making data-driven decisions.”
— Scott Breitenother, Founder & CEO, Brooklyn Data Co.
In our previous post, we spoke about the value of an analytics hub in consolidating disparate assets in a fractured data ecosystem.
Providing teams with a single access plane for analytics is a necessary prerequisite to data asset analytics. Only once all of your analytics are in an analytics hub can the metadata we have discussed be automatically collected and normalized.
What happens from there is up to the analytics team. Armed with adequate usage data, they can do what they do best: develop insights, iterate and evolve their offerings, and begin driving the greatest value for the most people in the organization. Having extensive and normalized usage data is the foundation for effective Data Knowledge Management.
Receive regular updates about Workstream, and on our research into the past, present and future of how teams make decisions.