September 20

Managing the Hurricane of Data


We’ve created a handy guide to help you manage the hurricane of daily data.


As the end of summer approaches, I love the annual appearance of the windswept weather guy on our favorite news channel.

You know the one, he attempts to stand in the thrashing wind, slammed by waves that would toss a small boat onto the sidewalk, reporting on the nasty hurricane conditions as the wind blows him off camera and into the ocean.

You might feel like that weather guy every day as you get pummeled by a constant stream of data and numbers to review, trying to get a handle on your business.

You might see a break in the clouds and get a reprieve.

Only to realize that it was the eye of the storm passing and you are about to get whipped by the circular motion of the data cycle that begins again.

In 2012, 639,800 gigabytes of global IP data was transferred every minute. By the end of 2013 it had increased to 1,572,877 gigabytes each minute. That is a staggering 130% increase in just one year. This statistic highlights the tension we feel as we attempt to understand the state of our business.

Source: Intel


The average time spent on devices increased 157% in just four years. No doubt a result of the explosion of platforms and the connectivity they bring long after the workday is over.

Source: comScore Media Metrix

All this connectivity creates information. From who our customers are and if they liked our latest offers. To their return rates and satisfaction after the sale. Data is crucial to understanding what is working – or not – and how our efforts are affecting the bottom line.

Without a plan to manage the flood of data, you’re rowing in the ocean with a small paddle. Searching for the right information that can be the life preserver of profitability.

We have been able to use data to understand and fine-tune our businesses for decades. Business analysis had, until recently, been the exclusive domain of Fortune 1000 companies. Developments in technology give even the bakery on the corner the ability to test, measure and adjust flavors every hour if needed. With tools in the cloud, sophisticated data sorting and real-time analysis can tell us if chocolate or red velvet is a crowd pleaser.

We should be using all the data we can get our hands on. How do we manage the constant stream and make sense of it all?

The key is having a plan and using the right tools to gain insight. A flight over the storm to see where you are now and where it’s headed – so that you can plan ahead and find the safest harbor.

We’ve created this guide to help in several ways.

In this post and in the tools we created that you can download for free, we outline the six steps designed to help you figure out the data you have, organize and prioritize it, add what might be missing and ways to manage for the future.

The six steps covered in detail are:

  • Getting the right team together
  • A review of the data you are collecting now
  • Analysis and scoring
  • Filling in the gaps
  • Taming the spreadsheets with tools
  • Test run and revisions

Before we start, we need to assemble the right team.


Getting the right team together


A project of this size works best if you have a cross-functional team and senior management buy-in.

This will ensure you get help from people that create and use the reports and that they are invested in the future plan. The last thing that you want is to only have a few departments involved in the effort. You run the risk having an incomplete picture for the company.

Having the right team will help you frame the project as a positive contribution. Some people may feel threatened and fear that changing report creation will take away a task that is now their job. To be sure that the project is viewed in a positive way, get buy-in from all levels of the company for the project first. Use internal communication tools to spread the word about the effort. This is key to a successful implementation. Help folks understand that increasing clarity around data creates a more profitable company and benefits everyone.


The Review


To develop a sound plan for managing data, you must begin with an understanding of what your organization is already spending time and effort collecting and creating.

Having a team that represents all functional areas of the company is critical in this early stage.

Your team can assist in gathering every report that is currently created. They will know if their team is creating a critical spreadsheet they rely on every day to manage their business.

Once you have gathered all the information, tear apart the reports to understand the information that is key for your business. This might appear to be a daunting task given the reams of paper in front of you, but it is critical in creating the right plan and flexible path for the future.

Download a tool we have created that you can use to help sort your data.



The guide has several functional groups filled in that can be changed based on your organization. Typically they will be departments like finance, marketing, sales and operations. The groups can also be product or customer focused depending on your organization.


Analysis and Scoring


Chart the key data points from each existing report and their source.

For example, operations might report the number of items produced for a given product line each day. Sales could report sales data by channel for that same product. They could be combined in an existing report. By separating the individual components, you can use that data in a different way, providing new insight into your business.

After you have this step completed, it is important to define who is going to use the data – not everyone needs – or wants – access to everything. List the names and titles of people that currently access or use this data. This then becomes a guide for what team members and titles in the organization are granted access to the reports that are generated. Don’t worry if you are missing someone, that will come about in the testing phase. If someone is missing access to a key report, they will let you know right away.

The next step is to rank each piece of data. If it is mission critical give it a score of 5. If it is a nice to have, give it a score of 3. And if you are asking yourself why in the world you would care about that information, give it a score of 1. This will create a scorecard that allows you to structure the data and make hard choices about your data needs. This scorecard can be used to define the most important information that forms the top line page of the dashboard.

The scorecard can help you understand the data that should be the focus of your efforts. Start with the mission critical list. Some of the reports coded as nice to haves may be constructed from mission critical reports. The scorecard will also let you cut down what is not key to managing the business. Don’t get bogged down by others that want to look at more – people can only focus on few points – this process forces focus.

After assigning a score to each piece of data, move to the next stage of the project – understanding what you are missing and what you might need for the future.


Filling in Gaps


Once you have sorted the scorecard and rated the data that is most important in managing your business, you can see what you might be missing.

Create a road map to gauge the data you are collecting now and the data you are going to need in the future as your business grows and expands.

Data can be organized and coded many different ways. But you can’t report on what you don’t have – so the scorecard will help you understand what might be missing. From here you can fill in the gaps and create a fuller picture to help manage the business. This might lead to generating data from new sources.

Some reports are generated to answer one question one time – but the report is still generated in case the question comes up again. The source data that is used to create an ad hoc report can be placed in the data storehouse, and by understanding what you have and how it can be combined, future ad hoc reporting – along with time and effort it takes – can be minimized.


Taming the spreadsheets with tools


With the scorecard complete, it is time to take the most important pieces of data and meld them into a new tool that takes the numbers and presents them in a visually appealing dashboard. Unchaining the data from a basic spreadsheet can provide more frequent and automatic updating. There are many resources can help – from simple dashboard tools to sophisticated enterprise-level business intelligence engines.

We created a quick guide to some of the most popular tools around – CLICK HERE TO READ.

The list provides a few tools to review and try. Most offer a free trial using your own data which can provide a good idea if they will work in your specific environment. The dashboard you choose should reflect the priorities that you outlined in your scorecard. If the focus of the data is more financial in nature, you would want to ensure that the ones you test and confirm have robust capabilities in that area. If the data will be used in a more general way, then one that has a broad scope, but might limit the depth could be a better choice.

The key is to not rush to a decision. Choose several to test and use a trial period to find the best fit. You are now ready for the next step in the data evolution – testing to ensure flawless execution.


Test, review, revise and implement


Once you have chosen a dashboard tool to assist in creating the reporting environment, you will move into a critical testing phase. Most often, you will start the testing phase with sample data and if all goes well, test with a live data feed. The timing of this stage will be dependent on tracking down reporting errors and fixing flaws. The new dashboards you create will be compared to existing reports to ensure accuracy. This is key as if reports are wrong, all the work potentially be wiped away as teams will not trust the information.

Be patient and allow plenty of time on the schedule for this step. After a successful live test, you will want to set up a test site where you can provide access to end users and invite feedback. This test site should also include the permission levels and secure areas that will be part of the final product. This will ensure the visibility of sensitive data is executed the way that you want and need it to be. The final product should meet their needs – and if it doesn’t – be open and willing to change.

Depending on the size of your organization, you might have to start with one group or department and deploy each conversion one at a time. There is no shame in starting small and expanding. It is smart to start with a smaller data set instead of trying to manage an entire organization’s reporting needs.

Fewer data points translates into a smaller test footprint. This makes it easy to track down flaws in the testing and implementation phase.


Final View


With the right team, clear analysis, structure and tools, the tide of data that can overwhelm your business can be calmed into a smooth stream. Illuminating and providing understanding of potential. All while saving time and money.

Click the link below to access the tool.


You may also like

Leave a Reply

Your email address will not be published. Required fields are marked

{"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}

Get in touch

0 of 350