If you’re like me, you’re noticing that everywhere you turn someone is writing about big data. Initially, it was the technology press. Then, business journals and newspapers got into the act. At companies everywhere, senior business leaders and even boards of directors are determining the best ways for their organizations to deal with big data. I like to joke that we don’t need to add the word “big” in front of every utterance of data, but for those who are new to big data, here are four factors to consider:
- Strategy. Have an outline of how your company intends to leverage data. Most any technology organization can download an open source copy of Hadoop, install it on some commodity boxes and declare itself on the big data bandwagon. Unfortunately, this misses the point. It is critical to understand what roles data and analytics play in your company and how you want to leverage that in the future. So a data strategy needs to be informed by the answers to these questions: Does the data strategy support your corporate and IT strategy? Will it be a driver for improving results? Will it help your company make better business decisions?
- Change. Just as the real world is not static, know that data is ever-changing. Big data technologies allow you to work with much larger datasets and at far-faster processing speeds. Technology innovations such as in-memory processing break through old speed barriers. Real-time processing technology innovations change the paradigm from a store and process data mindset to one of processing data in real-time. Even as storage costs go down, it will be more effective to process data in real-time to get to the true signal than to spend money trying to store the complete data set.
- There are four Vs. When defining big data, there are four Vs, not just the three the industry talks about: velocity, variety and volume. The fourth is veracity. In other words, it’s important that data is accurate and reliable, and that you understand what uses it is fit for. Without veracity you can very quickly end up with broken processes or erroneous insights.
- Good governance. Enterprises investing in big data require more emphasis on data governance than ever before. Not doing so is a recipe for a data quality disaster and it could lead to very poor management decisions or ineffective real-time analytics. Careful management of your data is an absolute requirement to get the most out of your big data efforts.
I do believe big data will continue to evolve how business is conducted, changing the way companies interact with consumers. But, it will be those businesses that have the discipline to stay focused on data quality that will reap the most rewards, whether they use the word “big” or not.
Roger Hartmuller is VP of Allstate’s information services group.
This blog was written for Insurance Networking News. Published with permission.