Data lifecycle management – Big data needs lifecycle management principles too. Enterprises must to define the length of time for which the data is needed online and then define the archiving and storage strategies for this data post-consumption. Even platforms like Hadoop provide a mechanism for reducing the burden of a large volume of data being in the “namenode.”
Risk and cost containment – While big data can benefit enterprises, there are hidden risks in the acquisition and processing of big data, which can be mitigated by implementing a governance process for infrastructure, process and consumption of the data. The biggest risk that we see unfolding is the incorrect association of the data and its subsequent processing, which can be avoided with stewardship and standards.
As we can infer from this brief discussion, data governance plays an extremely important role in big data and its management. If implemented early on and in the right organizational process, enterprises will reap rewards with big data processing and reduce any visible risk associated with such a program from a cost perspective. This is the beginning of a long journey for many organizations, and following a known path will bring improved adoption and success in the big data world.
In his 21 plus years of professional experience, Krishnan has been solving complex solution architecture problems around data warehousing and business intelligence for Fortune 1000 clients across the world. He is the president of Sixth Sense Advisors Inc., a Chicago-based company providing Independent analyst services in big data, data warehousing and business intelligence, and serves as Senior Vice President of Innovation for CBIG Consulting, a consulting firm focusing on data warehousing and business intelligence. He co-authored Building the Unstructured Data Warehouse along with Bill Inmon. He also has written eBooks, more than 150 articles, viewpoints and case studies on big data, business intelligence, data warehousing and data warehouse appliances, and high performance architectures. Reach Krish at krish.krishnan@cbigconsulting.com.
Be the first to comment on this post using the section below.