Data analytics remained one of the most important areas of technology investment throughout 2015, and industry analysts agree the same will hold true in 2016.
Hortonworks Chief Technology Officer Scott Gnau shared his thoughts with Information Management on what will be five of the most important data trends to impact the CIO in the coming year.
Internet of Anything
“Next year businesses will look at deriving value from ALL data. It’s not just the Internet of Things but rather Internet of Anything that can provide insights,” Gnau says.
“Getting value from data extends beyond devices, sensors and machines and includes ALL data -- including that produced by server logs, geo location and data from the Internet,” Gnau explains.
Data at the jagged edge
“Businesses must look beyond the edge of their data centers all the way out to the jagged edge of data,” Gnau notes. “Data flows now originate outside the data from many devices, sensors and servers on, for example, an oil rig in the ocean or a satellite in space.”
The impact: “There is a huge opportunity to manage the security perimeter, as well as to provide complete data provenance across the ecosystem. IoAT creates a new paradigm that requires new thinking and new data management systems, and these solutions will mature and permeate the enterprise next year,” Gnau says.
Data in motion platform
“The industry will see the evolution of data in motion platforms in 2016,” Gnau says. This will result in “a need for a higher-level platform to handle the many device protocols and bring all of the data flows into Hadoop.”
“The platform needs to facilitate communications in multiple protocol languages. There combination of data in motion and data at rest is a big opportunity for the year,” Gnau explains.
Big data made easy
According to Gnau, “There is a market need to simplify big data technologies, and opportunities for this exist at all levels: technical, consumption, etc.”
“Next year there will be significant progress towards simplification,” Gnau says. “It doesn't matter who you are - cluster operator, security administrator, data analyst - everyone wants Hadoop and related big data technologies to be straightforward. Things like a single integrated developer experience or a reduced number of settings or profiles will start to appear across the board.”
Hadoop for mission critical workloads
In 2016, Hadoop will be used to deliver more mission critical workloads — “beyond the ‘web scale’ companies, as Gnau describes it.
“While companies like Yahoo!, Spotify and TrueCar all have built businesses which significantly leverage Hadoop, we will see Hadoop used by more traditional enterprises to extract valuable insights from the vast quantity of data under management and deliver net new mission critical analytic applications which simply weren’t possible without Hadoop,” Gnau says.