A provider of real-time analytics and a provider of cloud-based data management software said Thursday they had put together a system that will analyze large amounts of structured and unstructured data residing in open source systems based on the Apache Hadoop files system manager.

HStreaming, which is headed by a former Citigroup performance manager, said it is working with Cloudera, which provides Hadoop-based data management software, services and training, on the project that is designed to deliver millisecond-latency in analyzing massive amounts of financial records, transaction data, images, and other information.

HStreaming’s software processes, analyze, and visualize massive amounts of so-called structured data, such as account records, and unstructured data, such as photos, video and communications, in real time. The platform can analyze petabytes of new data per day.

Cloudera provides a version of Hadoop called CDH4 that allows users to store data in any format, process data in parallel and in place, perform complex analysis across large, diverse data sets and tie Hadoop into existing data analysis tools.

“HStreaming is tightly integrated into Cloudera’s management console and is also compatible with open source tools such as HBase and HDFS,” said Jana Uhlig, CEO of HStreaming and former Director of Performance Management at Citigroup.

“The partnership between Cloudera and HStreaming enables new types of analytics to be run on CDH that were not possible before,” said Tim Stevens, Vice President of Business and Corporate Development at Cloudera, such as “real-time automated decisions.’’

In capital markets, that would involve trigger actions based on high-volume real-time event streams, similar to complex event processing. Analytics could be performed on historical data, and updates to financial models could be transported directly into the application.

This story first appeared on the Securities Technology Monitor web site.


Register or login for access to this item and much more

All Information Management content is archived after seven days.

Community members receive:
  • All recent and archived articles
  • Conference offers and updates
  • A full menu of enewsletter options
  • Web seminars, white papers, ebooks

Don't have an account? Register for Free Unlimited Access