Recently, Hurwitz & Associates published its inaugural "Victory Index for Predictive Analytics." The Victory Index is a market research assessment tool developed by Hurwitz & Associates that analyzes vendors across four dimensions: vision, viability, validity and value. In the course of our research, we surfaced a number of trends in the predictive analytics market that have important implications for companies considering deploying the technology. Five of these trends are discussed in this article.
1 | Providing Solutions Across the User Spectrum
Whereas the traditional user of predictive analytics was a statistician or other quantitative analyst, a change is occurring in user type. There is a shift toward business analysts as users and consumers of these products and services, and businesses want to expand the field of users even further. In fact, many organizations believe that anyone with knowledge of the business should be able to make use of predictive techniques. Vendors have responded to this demand in different ways. Some are providing more user-friendly graphical user interfaces and automating the process of building predictive analytics models. Some vendors provide tools with shortcuts, for example, suggesting the right predictive model for a user based on the data at hand.
Ease of use is a huge trend in predictive analytics today. However, since predictive models can be complex (and some remain best left to statisticians to build) some vendors are providing technologies for sharing the results of the models via interactive mashups and other Web interfaces. These strategies can help nontechnical users build and make use of predictive analytics to a certain level. Still others are offering predictive analytics in a software as a service model. Here, companies provide the vendor with their data and the vendor will produce the analysis for the company.
Regardless of who is using the technology, training will be necessary. The vast majority of end users we spoke to for our research, many of whom are using multiple predictive products, believe that training is a must, irrespective of the product used.
Predictive analytics can provide significant top-line benefits to companies, but in the wrong hands can lead to distracting or misleading results. If your company is planning to purchase predictive analytics tools or solutions, it is important to consider the skill level of the people using the technology and the range.
2 | Operationalizing Models
End users and vendors alike see great advantages in incorporating predictive models into business processes. For example, statisticians at an insurance company might build a model that predicts the likelihood of a claim being fraudulent. The model, along with some decision rules, could be inserted in the company's claims processing system in order to flag claims with a high probability of fraud. These claims would be sent to an investigation unit for further review.
In other cases, the model itself might be less visible to the end user. For instance, a model could be built to predict customers who are good targets for upselling when they call into a call center. The call center agent, while on the phone with the customer, would receive a message on specific additional products to sell to this customer. The agent might not even know that a predictive model was working behind the scenes to make this recommendation.
If your company is thinking of going down this route, make sure that the vendor you deal with can support this kind of deployment. For example, the vendor should provide model scoring as well the ability to create rules for decision-making and a platform for model deployment. In the insurance example, for instance, a rule might be that if the amount of the claim is less than $200, the claim goes to a separate category that isn't investigated because it would cost more to investigate than the claim is worth.
3 | Supporting Unstructured Data Analysis
End users realize they can gain significant insight from mining unstructured (i.e., text) data, which, used in conjunction with structured data, can provide a big lift to predictive models. For instance, in a worker's compensation claim, there may be notes regarding poor performance or the fact that the worker had been cited for misconduct. This information may not occur in structured data. Finding some of this information by manually reading through the notes is enormously time-consuming, and it is almost impossible to search through large amounts of data to identify patterns that might indicate fraud.
More vendors are offering solutions that marry structured data together with unstructured data. If your company has a lot of unstructured data and this kind of analysis might be on your roadmap, check with potential vendors to see how they deal with this kind of data. Do they offer text analytics technology? What sources can they extract data from? How easy is it to integrate the structured and unstructured data?
4 | BIG DATA
As companies gather greater volumes of disparate kinds of data (i.e., both structured and unstructured), they are looking for solutions that can scale. This kind of data includes data generated by RFID tags, social media and other channels. Real-time analysis of large amounts of data is also becoming more prevalent. For example, companies might use this capability for real-time ad placement. Or, a hospital might be interested in analyzing patient data from medical devices in real time. The buzz from vendors about "big data" solutions is growing louder. Some are providing solutions that work with big data appliances. Others are purposely built for analyzing big data.