MAY 24, 2007 1:00am ET

Related Links

10 Sustainability Predictions for 2011
February 23, 2011
A Letter to Future Employees: Embrace Analytics
February 3, 2011
A Hunger for Risk
January 6, 2011

Web Seminars

Data Discovery for Big Insights
Available On Demand
How to Narrow the IT/Business Communication Gap
Available On Demand
Suit Yourself: An Effective Recipe for Self-Service Analytics
Available On Demand

Validity, Design and BI, Part 3

Print
Reprints
Email

The May OpenBI Forum is the third of a series. For the second time this year, I've changed the topic of a column at the 11th hour based on something I've recently read. This time, that something is a business book, The Halo Effect - and the Eight Other Business Delusions That Deceive Managers, by Phil Rosenzweig. The Halo Effect, an easy three-hour read, is destined to be one of the best business books of 2007 - or any year for that matter. And since much of the book's content challenges the validity and interpretation of popular business research, its concerns are quite similar to those of the OpenBI Forum's two latest columns on validity, design and BI.

Readers who derive their corporate opinions from Forbes, Fortune and Business Week, or who lionize the popular management tomes of the last 25 years like In Search of Excellence, Built to Last, What Really Works and Good to Great, should be a bit circumspect when they take on The Halo Effect. For without inflammation but with surgical precision, Rosenzweig debunks the feel-good findings and interpretations of this research, leaving readers with the near-certain conclusion the books are little more than nice stories of how the business world should work. Alas, as The Halo Effect demonstrates, real business isn't as tidy or conforming as we'd like.

The Halo Effect

In psychology, the halo effect is an error in interpretation in which an evaluation of people or organizations on one dimension is generalized to other dimensions without substantiation. The halo effect was coined by psychologist Edward Thorndike during World War I to explain the phenomena where soldiers who ranked highly on leadership and intelligence, say, were assumed to be superior in other traits, while those deemed lacking in leadership were seen as inferior across the board. Over time, the halo effect has come to represent a tendency to assume specific traits based on a general impression - to blend features together, to make attributions from what is known to what is vague.

Rosenzweig argues convincingly that the halo effect is in play when companies whose financial performance is superior are presumed to have a laser-like strategic focus, to execute with aplomb, to have enabling leadership, to possess a cohesive culture and to be locked in on customer needs. Companies struggling financially, on the other hand, are assumed to have strayed from core, to be arrogant, to have lost focus, to be disconnected from customers. The big problem for the type of analyses noted in The Halo Effect is that indicators of company performance such as leadership, strategic focus, culture and customer orientation are not measured objectively and independently of financial performance, but rather assume the "halo" of that financial performance - either positive or negative.

Rosenzweig's discussion of the up and down fortunes of Cisco and the Swedish-Swiss industrial company ABB is as entertaining as it is illuminating. Citing popular business press, Rosenzweig illustrates the halo effect with all its splendor. The CEO of ABB, characterized as charismatic and visionary while ABB's performance was in orbit, is seen as arrogant and imperial on the decline. ABB's decision to expand into new areas like financial services was framed as a bold growth move in good times, but criticized as impulsive and foolish on the downturn. Cisco, lauded for its culture, customer focus, acquisition strategy and leadership in the high-flying late 90s, was denigrated as an out-of-control and overhyped underachiever in 2002. The juxtaposition of before and after quotes on the "causes" of the fortunes of ABB and Cisco - the halo effect in practice - is almost comical.

Though a psychological process that causes people to assess in certain ways, the halo effect needn't be an inevitable consequence of our desire to evaluate, our need to examine cause and effect. Indeed, the biggest problem with the assessments and studies noted in The Halo Effect is one of design and method. The dimensions of company performance in these cases - strategy, leadership, culture, etc. - are measured not by independent, objective evidence, but by individuals who are subject to a biasing halo interpretation. The inferior designs of these anecdotes, case studies and cross-sectional investigations almost guarantee that dimensional assessments will be reflective of overall performance, thus assuring a halo effect.

Other Delusions

The halo effect is not the only validity-threatening flaw discussed in the book. Nine delusions are noted in all, among them "correlation and causality," "lasting success," "connecting the winning dots" and "the wrong end of the stick." The problem of correlation and causality is as old as science and has to do with interpreting an association between two variables. Does a strong relationship between employee satisfaction and company performance imply that satisfied employees enhance company performance? Or that good company performance makes for satisfied employees? Or both? Or neither? The directions of many such relationships between company performance and dimensions of performance noted in The Halo Effect are certainly open to debate, especially those from anecdotes or cross sectional investigations that measure at one point in time only.

The delusion of lasting success embodies the statistical artifact of regression to the mean, in which above-average performance tends not to persist, while below-average results tend to improve over time. Nowhere is this more evident than in stock prices, often the top performance measure cited in the various analyses and studies of The Halo Effect. Rosenzweig notes that over half of Built to Last visionary companies failed to match the S&P 500 over the five year period post-study, after outperforming the index by a factor of 15 for 60 years. This type of finding is commonplace in the markets. Little wonder prudent investment managers urge customers not to chase outstanding stock performance.

Advertisement

Comments (0)

Be the first to comment on this post using the section below.

Add Your Comments:
You must be registered to post a comment.
Not Registered?
You must be registered to post a comment. Click here to register.
Already registered? Log in here
Please note you must now log in with your email address and password.

Where do young IT professionals (30 and under) obtain information to aid with daily role responsibilities and career development?

Trade publication websites 14%
Social media 23%
Vendor websites 4%
Vendor/community forums 7%
Newsletters 1%
Trade conferences/meetups 2%
RSS feeds 6%
Web search 44%

 

Twitter
Facebook
LinkedIn
Login  |  My Account  |  White Papers  |  Web Seminars  |  Events |  Newsletters |  eBooks
FOLLOW US
Please note you must now log in with your email address and password.