When to Trust the Process Instead of Data

Lindley Hamilton describes what is better than data analysis or procedure.

I am a data geek. I love it because data is objective, free from individual influence. Two plus two is four. I can’t just tell you that it’s nine. You wouldn’t believe me. You’re no fool. But what if the numbers are right, but the analysis is wrong? When does intuition or procedure prevail over data analysis?

Take this from the Providence Journal,

  • The U.S. Census Bureau says Rhode Island has about 770,000 adult citizens and that 73.5 percent of them are registered to vote. So how many voters does the state have on its rolls? Here’s a hint: 73.5 percent of 770,000 is about 566,000. If that’s your guess, you’re wrong.
  • Rhode Island’s voting list claims more than 748,000 people. That’s 180,000 more than the Census Bureau numbers suggest belong there.

Data can’t explain human subjectivity

Overreliance on data takes too long

The explosion of open data and fast progress in data science allows us to know more about our businesses than ever before. Using data is often viewed as the gold standard in contemporary management. This information should produce better decision-making on each aspect of the market.

While the potential of big data is undeniable, is it the remedy for all decision-making situations? When could reliance on too much data backfire? Recent research from professors at King’s College in London examined when overreliance on data can lead to poor decisions.

Uncertain decisions need process instead of data

Researchers centered on innovation screening judgments in creative industries. In these decisions, managers have a dearth of data that would allow them to predict client feelings correctly, business potential, utility, and dangers.

Researchers invited supervisors to report how they made successful decisions. The researcher’s questions asked the degree that they relied on data, instinct, and process. Those processes included “majority” (choosing what the most people wanted), “tallying” (picking the choice with the greatest quantity of positive points), and “experience” (picking the selection that the most experienced individual on the team wanted).

The results showed that most managers followed a process (tallying) more than any data. The research illustrated that relying on data is unhelpful when speed is important. Managers who relied on their instincts together with some simple processes produced choices that were just as reliable but moved much more quickly. Processes and gut feelings suggested a more desirable tradeoff in terms of decision-making speed and accuracy.

When it comes to intuitive decision-making, specialists make better gut decisions. So managers with limited expertise should avoid dependence on intuition. Results from the study show that relying mainly on the process is a strong choice.


Original published on the Hammer Blog.

Hamilton Lindley is a father, husband, and entrepreneur in Waco. He likes leading by enthusiasm, energy, and empathy.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store