Don’t believe the (Big Data) hype?

Two Gartner reports recently about Big Data

  1. Your Big Data projects will fail and here’s why (ZDNet Summary)
  2. Big Data ROI remains elusive (ZDNet summary).

Both reports and summaries try to inject a dose of reality into Big Data adoption. I don’t plan to summarise them here, (ZDNet already did that…) but I notice two important points :-

  1. Between one-third and almost 50% of respondents don’t know if ROI will be positive or negative.
  2. According to Gartner / ZDNet – two thirds of Big Data projects will fail.

ROI is obviously an elusive measurement, sometimes it’s used as a predictive tool to justify investments and then measurement doesn’t take place. We have seen plenty of Big Data projects that goo through an elaborate internal dance of justification using ROI calculations that are then forgotten or ignored once the project is up and running.

For sure many Big Data projects will fail (lots of our successful projects have been built on the back of failed projects from other suppliers), but most of the customers we talk to are becoming knowledgeable enough to avoid basic pitfalls like business linkage, skills building etc. The challenge for them is understanding the frenetic pace of change in the technology, I am sure this is the number 1 factor (among many others) that causes projects to fail.

If you feel out of control in setting your Big Data priorities there is one activity above all others that avoids the pitfalls Gartner outlines. In many ways it’s a paradigm shift as Open Source has moved into mainstream Enterprise adoption. A pre-requisite for success is – reading and lots of it. Very basic, but in such a fast moving environment with relatively high levels of complexity and still very tools/platform based – to avoid failure you must (must) spend maybe 1 hour a day reading blogs, product announcements, Apache project details, white papers. It’s that simple. Read lots and don’t fail….. don’t read and fail (lots)

What do you think – do technologists and non-technologists have to up their reading time? What are the other critical factors for success in Big Data.?

Going to Strata NY next week? Please let us know – we would love to meet you there.

If you have additional questions, get in touch with us!

3 + 4 =


Corporate Head Quarters

2205 152nd Avenue NE
Redmond, WA 98052

+1 (425) 605 1289

Latin America

(Mexico, Colombia & Chile)

Mexico City

Córdoba 42 Int. 807, Roma Norte, Cuauhtémoc, 06700, Mexico City

+52 (55) 5255 1329

United Kingdom


85 Great Portland Street, First Floor, London, W1W 7LT

+44 2030 971584



77 Camden Street Lower, Dublin, D02 XE80, Ireland

+353 71 915 9710

Search Guard is a trademark of floragunn GmbH, registered in the U.S. and in other countries. Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries. OpenSearch is licensed under Apache 2.0. All other trademark holders rights are reserved.