Sybase Analytics

There are two ways to read the question.

Is Big Data really a problem with managing Small Data? In other words, when we talk about managing Big Data are we not really talking about managing data at a more granular level? Adding more dimension and detail to the data we choose to record?

Now someone is going to rightfully point out that all this additional detail and granularity leads to more data. True. The problem with calling it Big Data is that people tend to think about volume – more data to store. And people tend to think about speed – more data to process within a given timeframe. All true. But all that frames the conversation about Big Data as if it were a problem.

In reality Big Data is an opportunity that enterprises deliberately choose. Enterprises choose to manage data at a more granular level instead of in summary form. Why? Because it opens up opportunities to look for patterns embedded within.

Yes, IT has the problem of managing more data and must find a platform that can cost effectively store it all. But business has an opportunity to discover more insights from many small chunks of data. So Big Data is just as much about mining Small Data as it is about managing the volume and speed of data. And IT needs to ensure that it provides the business with a platform that can effectively mine the many small chunks of data. It’s a huge opportunity for the business, even if it’s a huge headache for IT.

Which leads to the question’s alternate interpretation.

Should we label the Big Data challenge as Small Data instead? Probably not. Calling it Small Data creates an internal marketing problem. What CIO will spend millions on a small data problem?

Big Data may be Small Data. BUT if you’re looking for IT budget then it’s all just Big Data.