A great unmet need for agile cloud application development, application scalability, broader data collection, extreme transaction processing and streaming data management are creating a need for multiple big data technologies besides Hadoop.

A newly published International Data Corporation (IDC) study also offers a methodology and advice to IT customers regarding which of these technologies is appropriate for the specific task at hand.

Emerging technologies, including vendor processing, DBMS firmware, and non-volatile memory perform the operational data functions required for developments such as transactional software as a service (SaaS) in the cloud for broader realtime analytics and for analytics that blend various kinds of data.

While IDC predicts that in 2014 the dominant big data technology will continue to be Hadoop and its tributaries. At the same time, document and table-oriented NoSQL DBMSs will begin to gain traction beyond the early adopter phase and will develop along a parallel track with Hadoop on one hand and relational DBMS on the other.

IDC advises organizations to consider all big data technology solutions carefully and develop a strategy for deployment before committing to a data management technology.

“Big data technologies offer great benefits to businesses by enabling them to tap the value inherent in various kinds of data that could never be leveraged before in an affordable way,” says Carl Olofson, research vice-president for data management and data integration software research at IDC.

“Anyone investigating Big Data technology for the enterprise must first identify the type of data to be managed and the problems to be addressed.”