Average Rating: Rate this article:

Cloudera Announces Real-Time Query Engine for Hadoop By Barry Levine October 24, 2012 1:56PM     Cloudera's Apache-licensed, open-source query engine, Cloudera Impala, is specifically designed for real-time query of data stored in a Hadoop Distributed File System, or HDFS, and in HBase, a non-relational distributed database, and the company said it is the result of two years of in-house development. The queries for Impala can be expressed as SQL.   Related Topics Cloudera Hadoop Big Data Cloudera Enterprise Analytics Business Intelligence Latest News Reality TV's New Stars: Small Biz Soundbars Up the Ante on TV Sound Google Glass Raises Privacy Concerns Pentagon Gives iOS 6 Security OK Should Enterprises Skip Windows 8? There's a new tool for Big Data analysis. On Wednesday, Cloudera announced a real-time query engine for Apache Hadoop, resulting from two years of in-house development efforts. The engine is an enhancement to Cloudera's Big Data platform, known as Cloudera Enterprise. In describing the query-engine's uniqueness, Cloudera claims this is the first time both real-time and batch operations are available for unstructured and structured data in one massively scalable system. Cloudera offers a commonly used version of Hadoop, an open-source data framework designed for handling Big Data. In its announcement, Cloudera said that the new query engine will enable organizations to "process data at petabyte scale and, on the same system, interact with that data in real time to deliver 'speed-of-thought' insights." In short, the company said, the new tool will allow organizations to "ask bigger questions" of their data. SQL Queries The Apache-licensed, open-source query engine, Cloudera Impala, is specifically designed for real-time query of data stored in a Hadoop Distributed File System (HDFS) and in HBase, a non-relational distributed database. Interactive queries for Impala can be expressed as SQL. The company said that Impala operates 10 times as fast as the existing Hive/MapReduce, and can be even faster, depending on the workload. It pointed to cost savings for analyzing Big Data with real-time queries, by using this open-source technology with commodity hardware. Cloudera said that, in a recent survey it conducted of more than 100 customers, over 70 percent were looking at how to extract value from Big Data. Operational IT efficiency and competitive advantage were cited by the customers as reasons for adopting Hadoop, but the vast majority also indicated they needed faster methods of querying than the batch operations that had been available. 'Most Exciting' Since Hadoop In its announcement, the company pointed to one of its clients, travel Web site Expedia, which said that it uses the Cloudera Enterprise platform to manage more than 4 petabytes of data. With Impala added, Expedia said the enhanced Enterprise Real-Time Query platform allows the creation of one single platform for Big Data, instead of having to maintain several systems for archiving, extracting, transforming, loading, and analytics. Cloudera CEO Mike Olson said in a statement that, "until now, enterprises had to limit the work they did with Hadoop because batch-mode processing using MapReduce was just too slow for some business problems." Impala, he explained, will enable organizations to store all their data in Hadoop and "use the same hardware to do both powerful analytics and run real-time queries using industry-standard tools and the SQL language." In fact, Cloudera co-founder and Chief Scientist Jeff Hammerbacher characterized Impala as "the most exciting open-source project since Hadoop," adding that it was "the most important framework beyond MapReduce for analyzing data stored in HDFS and Hbase."   Tell Us What You Think Comment: Name: Also Visit: iPad Info Center Billions of Bytes Mobile Device Now Apple Info Center TopTechWire.com

Product Information and Resources for Technology You Can Use To Boost Your Business BYOD & MDM   Build a business case for a BYOD program. CRM Systems   Free Download: Understanding the Voice of the Customer   Unlock the potential in your people with Microsoft Dynamics   How Microsoft Dynamics helped mobilize retail businesses   2 million CRM success stories and counting...   Experience CRM and Business Success today with Salesforce.com.   Free Download: Understanding the Voice of the Customer   Optimize CRM with Data Quality Management. More from Trillium Cloud & Virtualization   Riverbed Stingray Traffic Manager on Amazon Web Services Contact Centers   Unlock the potential in your people with Microsoft Dynamics Customer Data   Free Download: Understanding the Voice of the Customer   See how you can benefit from Microsoft Dynamics   Free Download: Understanding the Voice of the Customer Customer Service   Improve your customer relationships with Microsoft Dynamics   2 million CRM success stories and counting...   Unlock the potential in your people with Microsoft Dynamics Data Security   Simpana® 10 software: an exponential leap forward Enterprise Hardware   The 2013 Toughpad™ tablets. Rugged, secure and built for business.   Rugged and reliable Panasonic Toughbook® mobile computers.   The best document scanner for you? Try KODAK's scanner selector   APC makes it easy for you to focus on business growth, not downtime. Enterprise I.T.   Brocade's mission: Making networks easier to deploy, manage, and scale.   11 Challenges Solved by Infrastructure for Small IT Environments Enterprise Software   Get critical data off paper and into SharePoint! Watch the video.   Simpana® 10 software: an exponential leap forward Hardware   The 2013 Toughpad™ tablets. Rugged, secure and built for business.   Rugged and reliable Panasonic Toughbook® mobile computers.   Rugged and reliable Panasonic Toughbook® mobile computers Innovation   The best document scanner for you? Try KODAK's scanner selector   Brocade's mission: Making networks easier to deploy, manage, and scale. Laptops & Tablets   Rugged and reliable Panasonic Toughbook® mobile computers. Mobile Apps   Build great mobile apps that drive engagement. Mobile Tech   Rugged and reliable Panasonic Toughbook® mobile computers Small Business   The best document scanner for you? Try KODAK's scanner selector Tech Trends   APC makes it easy for you to focus on business growth, not downtime.

Network Security Spotlight

Syrian Electronic Army Hacks Financial Times The Financial Times is the latest victim of the Syrian Electronic Army, a group that supports Syrian President Bashar al-Assad. The U.K.-based newspaper said a blog and its Twitter accounts were hacked.   Patch Tuesday Hyper Focuses on IE 8 Microsoft on Tuesday issued 10 security bulletins that fix 33 vulnerabilities. These updates include MS13-038, which will address the Internet Explorer 8 issue described in Security Advisory 2847140.   Surge of Venture Capital Buoys Tech Security Sector With companies and governments spending billions to repel cyberthreats, a surge of venture capital is pouring into companies developing cybersecurity technologies, the front line of the conflict.

Enterprise Hardware Spotlight

U.S. Defense Department Gives iOS 6 Security OK In a vote of confidence for Apple's iOS devices, the Defense Department has given the all-clear for employees to use iPads and iPhones for work. But only those running iOS 6, and only if issued by the government.   Cisco Surges After Profit Exceeds Analysts' Estimates Networking equipment giant Cisco's net income jumped 14 percent in the latest quarter as revenue at all four of its divisions rose for the first time in a year and a half, as tech spending increases.   HP and SAP Team To Advance HANA Database Technology The two tech leaders are working on a system that SAP says could fundamentally change the database market. HANA is SAP's technology that keeps data in-memory, for super fast processing.

Mobile Enterprise Spotlight

Google Glass Raises Congressional Privacy Concerns The buzz around Google Glass continues, but it's not all good. Some in Congress have questions. "We are curious whether this new technology could infringe on the privacy of average Americans," their letter to Google says.   Windows Phone Now No. 3 in Market, BlackBerry No. 4 Has Microsoft Phone moved into a coveted though distant third place for smartphone platforms behind Google's Android and Apple's iOS? A new report says yes, while BlackBerry has slipped to No. 4.   Intel Going Mobile with Its New CEO In his first speech as Intel's CEO, Brian Krzanich said he plans to focus on beefing up Intel's presence in mobility. The next step: a world tour showing mobile devices based on Intel chips, from PCs to phones and tablets.

Enterprise Technology Spotlight

HP and SAP Team To Advance HANA Database Technology The two tech leaders are working on a system that SAP says could fundamentally change the database market. HANA is SAP's technology that keeps data in-memory, for super fast processing.   Cloud Computing Gains Another Competitor with Google Amazon Web Services and Microsoft Azure now have a full-on rival in Google, with its I/O announcement that it is opening its hosted Compute Engine environment for virtual machines to all comers.   Hackers' New Tool of Choice: Smartphones Smartphones are increasingly popular not only with consumers, but with thieves who see the devices as another way to tap into bank accounts and other sensitive information, experts say.

Navigation NewsFactor Network Home/Top News | Enterprise I.T. | Cloud & Virtualization | Applications | Unified Communications | Mobile Tech | Hardware | Business Intelligence World Wide Web | Network Security | Data Storage | Small Business | Microsoft/Windows | Apple/Mac | Linux/Open Source | Personal Tech Press Releases NewsFactor Network Enterprise I.T. Sites NewsFactor Technology News | Enterprise Security Today | CRM Daily NewsFactor Business and Innovation Sites Sci-Tech Today | NewsFactor Business Report NewsFactor Services FreeNewsFeed | Free Newsletters | About NewsFactor Network | How To Contact Us | Article Reprints | Careers @ NewsFactor | Services for PR Pros | Top Tech Wire | How To Advertise Privacy Policy | Terms of Service © Copyright 2000-2013 NewsFactor Network. All rights reserved. Article rating technology by Blogowogo. Member of Accuserve Ad Network.