Tag: HBase

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. Welcome to our fourth edition of “This Month in the Ecosystem,” a digest of highlights from October 2013 (never intended to be comprehensive; for completeness, see Hadoop Weekly). For generating sheer excitement, that month installed a high bar to meet in the future: Hadoop 2 Became Stable with the 2.2 (“GA”) ReleaseThe idea that this news could be done justice in a few sentences strains credulity. (Furthermore, it has been covered elsewhere widely and thoroughly at this point.) Suffice to say here that this release will transform the Big Data ecosystem ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Rob Weltman. There are a number of special “users” with roles to play in the Apache Hadoop environment. For your reference, we have summarized them below as of CDH 4.4. Kerberos principals (used for authentication in a secure cluster) are not covered here. The specific user IDs listed are the ones created by default on installation but they are configurable unless otherwise indicated. Project User Group Notes HDFS hdfs hdfs The NameNode and DataNodes run as this user, and the HDFS root directory as well as the directories used for edit logs should ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. In a fast-moving project like Apache Hadoop, there are always exciting new features introduced in each release. While it is tempting to make the most of these new features by upgrading to the latest release, users are often concerned about their code continuing to run. In this post, you’ll get an overview of the the Hadoop API annotations and compatibility policies. Hadoop annotates specific APIs to be safe for use by end-users. By using these APIs, users can ensure their code works across a set of releases and be aware of ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: karan-sachdeva; The latest executive report published by IBM Institute for Business Value puts the estimated cost of cyber crime to the global economy in a range of USD 375–575 billion per year. Reputational damage, which is hard to calculate, comes on top of all this. No industry and geography has remained untouched with recent spurt of cyber attacks. Most companies have cyber security systems in place with some Fortune 500 and government agencies having highly advanced sophisticated systems in place. The difficulty is, not many have constructed living, dynamic and vibrant ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. Below please find our regularly scheduled quarterly update about where to find tech talks by Cloudera employees this year – this time, for October through December 2013. Note that this list will be continually curated during the period; complete logistical information may not be available yet. As always, we’re standing by to assist your meetup by providing speakers, sponsorships, and schwag! Date City Venue Speaker(s) Oct. 1 Aarhus, Denmark GOTO Aarhus Eva Andreeason on Hadoop use cases Oct. 8 Sunnyvale, Calif. Hadoop Happy Hour Kathleen Ting and Jarek Cecho sign books! ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. Welcome to our third edition of “This Month in the Ecosystem,” a digest of highlights from September 2013 (never intended to be comprehensive; for completeness, see Hadoop Weekly). Note: there were a few other interesting developments this week, but out of respect for the calendar, I’ll address them next month. New Ecosystem Projects Joined the Apache IncubatorA trio of Hadoop-related projects were accepted into the Apache Incubator, including Storm (for real-time event processing – contributed by Nathan Marz and championed by Doug Cutting), Samza (for processing of data streamed from publish-subscribe ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. In this installment of “Meet the Project Founder,” we speak with Josh Wills (@josh_wills), Cloudera’s Senior Director of Data Science and founder of Apache Crunch and Cloudera ML. What led you to your project idea(s)?When I first started at Cloudera in 2011, I had a fairly vague job description, no real responsibilities, and wasn’t all that familiar with the Apache Hadoop stack, so I started working on various pet projects in order to learn more about the tools and the use cases in domains like healthcare and energy. My first project, ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. In December 2012, we described how an internal application built on CDH called Cloudera Support Interface (CSI), which drastically improves Cloudera’s ability to optimally support our customers, is a unique and instructive use case for Apache Hadoop. In this post, we’ll follow up by describing two new differentiating CSI capabilities that have made Cloudera Support yet more responsive for customers: How Cloudera Impala has turbo-charged CSI with support for real-time log file analysis and visualization How Cloudera Search enables interactive data exploration of multiple sources simultaneously from within CSI So, let’s ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: jessica-lee; Data is a potent business resource and the key to gaining and maintaining competitive advantage. Last month, IBM and Hortonworks announced a partnership to bring data science to the world on an open platform, offering Hortonworks Data Platform (HDP) along with IBM Data Science Experience (DSX) and IBM Big SQL to help everyone from data scientists to business leaders better analyze and manage their data and accelerate data-driven decision making. This collaboration marks the coming together of an industry leading 100% open source Hadoop distribution, an innovative data ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. Why would any company be interested in searching through its vast trove of email? A better question is: Why wouldn’t everybody be interested?  Email has become the most widespread method of communication we have, so there is much value to be extracted by making all emails searchable and readily available for further analysis. Some common use cases that involve email analysis are fraud detection, customer sentiment and churn, lawsuit prevention, and that’s just the tip of the iceberg. Each and every company can extract tremendous value based on its own business ... Read More