Tag: Apache

Feed: Cloudera Engineering Blog » Hadoop. Author: Aaron Kimball. In addition to providing you with a dependable release of Hadoop that is easy to configure, at Cloudera we also focus on developing tools to extend Hadoop’s usability, and make Hadoop a more central component of your data infrastructure. In this vein, we’re proud to announce the availability of Sqoop, a tool designed to easily import information from SQL databases into your Hadoop cluster. Sqoop (“SQL-to-Hadoop”) is a straightforward command-line tool with the following capabilities: Imports individual tables or entire databases to files in HDFS Generates Java classes to allow you ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Christophe Bisciglia. As Apache Hadoop continues to turn heads at startups and big enterprises alike, Cloudera has received several requests to offer certification in addition to our popular training programs. Certification is a critical component of any software ecosystem, and especially so for open source projects with quickly expanding user bases. Certification allows developers to ensure their skills are up to date, and allows employers and customers to confidently identify individuals that are up for the challenge of solving problems with Hadoop. To that end, we are happy to announce Cloudera Certification for Hadoop. Starting ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Christophe Bisciglia. There’s been a lot of buzz about Apache Hadoop lately. Just the other day, some of our friends at Yahoo! reclaimed the terasort record from Google using Hadoop, and the folks at Facebook let on that they ingest 15 terabytes a day into their 2.5 petabyte Hadoop-powered data warehouse. But many people still find themselves wondering just how all this works, and what it means to them. We get a lot of common questions while working with customers, speaking at conferences, and teaching new users about Hadoop. If you, or folks ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Todd Lipcon. When we announced Cloudera’s Distribution for Apache Hadoop last month, we asked the community to give us feedback on what features they liked best and what new development was most important to them. Almost immediately, Debian and Ubuntu packages for Hadoop emerged as the most popular request. A lot of customers prefer Debian derivatives over Red Hat, and installing RPMs on top of Debian, while possible with tools like alien, is a pain to say the least. After some weeks of development and testing, we are happy to announce the Cloudera ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Christophe Bisciglia. Welcome to the first guest post on the Cloudera blog. The other day, we saw Toby from Swingly tweeting about using Apache Hadoop to process millions of other tweeters’ tweets. We were curious, and Toby put together a great writeup about how they use Hadoop to crunch data. We have a few other guest posts in the pipeline, but if you are doing something really fun with Hadoop and want to share, we’d love to hear from you. Get in touch! -Christophe How can you run hundreds of memory intensive annotation tasks ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Alex Loddengaard. A few weeks ago we announced Cloudera’s Distribution for Apache Hadoop, and I want to spend some time showing how our distribution makes a sysadmin’s job a little easier. Perhaps the most useful features in our distribution, at least for sysadmins, are RPM packages and init scripts.  RPMs are the standard way of installing software on a Red Hat Linux distribution (RHEL, Fedora Core, CentOS).  They give sysadmins a one-command install, and they install libraries, binaries, init scripts, log files, man pages, and configuration files in places where Linux users expect ... Read More

Feed: IBM Big Data & Analytics Hub - All Content. Author: cindy-russell. It seems that we’re reaching the point where the Internet of Things (IoT) is moving from the domain of enthusiastic early-adopters to the more challenging, more profitable territory of mainstream enterprise technology.In particular, companies in industries that depend on the attention and loyalty of large numbers of consumers – retail and air travel, for example –have already woken up to the possibilities. If you can recognize an individual customer’s mobile device as they move through an airport or walk past your store, you can potentially take action to improve that ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Tom Hastain. DNV GL has an impressive 153 years of history, dating back to 1864 when the company inspected and evaluated Norwegian merchant vessels. Fast-forward to today, DNV GL now operates in over 100 countries and provides services for several industries including maritime, renewable energy, oil & gas, electrification, food & beverage, and healthcare. According to Rene Castberg, Senior Research at DNV GL, “Data has always been important for our company in DNV GL, [it’s] something we’ve relied on, so from the earliest beginning…nowadays we are moving over to newer technology, [such as] digital ... Read More

Feed: AWS Compute Blog. Author: Juan Villa. Juan Villa – Partner Solutions Architect When most people hear “Java” they think of Java the programming language. Java is a lot more than a programming language, it also implies a larger ecosystem including the Java Virtual Machine (JVM). Java, the programming language, is just one of the many languages that can be compiled to run on the JVM. Some of the most popular JVM languages, other than Java, are Clojure, Groovy, Scala, Kotlin, JRuby, and Jython (see this link for a list of more JVM languages). Did you know that you can ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Aaron Kimball. Configuring a Hadoop cluster is something akin to voodoo. There are a large number of variables in hadoop-default.xml that you can override in hadoop-site.xml. Some specify file paths on your system, but others adjust levers and knobs deep inside Hadoop’s guts. Unfortuately, there’s little or no documentation on how to set them well. Is there a single optimal configuration? Are there some settings that can just be “set to 11?” At Cloudera, we’re working hard to make Hadoop easier to use and to make configuration less painful. Our Hadoop Configuration Tool ... Read More