Tag: data warehouse

Feed: Cloudera Engineering Blog » Hadoop. Author: John Kreisa. This post was contributed by Jonathan Seidman from Orbitz. Jonathan is a Lead Engineer on the Intelligent Marketplace/Machine Learning team at Orbitz Worldwide . You can hear more from Jonathan at Hadoop World October 12th in NYC. Orbitz Worldwide (NYSE:OWW) is composed of a global portfolio of online consumer travel brands including Orbitz, Cheaptickets, The Away Network, ebookers and HotelClub, Additionally, the company operates business-to-business service: Orbitz Worldwide Distribution provides third parties such as Amtrak, Delta, LAN, KLM, Air France and a number of other leading airlines hotel booking capabilities, and Orbitz for ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Aaron Kimball. Cloudera customers usually have two major sources of data: log files, which can be imported to Hadoop via Flume, and relational databases. Throughout the previous releases of CDH2 and CDH3, Cloudera has included a package we’ve developed called Sqoop. Sqoop can perform batch imports and exports between relational databases and Hadoop, storing data in HDFS and creating Hive tables to hold results. We described its motivation and some use cases in a previous blog post a while ago. In CDH3b2, we’ve included a greatly-expanded version of Sqoop which has had a ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Jeff Bean. Just today we heard another question about integrating Apache Hadoop with Business Intelligence tools. This is one of the most common questions we receive from enterprises adopting or evaluating Hadoop. In the early stages of their projects, customers are generally not sure how to connect their BI tools to Hadoop, and when it makes sense to do so. As I wrote in BI Considerations and Hadoop Part 1, Cloudera encourages you to use your existing infrastructure wherever possible, and this includes your investments in Business Intelligence. BI tools traditionally were designed ... Read More

Feed: Alation. Author: Stephanie McReynolds. As big data matures, the way you think about it may have to shift also. It’s no longer enough to build the data warehouse. Dave Wells, analyst with the Eckerson Group suggests that realizing the promise of the data warehouse requires a paradigm shift in the way we think about data along with a change in how we access and use it. Self-service analytics environments are giving rise to the data marketplace. Unlike the data warehouses of the past, an enterprise data marketplace (EDM) doesn’t just store, process, or manage information by IT. Instead it ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Christophe Bisciglia. It’s been a crazy few weeks here at Cloudera, and while there is no sign of things letting up before Hadoop World: NYC 2009 on October 2nd, we wanted to take a minute to share the latest details about the speakers, and to say thanks to our sponsors who have recently come on board. We’re absolutely thrilled to have such a wide variety of organizations sharing their experiences with Apache Hadoop. In addition to a deeply technical track headlined by Cloudera, Yahoo! and Facebook, those new to Hadoop will appreciate an ... Read More

Feed: AWS Big Data Blog. Amazon Redshift Spectrum enables you to run Amazon Redshift SQL queries against data that is stored in Amazon S3. With Amazon Redshift Spectrum, you can extend the analytic power of Amazon Redshift beyond the data that is stored on local disks in your data warehouse. You can query vast amounts of data in your Amazon S3 “data lake” without having to go through a tedious and time-consuming extract, transfer, and load (ETL) process. Amazon Redshift Spectrum applies sophisticated query optimization and scales processing across thousands of nodes to deliver fast performance.In this blog post, we have ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Aaron Kimball. In addition to providing you with a dependable release of Hadoop that is easy to configure, at Cloudera we also focus on developing tools to extend Hadoop’s usability, and make Hadoop a more central component of your data infrastructure. In this vein, we’re proud to announce the availability of Sqoop, a tool designed to easily import information from SQL databases into your Hadoop cluster. Sqoop (“SQL-to-Hadoop”) is a straightforward command-line tool with the following capabilities: Imports individual tables or entire databases to files in HDFS Generates Java classes to allow you ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Christophe Bisciglia. There’s been a lot of buzz about Apache Hadoop lately. Just the other day, some of our friends at Yahoo! reclaimed the terasort record from Google using Hadoop, and the folks at Facebook let on that they ingest 15 terabytes a day into their 2.5 petabyte Hadoop-powered data warehouse. But many people still find themselves wondering just how all this works, and what it means to them. We get a lot of common questions while working with customers, speaking at conferences, and teaching new users about Hadoop. If you, or folks ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Amr Awadallah. (guest blog post by Matei Zaharia) As Hadoop clusters grow in size and data volume, it becomes more and more useful to share them between multiple users and to isolate these users. If User 1 is running a ten-hour machine learning job for example, this should not impair a User 2 from running a 2-minute Hive query. In November, I blogged about how Hadoop 0.19 supports pluggable job schedulers, and how we worked with Facebook to implement a Fair Scheduler for Hadoop using this new functionality. The Fair Scheduler gives each ... Read More

Feed: AllegroGraph - THE Semantic Graph Database. Author: cnorvell. In this issue Free Webcast: The Power of Machine Learning and Graphs - March 1, 2017 allegRo - The R Project API for AllegroGraph AllegroGraph Version 6.1.5 Now Available Smart Data Conference - Tutorial: Build Your Own Cognitive Computing Platform, January 30 Smart Data Conference - Presentation: Cognitive Probability Graphs for Smart Knowledge Management, January 31 Enterprise Data World Presentation: Developing an Advanced Analytics Capability on an Enterprise Data Lake, April 4 TechCrunch article - Putting data back into the hands of owners Linkurious Adds Support for AllegroGraph Gruff version 6.4 ... Read More