Tag: HBase

Feed: All - O'Reilly Media. Author: James Furbush. Metal tubes (source: BrooklynJohn via Pixabay) Attend the Strata Data Conference to learn the skills and technologies of data engineering. As the the data space has matured, data engineering has emerged as a separate and related role that works in concert with data scientists. Ian Buss, principal solutions architect at Cloudera, notes that data scientists focus on finding new insights from a data set, while data engineers are concerned with the production readiness of that data and all that comes with it: formats, scaling, resilience, security, and more. Ryan Blue, a senior ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Igor Bobriakov. Apache Spark is a powerful open-source processing engine built around speed, ease of use, and sophisticated analytics. It has originally been developed at UC Berkeley in 2009, while Databricks was founded later by the creators of Spark in 2013. The Spark engine runs in a variety of environments, from cloud services to Hadoop or Mesos clusters. It is used to perform ETL, interactive queries (SQL), advanced analytics (e.g., machine learning) and streaming over large datasets in a wide range of data stores (e.g., HDFS, Cassandra, HBase, S3). Spark supports ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Saumitra Buragohain. We’re excited to announce the long-awaited release of Hortonworks Data Platform 3.0.0. HDP 3.0 is faster, smarter, hybrid, bigger, trusted and real-time database. We encourage you to read our blog that announced HDP 3.0. You can also view our keynote presentation from DataWorks Summit, where we demoed an autonomous car (1/10 scale), trained with HDP 3.0 technologies. We also want to thank  our current and prospective customers and partners for signing up for the HDP 3.0 Early Access and we are encouraged by the huge interest- now, you can use the HDP ... Read More

Feed: What's New. You can now use Hue 4.2.0 and Apache Oozie 5.0.0 on Amazon EMR release 5.15.0. Hue 4.2.0 adds several new features and updates, including an SQL syntax checker, an improved search UX with the ability to search through tables, columns, and saved queries, and several other UX improvements. Oozie 5.0.0 features an improved DAG visualization of workflows, integration with YARN Application Master to submit and manage jobs, and other performance improvements. Additionally, you can now use the upgraded version of Apache Hive (2.3.3), Apache HBase (1.4.4), and Apache ZooKeeper (3.4.12). These releases contain various bug fixes and ... Read More

Feed: Cloudera Manager – Cloudera Engineering Blog. Author: Justin Kestelyn. Unique across all options, Cloudera Manager makes it easy to do what would otherwise be a disruptive operation for operators and users. For the increasing number of customers that rely on enterprise data hubs (EDHs) for business-critical applications, it is imperative to minimize or eliminate downtime — thus, Cloudera has focused intently on making software upgrades a routine, non-disruptive operation for EDH administrators and users. With Cloudera Manager 4.6 and later, it is extremely easy to do minor version upgrades (from CDH 4.3 to CDH 4.6) with zero downtime, and ... Read More

Feed: Cloudera Manager – Cloudera Engineering Blog. Author: Justin Kestelyn. Thanks to Jonathan Natkins of WibiData for the post below about how his company extended Cloudera Manager to manage Kiji. Learn more about Kiji and the organizations using it to build real-time HBase applications at Kiji Sessions, happening on May 6, 2014, the day after HBaseCon. As a partner of Cloudera, WibiData sees Cloudera Manager’s new extensibility framework as one of the most exciting parts of Cloudera Enterprise 5. Cloudera Manager 5.0.0 provides the single-pane view that Apache Hadoop administrators and operators want to effectively manage a cluster of machines ... Read More

Feed: Microsoft Azure Blog. Author: Maxim Lukiyanov. Apache Spark 2.3.0 is now available for production use on the managed big data service Azure HDInsight. Ranging from bug fixes (more than 1400 tickets were fixed in this release) to new experimental features, Apache Spark 2.3.0 brings advancements and polish to all areas of its unified data platform. Data engineers relying on Python UDFs get 10 times to a 100 times more speed, thanks to revamped object serialization between Spark runtime and Python. Data Scientist will be delighted by better integration of Deep Learning frameworks like TensorFlow with Spark Machine Learning pipelines ... Read More

Feed: Cloudera Manager – Cloudera Engineering Blog. Author: Justin Kestelyn. Cloudera Manager 4.7 added support for managing Cloudera Search 1.. Thus Cloudera Manager users can easily deploy all components of Cloudera Search (including Apache Solr) and manage all related services, just like every other service included in CDH (Cloudera’s distribution of Apache Hadoop and related projects). In this how-to, you will learn the steps involved in adding Cloudera Search to a Cloudera Enterprise (CDH + Cloudera Manager) cluster. Installing the SOLR Parcel In our example, the cluster uses a CDH 4.4 parcel and is running Apache ZooKeeper, HDFS, and Apache ... Read More

Feed: Cloudera Manager – Cloudera Engineering Blog. Author: Justin Kestelyn. Cloudera Manager 4.7 is an update to Cloudera Manager 4 and contains a number of bug fixes and usability improvements. Furthermore, we have introduced new features such as: Support for Sentry (Impala and Hive Authorization) with CDH 4.3.0 or later New Home page to offer a clusterwide status of all issues Support for HBase Indexer for Cloudera Search New Parcel usage page to give a more granular view into parcel usage across the cluster More granular controls around alerting for various health states Improved user experience for Events and Audits ... Read More

Feed: Cloudera Manager – Cloudera Engineering Blog. Author: Bala Venkatrao. It has been a while since I have blogged, primarily because we have been heads-down working toward the Cloudera Manager 4.5 release that we announced yesterday! Cloudera Manager has seen a rapid adoption among enterprise customers and as more clusters are deployed into production environments, the more feature requests we get from them. We have heard our customers and the Cloudera Manager 4.5 release aims to address many of these requests. Kudos to the engineering team for another feature-packed release. Some key features of CM4.5 release are as follows: Rolling ... Read More