Category: Hortonworks

Feed: Hortonworks Blog – Hortonworks. Author: Saumitra Buragohain. What is a Data Science and Engineering Platform Apache Spark is one of our most popular workloads- both on-premises and cloud. As we recently announced HDP 3.0.0  (followed by a hardened HDP 3.0.1), we want to introduce the Data Science and Engineering Platform powered by Apache Spark. As noted in the marketecture above, our Data Science & Engineering Platform is powered by Apache Spark with Apache Zeppelin notebooks to enable Batch, Machine Learning, and Streaming use cases, by personas such as Data Engineers, Data Scientists and Business Analysts. We recently introduced Apache ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Arpit Agarwal. 1. Introduction Apache Hadoop Ozone is a distributed key-value store that can efficiently manage both small and large files alike. Ozone is designed to work well with the existing Apache Hadoop ecosystem and also fill the need for a new open-source object store that is designed for ease of operational use and scale to thousands of nodes and billions of objects in a single cluster. Earlier articles Introducing Ozone and Ozone Overview introduced the Ozone design philosophy and key concepts. This developer-oriented article dives deeper into the system architecture. We examine the ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Matt Spillar. Next week is DataWorks Summit Tokyo (October 16th)! We have a number of impressive speakers lined up for keynote and breakout presentations, including Javier Nieto Centeno from Santander Bank. Santander Bank offers an array of financial services and products including retail banking, mortgages, corporate banking, cash management, credit card, capital markets, trust and wealth management, and insurance. It has about 650 retail banking offices, over 2,000 ATMs, and employs approximately 9,800 people. Javier will be speaking about how Banco Santander has established a Big Data architecture that provides the solutions that the ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Michael Lin. According to a recent IDC survey, organizations are migrating 50% of their public cloud applications and data to either on-premises or private cloud environments in the next 2 years due to security concerns. However, some say the move to the cloud is inevitable: LogicMonitor indicates that 83% of enterprise workloads will be in the cloud by 2020, and Ovum predicts that 50% of new big data workloads will be deployed in the cloud. These incompatible viewpoints boil down to a “he said, she said” take on what the future may hold, and ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Dinesh Chandrasekhar. While some of the Hortonworks engineers are busy adding more enterprise features to Apache Kafka or are creating new innovations to make your life more easy with Kafka, I thought of updating you with a couple of upcoming (Kafka related) events that we don’t want you to miss. Before I give you the scoop on that, let us make sure that you have checked out these blog posts that we had recently published about our new innovation – Hortonworks Streams Messaging Manager (SMM), which has been curing Kafka Blindness of many enterprises ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Arpit Agarwal. 1. Introduction The Apache Hadoop Distributed File System (HDFS) has been the de facto file system for big data. It is easy to forget just how scalable and robust HDFS is in the real world. Our customers run clusters with thousands of nodes; these clusters store over 100 petabytes of data serving thousands of concurrent clients. True to its big data roots, HDFS works best when most of the files are large – tens to hundreds of MBs. HDFS suffers from the famous small files limitation and struggles with over 400 Million ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Rob Bearden. Today we made a very exciting announcement about the future of Hortonworks – we announced that we have agreed to combine with Cloudera in a merger of equals. Together, Hortonworks and Cloudera will create the industry’s first enterprise data cloud for enabling actionable insights from the Edge to AI. This exciting combination will expand our customer reach and opportunity, as we accelerate innovation for IoT, streaming, hybrid cloud, data management, data warehousing and machine learning/AI. We are witnessing the biggest business model transformation since the Industrial Revolution. The modern data architecture grows ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Matt Spillar. Yesterday was Customer Experience Day, a day where we had the opportunity to celebrate the people and companies that make great customer experiences happen and recognize great customer work! As part of this celebration, we had a customer webinar with Johns Hopkins University. Johns Hopkins University is an American private research university, founded in 1876 and located in Baltimore, Maryland. It is considered the first research university in the United States, and is organized into 10 divisions on campuses in Maryland and Washington, D.C. These divisions include the Johns Hopkins School of ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Matt Spillar. Today we’re celebrating Customer Experience Day! This is a day to celebrate the people and companies that make great customer experiences happen and to recognize great customer work. We have over 1,400 different customers across every industry, all with unique stories to tell, solving difficult business challenges. Not only are they putting these technological solutions in place to solve these mission critical challenges, our customers are achieving tremendous business value ranging from reduced costs, deeper insights, faster time to market, and increased revenue. Here are some of the many customer wins we ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Nishant Bangarwa. Earlier we talked about reasons for integrating Druid and Hive in a THREE-PART SERIES (Part 1, Part 2 ,  Part 3) OF DOING ULTRA FAST OLAP ANALYTICS WITH APACHE HIVE AND DRUID. Since then we have spent even more of our time and efforts on — bug fixes, correctness, performance and supporting new features. Today, We are excited to share an update on our performance benchmark blog and compare the performance numbers of running 1 TB OLAP benchmark at 1 TB Scale for HDP 2.6 vs HDP 3.0. The benchmark results show ... Read More