Category: Hortonworks

Feed: Hortonworks Blog – Hortonworks. Author: Bikas Saha. This is the third in a series of data engineering blogs that we plan to publish. The first blog outlined the data science and data engineering capabilities of Hortonworks Data Platform. Motivation Apache Spark is becoming the de-facto processing framework for all kinds of complex processing including ETL, LOB business data processing and machine learning. This is because of the simple and intuitive APIs for common data processing operations and deep integration with popular languages like Java, Scala, Python and R. Increasingly, it’s also being adopted for continuous processing scenarios using the ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Dinesh Chandrasekhar. We are excited to announce the General Availability of Hortonworks DataFlow (HDF) 3.3. Throughout 2018, the HDF releases have been focusing on making the platform more robust for taking on advanced streaming architectures. We brought about several innovations and key enhancements on the operational side as well as on the development side of the enterprise. We have made HDF a highly reliable platform for Kafka in keeping up with the latest release as well as making sure that it is tightly integrated with the rest of our platform for comprehensive security and ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Saumitra Buragohain. To make Big Data cloud-native, Hortonworks has unveiled the Open Hybrid Architecture Initiative. In our previous blogs, we have talked about the vision, key tenets/concepts, real-world use case, and the new storage environment of O3. We often get asked by our customers, partners, and analysts: “Hortonworks has been in the middle of the data revolution for years. How do you plan to bring the new Kubernetes cloud-native architecture to Big Data?” Why Cloud Native Computing Foundation We have collaborated with many of our customers in their container journey for many years now, leading ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Matt Spillar. It’s been an incredible year for Hortonworks, and it’s only been possible because of our customers! We’ve seen our customers accomplish remarkable achievements across every industry. Throughout the year, we’ve featured a number of these stories, including the challenges that were being faced and the results that were achieved. Here is a look back, at the top eleven customer blogs of 2018: 1. Hilton – Becoming more data centric to drive a better experience for its customers. The new framework has resulted in the ability to do inline pricing on the fly and ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: George Vetticaden. With Hortonworks DataFlow (HDF) 3.3 now supporting Kafka Streams, we are truly excited about the possibilities of the applications that you can benefit from when combined with the rest of our platform. In this post, we will demonstrate how Kafka Streams can be integrated with Schema Registry, Atlas and Ranger to build set of microservices apps for a fictitious use case.  Streaming Use Case for a Trucking Fleet Company For this sample application, a trucking fleet company has sensors outfitted on their fleet of trucks. The geo-event sensor captures important events from ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: George Vetticaden. In an earlier blog post, Democratizing Analytics within Kafka With 3 Powerful New Access Patterns in HDP and HDF, we discussed different access patterns that provides application developers and BI analysts powerful new tools to implement diverse use cases where Kafka is key component of their application architectures. In this blog, we will discuss in detail the streaming access pattern and the addition of Kafka Streams support in HDF 3.3 and the upcoming HDP 3.1 release. Before the addition of Kafka Streams support, HDP and HDF supported two stream processing engines:  Spark Structured ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Matt Spillar. With millions of consumers searching for the ideal hotel room around the world, Hotels.com was finding it difficult to cope with the vast amounts of data coming from its search engine marketing that could be used to enhance the customer journey. Hotels.com provides a service for reserving hotels, B&Bs and other types of commercial lodgings, helping millions of customers around the globe. It offers 90 localized websites in 41 languages and hundreds of thousands of places to stay in more than 200 countries and territories. The company became a part of Expedia, ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Diana Yanez-Pastor. At Hortonworks, we are excited to launch the Data Hero Call for Nominations which are now open for Dataworks Summit Barcelona, Spain and Washington, DC. We want to hear from you our customers and learn how they drive  leadership in the industry and across the marketplace. Nominations for Barcelona are open through February 1, 2019 and for DC through April 1, 2019. Data Heroes design modern data architectures that make it all work in the cloud, the data center and out to the edge.  They are innovative and leading the way managing, analyzing and ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Jon Dybik. There are three common abilities across the cloud providers that I want to focus on and to see how they work together and build on each other to help you maximize agility and data insights in the cloud. They are: cloud storage, running workloads on demand, and elastic resource management. In addition, we’ll talk about how you can pull this all together with Hortonworks Cloudbreak on a path towards big data insights in the cloud. Let’s start with cloud storage. Cloud storage is key and lays the foundation to take full advantage ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Saumitra Buragohain. Introducing our Storage Environment O3 Building on the last three blogs (vision, key tenets/concepts, real-world use case) in the Open Hybrid Architecture series, we now want to take a deeper dive into our Storage Environment, especially O3 (the molecular formula for Ozone). First, we want to look back at the annals of history of Hadoop. Apache Hadoop File System (HDFS) started with 5000 lines of code in 2006. This is the first software defined storage adopted by enterprises, that now stores hundreds of exabytes of big data on commodity hardware to power ... Read More