Tag: Data Lake

Feed: Planet big data. Author: Sandeep Raut. Today more than even, every business is focusing on collecting the data and applying analytics to be competitive. Big Data Analytics has passed the hype stage and has become the essential part of business plans. Data Lake is the latest buzzword for dumping every element of data you can find internally or externally. If you Google the term data lake, you will get more than 14 million results. With entry of Hadoop, everyone wants to dump their siloes of data warehouses, data marts and create data lake. The idea behind a data lake ... Read More

Feed: Microsoft Azure Blog. Author: Pranav Rastogi. We are pleased to announce the availability of Imanis Data on Azure. Azure HDInsight is the industry leading fully-managed cloud Apache Hadoop & Spark offering, which allows customers to run reliable open source analytics with an industry-leading SLA. Imanis Data provides data management software that allows users to migrate data and add backup and restore functionality for their big data applications. This combined offering of Imanis Data on HDInsight and integration with Azure Blob Storage and Data Lake Store enables customers to migrate to cloud faster, protect critical data assets from application or ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Syed Mahmood. Data science is inherently an exploratory and creative process because there is usually neither a definitive answer to the problem at hand nor a well-defined approach to reaching one. Data scientists research problems, explore data, visualize patterns across data and use their experience and judgment to choose parameters and processes that may be relevant to the specific problem at hand. This makes sharing and collaboration a critical activity that enables teams of data scientists to build on each other’s knowledge and to produce the overall best results. As data science has evolved ... Read More

Feed: Planet big data. Author: Julie Steele. August 17th, 2017 Editor’s note: Welcome to Throwback Thursdays! Every third Thursday of the month, we feature a classic post from the earlier days of our company, gently updated as appropriate. We still find them helpful, and we think you will, too! The original version of this post can be found here. Many enterprises are hoping to systematically drive competitive advantage and operational efficiency by gaining insight from data. For that reason, they may be contemplating — or already well into — a “data lake” effort. These are large, complex efforts, typically focussed ... Read More

Feed: AWS Big Data Blog. This is a guest post by Jeremy Winters and Ritu Mishra, Solution Architects at Full 360. In their own words, “Full 360 is a cloud first, cloud native integrator, and true believers in the cloud since inception in 2007, our focus has been on helping customers with their journey into the cloud. Our practice areas – Big Data and Warehousing, Application Modernization, and Cloud Ops/Strategy – represent deep, but focused expertise.”AWS Glue is a fully managed ETL (extract, transform, and load) service that makes it simple and cost-effective to categorize your data, clean it, enrich ... Read More

Feed: erwin Expert Blog – erwin, Inc.. Author: Kevin Schofield. There’s no escaping data’s role in the cloud, and so it’s crucial that we analyze the cloud’s impact on data modeling.  The fourth post in this series concluded with the observation that more and more managed data lakes are being implemented in the cloud. The second post in this series focused on the Internet of Things (IoT), the constellation of web-connected devices, vehicles, buildings and related sensors and software that are greatly facilitated by the cloud. But what exactly is “the cloud,” and what challenges and opportunities does it present ... Read More

Feed: Microsoft Azure Blog. Author: Corey Sanders. Most modern applications are built using events – whether it is reacting to changes coming from IoT devices, responding to user clicks on mobile apps, or initiating business processes from customer requests. With the growth of event-based programming, there is an increased focus on serverless platforms, like Azure Functions, a serverless compute engine, and Azure Logic Apps, a serverless workflow orchestration engine. Both services enable you to focus on your application without worrying about any infrastructure, provisioning, or scaling. Today, I am excited to announce that we are making event-based and serverless applications ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: vinay-shukla; On June 13th 2017, Hortonworks and IBM announced an extension of our partnership. A key part of this partnership is the collaboration on IBM Data Science Experience (DSX). This collaboration is win-win in that it brings a production-ready full-cycle data science experience to Hortonworks Data Platform (HDP) customers and provides DSX customers access to information stored within HDP data lakes with an enterprise-grade compute grid. For most businesses, data is a key competitive differentiator. Increasingly, data science is employed to fully leverage this data. Data science remains a ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Nadeem Asghar. Attunity is a long-time Hortonworks partner who provides data optimization and data integration software to help Hortonworks customers address exploding data growth, efficiently manage the performance of BI and data warehouse systems, and realize the tremendous economies of Apache Hadoop®. Attunity solutions are certified on HDF, HDP and are YARN Ready. Together, Hortonworks and Attunity are committed to advancing Hadoop through community-led innovation. This new solution is one more example of that. Attunity Compose for Hive By Jordan Martz, Director of Technology Solutions, Attunity Attunity Compose for Hive automates the data pipeline ... Read More

Feed: Microsoft Azure Blog. Author: Linda Wang. We are glad to announce that Azure Data Factory has added more new features in July, including: Preview for Data Management Gateway high availability and scalability Skipping or logging incompatible rows during copy for fault tolerance Service principal authentication support for Azure Data Lake Analytics We will go through each of these new features one by one in this blog post. Preview for Data Management Gateway high availability and scalability You can now associate multiple data management gateway nodes that are installed on different machines with a single logical gateway, so as to ... Read More