Tag: Data Lake

Feed: Microsoft Azure Blog. Author: Josh Caplan. Members from the Azure Analysis Services team will be presenting two sessions at this years PASS Summit 2017 in Seattle, WA. Members will also be available in the SQL Clinic to directly answer your Analysis Services questions in a one-on-one setting. Sessions include the following: Creating Enterprise Grade BI Models with Azure Analysis Services or SQL Server Analysis Services Speakers: Bret Grinslade and Christian Wade Level: 400 Microsoft Azure Analysis Services and SQL Server Analysis Services enable you to build comprehensive, enterprise-scale analytic solutions that deliver actionable insights through familiar data visualization tools ... Read More

Feed: All - O'Reilly Media. Author: Greg Rahn. Clouds (source: Pexels) Check out Greg Rahn’s session, “Rethinking data marts in the cloud: Common architectural patterns for analytics” at the Strata Data Conference in Singapore, December 4-7, 2017, to learn how to architect analytic workloads in the cloud and the core elements of data governance. Early price ends October 20. Many of us are all too familiar with the traditional way enterprises operate when it comes to on-premises data warehousing and data marts: the enterprise data warehouse (EDW) is often the center of the universe. Frequently, the EDW is treated a ... Read More

Feed: All - O'Reilly Media. Author: Aditya Parameswaran. Gears (source: Pixabay) Check out “How Pirelli built a data science team from scratch,” a case study available on Safari, to learn more about how data science can enable business transformation. As practitioners who build data science tools, we seem to have a rather myopic obsession with the challenges faced by the Googles, Amazons, and Facebooks of the world—companies with massive and mature data analytics ecosystems, supported by experienced systems engineers, and used by data scientists who are capable programmers. However, these companies represent a tiny fraction of the “big data” universe ... Read More

Feed: Microsoft Azure Blog. Author: Jenny Jiang. If you are a data scientist looking for a lightweight code editor for U-SQL, try ADL Tools for VSCode for rapid development. If you are a developer looking for a modern, simple U-SQL development tool, try ADL Tools for VSCode. If you prefer to use Mac or Linux for your development, install ADL Tools for VSCode and get started with U-SQL development. U-SQL is a programming framework built for scaling out big data queries and running them in a serverless cloud environment. In addition to being able to run SQL-like queries directly, the ... Read More

Feed: James Serra's Blog. Author: James Serra. There were so many good presentations at Microsoft Ignite, all of which can be viewed on-demand.  I wanted to list the big data related presentations that I found the most useful.  It’s a lot of stuff to watch and with our busy schedules can be quite challenging to view them all.  What I do is set aside 40 minutes every day to watch half a session (they are 75 minutes).  If may take a few weeks, but if you consistently watch you will be rewarded by a much better understanding of all the ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Bill Schmarzo. This blog is written in collaboration with the witting and insightful Matt Maccaux and his leading edge work around our elastic data platform and data lake.“Our organization is abuzz with the concept of data lakes!” a customer recently told me. And rightfully so, as the data lake holds the potential to help organizations become more effective at leveraging data and analytics to power their business models. That’s exactly what we propose when we talk about the Big Data Business Model Maturity Index, and helping organizations to exploit the power ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: rob-utzschneider; Apache Hadoop infrastructure offers tremendous potential for modernizing the enterprise analytics architecture. In fact, one of the biggest use cases for Hadoop is to optimize the enterprise data warehouse (EDW) architecture, which is part of the enterprise analytics architecture. EDW optimization can involve a number of activities, including offloading both ETL workloads and unused data from the EDW to Hadoop. It can also help enrich EDW analytics and reporting by adding new sources of structured and unstructured data that get stored, processed and analyzed in a low-cost Hadoop ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Guest Author. Guest author Nagapriya Tiruthani, Offering Manager, IBM Big SQL, IBM Why Big SQL? Enterprise Data Warehousing (EDW) emerged as a logical home for all enterprise data that captures the essence of all enterprise systems. But in recent years, there’s been an explosion of data being captured from social media, sensors, etc. This rapid growth has put tremendous pressure on traditional systems as they run of space quickly.   Due to this new age data explosion, businesses are challenged to handle this rapid growth effectively and efficiently without relinquishing the ability of deriving existing insights, ... Read More

Feed: All - O'Reilly Media. Author: Jeff Bleiel. Vortex (source: Pixabay) Register for the webcast "How to make your data lake more effective with an operational data hub," presented by Damon Feldman on November 2, 2017. In this podcast episode, O’Reilly’s Shannon Cutt talks with Damon Feldman, solutions director at MarkLogic, a company that has developed an operational and transactional NoSQL database that integrates data silos to give customers a single view of their data. They discuss data lakes, data hubs, integrating data in a lake format, data governance related to security, and more. Here are some highlights from the ... Read More

Feed: R-bloggers. Author: David Smith. The Azure Data Lake store is an Apache Hadoop file system compatible with HDFS, hosted and managed in the Azure Cloud. You can store and access the data within directly via the API, by connecting the filesystem directly to Azure HDInsight services, or via HDFS-compatible open-source applications. And for data science applications, you can also access the data directly from R, as this tutorial explains.  To interface with Azure Data Lake, you'll use U-SQL, a SQL-like language extensible using C#. The R Extensions for U-SQL allow you to reference an R script from a U-SQL statement, and pass ... Read More