Tag: Spark

Feed: Microsoft Azure Blog. Author: Chandrika Shankarnarayan. Today we’re pleased to announce two key capabilities that Azure Time Series Insights will be delivering later this year: A cost-effective long-term storage that enables a cloud-based solution to trend years’ worth of time series data pivoted on devices/tags.  A device-based (also known industry-wide as “tag-based”) user experience backed by a time series model to contextualize raw time series data with device metadata and domain hierarchies. Additionally, Time Series Insights will be integrating with advanced machine learning and analytics tools like Spark and Jupyter notebooks to help customers tackle time series data challenges ... Read More

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. At Amazon, our culture of innovation runs deep. It’s always Day 1, which means we are constantly looking around corners for the next big idea to help us innovate on behalf of our customers. From adding new capabilities, such as voice donations with Alexa, to developing over 1,400 new AWS services last year, our commitment to delivering the highest value to our customers is largely driven by our ability to think big.As we celebrate World Creativity and Innovation Day, we are reminded of the powerful alliance between creativity and innovation, and ... Read More

Feed: AWS Big Data Blog. AWS Glue is an increasingly popular way to develop serverless ETL (extract, transform, and load) applications for big data and data lake workloads. Organizations that transform their ETL applications to cloud-based, serverless ETL architectures need a seamless, end-to-end continuous integration and continuous delivery (CI/CD) pipeline: from source code, to build, to deployment, to product delivery. Having a good CI/CD pipeline can help your organization discover bugs before they reach production and deliver updates more frequently. It can also help developers write quality code and automate the ETL job release management process, mitigate risk, and more.AWS ... Read More

Feed: All - O'Reilly Media. Author: Holden Karau, Alena Hall. Light painting (source: Paul Carmona on Unsplash) Check out the Evolutionary Architecture sessions at OSCON, July 16-19, 2018, in Portland. Hurry—best price ends April 20. Do you want to try out a new version of Apache Spark without waiting around for the entire release process? Does running alpha-quality software sound like fun? Does setting up a test cluster sound like work? This is the blog post for you, my friend! We will help you deploy code that hasn't even been reviewed yet (if that is the adventure you seek). If ... Read More

Feed: AWS Big Data Blog. AWS Glue provides enhanced support for working with datasets that are organized into Hive-style partitions. AWS Glue crawlers automatically identify partitions in your Amazon S3 data. The AWS Glue ETL (extract, transform, and load) library natively supports partitions when you work with DynamicFrames. DynamicFrames represent a distributed collection of data without requiring you to specify a schema. You can now push down predicates when creating DynamicFrames to filter out partitions and avoid costly calls to S3. We have also added support for writing DynamicFrames directly into partitioned directories without converting them to Apache Spark DataFrames.Partitioning ... Read More

Feed: R-bloggers. Author: John Mount. I have a couple of public appearances coming up soon. The East Bay R Language Beginners Group: Preparing Datasets – The Ugly Truth & Some Solutions, Tuesday, May 1, 2018 at Robert Half Technologies, 1999 Harrison Street, Oakland, CA, 94612. Official May 2018 BARUG Meeting: rquery: a Query Generator for Working With SQL Data, Tuesday, May 8, 2018 at Intuit, Building 202600 Marine Way · Mountain View, CA. vtreat Preparing Datasets – The Ugly Truth & Some Solutions is a great idea of Jim Porzak’s. Jim will speak on problems one is likely to encounter ... Read More

Feed: SAS Blogs. Author: Thomas Keil. Zur Person: Dr. Volker Stümpflen verantwortet als Leiter Data Strategy & Operations bei der Mediengruppe RTL vor allem den Auf- und Ausbau der Data-Science-Aktivitäten sowie die Realisierung und Monetarisierung speziell analysierter Datenmodelle mit Fokus auf Nutzerverhalten und Nutzerbedürfnisse. Er verfügt über große Erfahrungen mit der Vernetzung großer Datenbanksysteme und Applikationen, basierend auf seiner früheren Tätigkeit als Director Data Science mit Schwerpunkt datengetriebenes Risikomanagement im Finanzanlagebereich. Zu seinen weiteren Stationen gehörte die langjährige Leitung der Gruppe Biologische Informationssysteme am Helmholtz-Zentrum in München mit Schwerpunkt auf semantischen Big-Data-Systemen in der Biomedizin. Zudem war er Gründer und ... Read More

Feed: Microsoft Azure Blog. Author: Christine Alford. Kentico on Windows Server 2012 R2: Kentico CMS is a free edition web content management system for building websites, online stores, intranets, and community sites. Create, manage, and integrate communities socially to encourage conversations about your brand. OpenText Process Suite 16.3 Marketplace Info VM: With intelligently automated, content-rich processes that you can quickly build and easily modify, Process Suite gives you the power to deliver a variety of new digital experiences with a much lower IT workload. Content Suite 16 (January 2018): OpenText Content Suite Platform is a comprehensive enterprise content management (ECM) ... Read More

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. The Urban Institute is a Washington, D.C.-based policy research organization dedicated to developing evidence-based insights that improve decision making, strengthen communities, and make people’s lives better.As a leader in data-driven policy research, the Urban Institute was looking for a solution that would enable it to run sophisticated data analytics and microsimulation models with flexibility, speed, and accuracy. The organization was running complex, data-driven microsimulations developed over years, and wanted to evolve its processing platform while retaining select legacy code. They also hoped to improve information sharing, lower costs for storage and ... Read More

Feed: R-bloggers. Author: Robert. I am going to be giving this course on 10 August and 6 December this year. It is organised by Timberlake Consultants, the distributors of Stata for UK and Ireland, and will take place at Cass Business School’s excellent facilities in the City of London. I am excited to offer this new course because I think there is a real gap in the market here. Lots of people want to tap into both Stata as a commercial package with a lot of well-constructed and thoroughly tested tools for analysis and graphics, as well as R as ... Read More