Tag: SQL

Feed: Cloud Data Integration Software | Matillion. Author: Laura Malins, Solution Architect; Laura Malins, Solution ArchitectIn this blog, we will show you how to use grid variable to apply business rules in a Transformation job within Matillion ETL. It is often the case that business rules are hard-coded into an ETL meaning any change to the business rules requires an ETL developer to update the logic. Here we look at an alternative approach.Using Grid Variables Apply Business Rules with Matillion ETLIn this example we look at product transactions where the product code and region it is sold will affect the amount ... Read More

Feed: R-bloggers. Author: rOpenSci - open tools for open science. pubchunks is a package grown out of the fulltext package. fulltextprovides a single interface to many sources of full text scholarly articles. Aspart of the user flow in fulltext there is an extraction step where fulltext::chunks()pulls parts of articles out of XML format article files. As part of making fulltext more maintainable and focused on simply fetching articles,and realizing that pulling out bits of structured XML files is a more general problem,we broke out pubchunks into a separate package. fulltext::ft_chunks() andfulltext::ft_tabularize() will eventually be removed and we’ll point users topubchunks ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: paul-rivot; The Hadoop landscape looks a little different after Cloudera and Hortonworks’ recent announcement of a $5.2 billion merger.According to the Hortonworks press release, “the combination establishes the industry standard for hybrid cloud data management, accelerating customer adoption, community development and partner engagement.” News outlets are already buzzing about the possibilities as seen in this CNBC video.  As with all mergers, it will take time. The merger’s completion is slated for the first quarter of 2019 and, in the interim, the companies will continue to operate as two separate ... Read More

Feed: What's New. By using external trust, only users from the domains you specify may use their existing AD credentials to access applications such as Amazon RDS for SQL Server, Amazon WorkSpaces, and other AD-aware applications that are using AWS Managed Microsoft AD. This also limits read access in your existing Microsoft AD by AWS Managed Microsoft AD when you implement two-way trusts or trusts from your existing Microsoft AD to AWS Managed Microsoft AD ... Read More

Feed: What's New. Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run. Athena uses the Glue Data Catalog, a managed repository, integrated with Amazon EMR, Amazon Athena, Amazon Redshift Spectrum, and AWS Glue ETL, to store metadata information, and automate schema discovery and schema version history. With the recent release of resource-based policies and resource-level permissions for the AWS Glue Data Catalog, you can restrict or allow Athena access ... Read More

Feed: R-bloggers. Author: Dr. Shirin Glander. During my stay in London for the m3 conference, I also gave a talk at the R-Ladies London Meetup on Tuesday, October 16th, about one of my favorite topics: Interpretable Deep Learning with R, Keras and LIME. Keras is a high-level open-source deep learning framework that by default works on top of TensorFlow. Keras is minimalistic, efficient and highly flexible because it works with a modular layer system to define, compile and fit neural networks. It has been written in Python but can also be used from within R. Because the underlying backend can ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Saumitra Buragohain. What is a Data Science and Engineering Platform Apache Spark is one of our most popular workloads- both on-premises and cloud. As we recently announced HDP 3.0.0  (followed by a hardened HDP 3.0.1), we want to introduce the Data Science and Engineering Platform powered by Apache Spark. As noted in the marketecture above, our Data Science & Engineering Platform is powered by Apache Spark with Apache Zeppelin notebooks to enable Batch, Machine Learning, and Streaming use cases, by personas such as Data Engineers, Data Scientists and Business Analysts. We recently introduced Apache ... Read More

Feed: Planet MySQL; Author: Ivan Ma; MySQL InnoDB Cluster Setup and ConfigurationReference : https://dev.mysql.com/doc/refman/8.0/en/mysql-innodb-cluster-production-deployment.htmlPr-requisite  Assumption :     MySQL Server 8.0.12+ installation : /usr/local/mysql     MySQL Shell installation : /usr/local/shell     MySQL Router Installation : /usr/local/router     Hostname and IP must be resolvable.            Make sure the /etc/hosts valid to have the IP and Hostname entries correctly with ALL MySQL Server machines.The Video [ https://youtu.be/_jR_bJGTf-o ] provides the full steps showing the Demonstration of 1. Setting up of 3 x MySQL Servers on 1 VM     a.  Configuration my1.cnf, my2.cnf and my3.cnf    b.  MySQL  Server (mysqld) initialization          # mysqld --defaults-file= ... Read More

Feed: James Serra's Blog. Author: James Serra. At Microsoft Ignite, one of the announcements was for Azure SQL Database Hyperscale, which was made available in public preview October 1st, 2018 in 12 different Azure regions.  SQL Database Hyperscale is a new SQL-based and highly scalable service tier for single databases that adapts on-demand to your workload’s needs.  With SQL Database Hyperscale, databases can quickly auto-scale up to 100TB, eliminating the need to pre-provision storage resources, and significantly expanding the potential for app growth without being limited by storage size.  Check out the documentation. Compared to current Azure SQL Database service tiers, Hyperscale provides ... Read More

Feed: Microsoft Azure Blog. Author: Nandakishor Basavanthappa. A few months ago, we released a significant update to the Azure IoT Reference Architecture, a downloadable resource that aims to accelerate customers building IoT solutions on Azure by providing a proven production ready architecture and technology implementation choices. Today, we are happy to release updated version 2.1 of the Azure IoT Reference Architecture. The document offers an overview of the IoT space, recommended subsystem factoring for scalable IoT solutions, prescriptive technology recommendations per subsystem, and detailed sections that explore use cases and technology alternatives. This latest version of the guide includes four ... Read More