Tag: partitions

Feed: Microsoft Power BI Blog | Microsoft Power BI. Author: . The incremental refresh feature has proven very popular and attracted much usage. We received strong feedback from customers that we should make it available with Power BI Pro licensing rather than a Premium-only feature. In fact, at time of writing this post, incremental refresh in Pro is the 2nd highest voted item on https://ideas.powerbi.com/! Well, you talked; we listened. We are pleased to announce that, in addition to incremental refresh reaching general availability, it is also now available in Pro. Incremental refresh is a critical capability to unlock actionable ... Read More

Feed: MemSQL Blog. Author: Rob Richardson. The MEAN stack – MongoDB, Express.js, Angular.js, and Node.js – has served as a pattern for a wide variety of web development. But times have changed, and the components of the MEAN stack have failed to keep up with the times. Let’s take a look at how the MEAN stack superseded the previous stack, the LAMP stack, and at the options developers have now for delivering efficient Web applications. Introduction We reach for software stacks to simplify the endless sea of choices. The MEAN stack is one such simplification that worked very well in ... Read More

Feed: AWS Big Data Blog. AWS Glue provides a serverless environment to prepare (extract and transform) and load large amounts of datasets from a variety of sources for analytics and data processing with Apache Spark ETL jobs. The first post of the series, Best practices to scale Apache Spark jobs and partition data with AWS Glue, discusses best practices to help developers of Apache Spark applications and Glue ETL jobs, big data architects, data engineers, and business analysts scale their data processing jobs running on AWS Glue automatically.This post shows how to incrementally load data from data sources in an ... Read More

Feed: Planet MySQL; Author: Corrado Pandiani; This blog is the first part of a two-articles series. In this article, I’m going to introduce the Common Table Expression (CTE), a new feature available on MySQL 8.0, as well as Percona Server for MySQL 8.What is a Common Table Expression?We can define a CTE as an alternative to a derived table. In a small way, CTE simplifies complex joins and subqueries, improving the readability of the queries. CTE is part of ANSI SQL 99 and was introduced in MySQL 8.0.1. The same feature is available even on Percona Server for MySQL 8.0.The ... Read More

Feed: MemSQL Blog. Author: Floyd Smith. This is the first part of a two-part blog post; part two is here. The recent release of MemSQL 7.0 has fast replication as one of its major features. With this release, MemSQL offers high-throughput, synchronous replication that, in most cases, only slows MemSQL’s very fast performance by about 10%, compared with asynchronous replication. This is achieved in a very high-performing, distributed, relational database. In this talk, available on YouTube, Rodrigo Gomes describes the high points as to how MemSQL achieved these results.  Rodrigo Gomes is a senior engineer in MemSQL’s San Francisco office, ... Read More

Feed: Planet PostgreSQL. PostgreSQL 10 introduced native partitioning and more recent versions have continued to improve upon this feature. However, many people set up partition sets before native partitioning was available and would greatly benefit from migrating to it. This article will cover how to migrate a partition set using the old method of triggers/inheritance/constraints to a partition set using the native features found in PostgreSQL 11+. Note these instructions do not cover migrating to PG10 since some key features that make this migration easier were not yet implemented. It is highly recommended to move to PG11 or higher if ... Read More

Feed: Planet MySQL; Author: Severalnines; The I/O performance is vital for MySQL databases. Data is read and written to the disk in numerous places. Redo logs, tablespaces, binary and relay logs. With an increase of the usage of solid state drives I/O performance has significantly increased allowing users to push their databases even faster but even then I/O may become a bottleneck and a limiting factor of the performance of the whole database. In this blog post we will take a look at the things you want to check if you notice your I/O performance is high on your MySQL ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Balaji Gopalan. By Nadav Sharir, VP Engineering at BehalfBy Liran Keren, Director of Engineering at BehalfBy Balaji Gopalan, Sr. Solutions Architect at AWSTo be a successful fintech startup, companies have to build solutions fast so the business can achieve its goals. However, you can’t compromise on security, reliability, or support. Behalf is an AWS Partner Network (APN) Advanced Technology Partner that offers short-term financing with flexible repayment terms to U.S.-based businesses. As an AWS Financial Services Competency Partner, Behalf is committed to delivering reliable, secure, low-cost payment processing and credit options to business customers ... Read More

Feed: Planet PostgreSQL. It’s been exactly half a year since the last major release of the pgwatch2 Open Source PostgreSQL monitoring tool, and I’m glad to announce that another huge set of useful features and improvements have found their way into the pgwatch2 code repository! The new version is incremented to v1.7 and, continuing the naming tradition, I’m also calling it “Feature Pack 6” as it’s mostly about new features mixed with some bugfixes, although it’s been surprisingly error-free for the last year. Note that listed below are only the most significant changes since last major version, v1.6, so please ... Read More

Feed: AWS Big Data Blog. Many AWS customers use a multi-account strategy. A centralized AWS Glue Data Catalog is important to minimize the amount of administration related to sharing metadata across different accounts. This post introduces capability that allows Amazon Athena to query a centralized Data Catalog across different AWS accounts.Overview of solution In late 2019, AWS introduced the ability to Connect Amazon Athena to your Apache Hive Metastore. Using this functionality, you can also configure Athena to point to a Data Catalog in a different account. The Hive Metastore functionality uses an AWS Lambda function to federate queries to ... Read More