Tag: INSERT

Feed: Planet PostgreSQL. Let's say you have a script of one million of insert statements with literal values. Of course, this is a bad idea. SQL is language, not a data exchange format. You should have a file to import with COPY, with all values as CSV for example. Or at least, if you are a big fan of INSERT statements, have thousands of row values in it. Or prepare the statement with parameters and call with each parameter. However, this is the kind of things we encounter in real life. I still remember 20 years ago when I got ... Read More

Feed: Planet PostgreSQL. The missing piece of the puzzle is that these tables were insert-only. In versions of PostgreSQL prior to 13, no auto*vacuum* would be kicked off with an insert-only workload, presumably because if there are no updates or deletes, there would be no free space that would need to be reclaimed. autoanalyze was kicked off for insert-only workloads, since there was new data and new statistics that could be gathered. Since autovacuum was not running on this table, the Visibility Map was not updated, and thus the query performance started to suffer over time. Once the Visibility Map was updated, performance returned ... Read More

Feed: Planet MySQL; Author: Jesper Krogh; Locking is an important concept in databases. They help regulate access to the data, so your SELECT queries return consistent results and DML and DDL statements leave the data and schema in a consistent state. For the data, there are four different transaction isolation levels that influence which locks are taken. The most two commonly used isolation levels are REPEATABLE READ (the default in InnoDB) and READ COMMITTED (the default in some other databases). Both of those are said to provide non-locking reads, but there is a little more to it than that. Selecting ... Read More

Feed: Planet MySQL; Author: Michael McLaughlin; I found myself explaining the nuances of INSERT statements and whether you should use named or positional notation. While the class was on Zoom, I could imagine the blank stares in the silence of my headphones. Then, I had to remind them about mandatory (NOT NULL constrained) and optional (nullable) columns in tables and how an INSERT statement requires an explicit NULL value for optional columns when the INSERT statement isn’t inserting a value into that column. Then, I asked if somebody could qualify the different types of INSERT statements; and what would happen ... Read More

Feed: Planet MySQL; Author: EverSQL; Optimize your database, auto-magically.Click to start, for free. At some points, many of our customers need to handle insertions of large data sets and run into slow insert statements. This article will try to give some guidance on how to speed up slow INSERT SQL queries. The following recommendations may help optimize your data loading operations: Remove existing indexes - Inserting data to a MySQL table will slow down once you add more and more indexes. Therefore, if you're loading data to a new table, it's best to load it to a table without any indexes, ... Read More

Feed: AWS Big Data Blog. Organizations across the globe are striving to improve the scalability and cost efficiency of the data warehouse. Offloading data and data processing from a data warehouse to a data lake empowers companies to introduce new use cases like ad hoc data analysis and AI and machine learning (ML), reusing the same data stored on Amazon Simple Storage Service (Amazon S3). This approach avoids data silos and allows you to process the data at very large scale while keeping the data access cost-effective. Starting off with this new approach can bring with it several challenges: Choosing ... Read More

Feed: R-bloggers. Author: R on Chemometrics & Spectroscopy using R. Last summer, a GSOC project was approved for work on the hyperSpec package which had grown quite large and hard to maintain. The essence of the project was to break the original hyperSpec package into smaller packages. As part of that project, we needed to be able to: Provide development versions of packages Provide large data-only packages (potentially too large to be hosted on CRAN). In this post I’ll describe how we used Dirk Eddelbuettel’s drat package and Github Actions to automate the deployment of packages between repositories. What is ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Diego García. By Diego García, Partner Solutions Architect Manager at AWS By Emanuele Cuoccio, Solutions Architect at AWSBy Guillermo Torres, Product Developer Lead at Linke A top priority for the more than 5,000 active customers running SAP workloads on Amazon Web Services (AWS) is to regularly back up their databases to recover them in case of failure. Regarding where to ship the backups, Amazon Simple Storage Service (Amazon S3) is a cost-effective, highly durable, and reliable storage service. This makes it the preferred storage service for storing database backups, both in general and ... Read More

Feed: Planet MySQL; Author: Saroj Tripathy; In this post, we will see how to setup MySQL NDB Cluster from a docker image. I assume that the reader has some basic understanding of docker and its terminology.Steps to install MySQL NDB Cluster:Let's create a MySQL NDB Cluster with the following environment:MySQL NDB Cluster version (Latest GA version)1 Management Node4 Data Nodes1 Mysqld ServerConfiguration slots for upto 4 additional API nodes Note: Docker software must be installed and running on the same host where we are planning to install MySQL NDB Cluster. Also make sure we have enough resources allocated to docker so ... Read More

Feed: CronJ. Author: Nidhi Swadi; iPhone: It would not be wrong to say that the iPhone is not only the best-selling gadget but also an influential one too in the world. It not only has a wide market but also created a market for app development and accessories. For several people, the iPhone has replaced computers too. The iPhone is a one-stop for the camera, music, communication, GPS, planners, payments, etc. It is a trend-setter be it with the screen, design, or cameras. iPhones have not only solved the latent problems but also introduced new features. Thereby, it has been a ... Read More