Tag: PostgreSQL

Feed: Planet PostgreSQL. 18 Nov 2019 The OGR FDW now pushes spatial filters down to remote data sources! Whuuuut?!?!? The Basics OK, first, “OGR” is a subcomponent of the GDAL toolkit that allows generic access to dozens of different geospatial file formats. The OGR part handles the “vector” data (points, lines and polygons) and the GDAL part handles the “raster” data (imagery, elevation grids). Second, “FDW” is a “foreign data wrapper”, an extension API for PostgreSQL that allows developers to connect non-database information to the database and present it in the form of a table. The simplest FDWs, like the ... Read More

Feed: Planet PostgreSQL. On 6th of November 2019, Tomas Vondra committed patch: Allow sampling of statements depending on duration   This allows logging a sample of statements, without incurring excessive log traffic (which may impact performance). This can be useful when analyzing workloads with lots of short queries.   The sampling is configured using two new GUC parameters:   * log_min_duration_sample - minimum required statement duration   * log_statement_sample_rate - sample rate (0.0 - 1.0)   Only statements with duration exceeding log_min_duration_sample are considered for sampling. To enable sampling, both those GUCs have to be set correctly.   The existing ... Read More

Feed: MemSQL Blog. Author: Floyd Smith. How does a major technology services company equip itself to compete in the digital age – and provide services so outstanding that they can significantly advance the business prospects of their customers? All while reducing complexity, cutting costs, and tightening SLAs – in some cases, by 10x or more? For one such company, the solution is to deliver real-time, operational analytics with Kafka and MemSQL. In this company, data flowed through several data stores, and from a relational, SQL database, into NoSQL data stores for batch query processing, and back into SQL for BI, ... Read More

Feed: Planet MySQL; Author: Mark Callaghan; I am wary of papers with performance results for too many products.Too many means including results from systems for which you lack expertise. Wary means I have less faith in the comparison even when the ideas in the paper are awesome. I have expertise in MySQL, MongoDB, RocksDB, WiredTiger and InnoDB but even for them I have made and acknowledged ridiculous mistakes.Database configuration is too hard. There are too many options, most of them aren't significant and the approach is bottom-up. I an expert on this -- in addition to years of tuning I ... Read More

Feed: Planet PostgreSQL. OSM to PostGIS – The BasicsEver wondered how to import OSM (OpenStreetMap) data into PostGIS [1] for the purpose of visualization and further analytics? Here are the basic steps to do so.There are a bunch of tools on the market— osm2pgsql; imposm; ogr2org; just to mention some of those. In this article I will focus on osm2pgsql [2] .Let’s start with the software prerequisites. PostGIS comes as a PostgreSQL database extension, which must be installed in addition to the core database. Up till now, the latest PostGIS version is 3, which was released some days ago. For ... Read More

Feed: Planet PostgreSQL. etcd is one of several solutions to a problem that is faced by many programs that run in a distributed fashion on a set of hosts, each of which may fail or need rebooting at any moment. One such program is Patroni; I’ve already written an introduction to it as well as a guide on how to set up a highly-available PostgreSQL cluster using Patroni.In that guide, I briefly touched on the reason why Patroni needs a tool like etcd.Here’s a quick recap:Each Patroni instance monitors the health data of a PostgreSQL instance.The health data needs to be ... Read More

Feed: Planet PostgreSQL. I’ve been at dinners before with developers that admitted developers, themselves included, can be a bit opinionated. In one case one said for example, “I love Postgres, but I have no idea why.” They were sitting at the wrong table to use Postgres as an example… But it is quite often that I am asked Why Postgres.In fact a little over a year ago good friend Dimitri Fontaine asked if he could interview me for a book he’s working on for Postgres. I’ve long said their is a shortage of good books about Postgres and he’s done ... Read More

Feed: Microsoft Azure Blog. Author: Yashesvi Sharma. With reserved capacity, you get significant discounts over your on-demand costs by committing to long-term usage of a service. We are pleased to share reserved capacity offerings for the following additional services. With the addition of these services, we now support reservations for 16 services, giving you more options to save and get better cost predictability across more workloads. Blob Storage (GPv2) and Azure Data Lake Storage (Gen2). Azure Database for MySQL. Azure Database for PostgreSQL. Azure Database for MariaDB. Azure Data Explorer. Premium SSD Managed Disks. Blob Storage (GPv2) and Azure Data ... Read More

Feed: Planet PostgreSQL. 13 Nov 2019 This post originally appeared in the CARTO blog. One of the things that makes managing geospatial data challenging is the huge variety of scales that geospatial data covers: areas as large as a continent or as small as a man-hole cover. The data in the database also covers a wide range, from single points, to polygons described with thousands of vertices. And size matters! A large object takes more time to retrieve from storage, and more time to run calculations on. The Natural Earth countries file is a good example of that variation. Load ... Read More

Feed: Planet PostgreSQL. I use FreeBSD as my main PostgreSQL server, and also as virtual machine for training courses. A long time ago, I changed the message of the day (/etc/motd) to reflect the elephant logo in ascii-art, but why not changing also the booloader logo? FreeBSD by default shows what is called orb or the devil (named beastie), and the new Lua based bootloader use some simple string concatenation to generate a logo. However, it was not so simple to make a new logo, since I’ve no idea about how to debug it production, and that forced me to ... Read More