Tag: INDEX

Feed: Planet MySQL; Author: Krunal Bauskar; By and large this would be a topic of interest for most of us including me when I started to explore this space. Before we dwell into the numbers let’s first understand some basic differences between 2 architectures. Beyond being CISC and RISC let’s look at the important differences from MySQL perspective. Strong vs Weak memory model (weak memory model needs proper memory barrier while writing lock-free code). Underlying hardware specific specialized instructions. For example: both now support crc32c hardware instructions but being low-level they are different ways to invoke them. For more differences ... Read More

Feed: R-bloggers. Author: rOpenSci - open tools for open science. After soliciting, reviewing, and publishing over 100 blog posts and tech notes by rOpenSci community members, we have created the rOpenSci Blog Guide for Authors and Editors to address many frequently asked questions and frequently given suggestions. Technically, we structured the content as a bookdown gitbook. It was Stef’s first foray into the glorious process of publishing a book with bookdown, and Maëlle’s second. And oh, we learned a lot. Stef (first-timer) 1. How to collaborate across timezones There is a 9-hour time difference between Maëlle and me for most ... Read More

Feed: Redis Labs. Author: Pieter Cailliau. Redis is a noSQL database that enables users to store a variety of data in a variety of data structures. We saw a need for our customers to create highly connected data and derive insight by using graph technology. Originally released in 2018, RedisGraph is the result of that effort. RedisGraph is based on a unique approach and architecture that translates the Cypher query language to matrix operations executed over a GraphBLAS-based engine. By using sparse matrices to represent graphs and the power of GraphBLAS to process them, RedisGraph delivers a fast and efficient ... Read More

Feed: Planet PostgreSQL. By design, the out of the box configuration for PostgreSQL is defined to be a "Jack of All Trades, Master of None". The default configuration for PostgreSQL is fairly painstakingly chosen to ensure that it will run on every environment it is installed, meeting the lowest common denominator resources across most platforms.Because of this, it's always recommended that one of the first actions performed once an install of PostgreSQL is completed, would be to tune and configure some high-level settings. There are four high-level settings which will be discussed here: shared_buffers,  wal_buffers,  effective_cache_size, and maintenance_work_mem. Let's begin with shared_buffers ... Read More

Feed: Planet PostgreSQL. Write-Ahead Logs is a critical part of PostgreSQL, that ensures data durability. While there are multiple configuration parameters , there was no easy to monitor WAL activity, or what is generating it. New infrastructure to track WAL activity commit df3b181499b40523bd6244a4e5eb554acb9020ce Author: Amit Kapila Date: Sat Apr 4 10:02:08 2020 +0530 Add infrastructure to track WAL usage. This allows gathering the WAL generation statistics for each statement execution. The three statistics that we collect are the number of WAL records, the number of full page writes and the amount of WAL bytes generated. This helps the users who ... Read More

Feed: Planet MySQL; Author: MySQL Performance Blog; This is a three-part blog series that focuses on dealing with an unexpected high traffic event as it is happening. Part one can be found here, and part two can be found here.  13. Configure MySQL Server ProperlyComplexity:MediumPotential Impact: High A poorly configured MySQL Server can cause severe issues, especially under high load during a traffic spike, yet getting the basics right is not that hard. While MySQL Server has more than 400 variables you can tune, you rarely need to change more than 10-20 of them to get 95% of the possible performance for ... Read More

Feed: Microsoft Azure Blog. Author: Vinod Kurpad. Incremental enrichment is a new feature of Azure Cognitive Search that brings a declarative approach to indexing your data. When incremental enrichment is turned on, document enrichment is performed at the least cost, even as your skills continue to evolve. Indexers in Azure Cognitive Search add documents to your search index from a data source. Indexers track updates to the documents in your data sources and update the index with the new or updated documents from the data source. Incremental enrichment is a new feature that extends change tracking from document changes in ... Read More

Feed: CronJ. Author: Shruti Priya; Redux Middleware: What struck your mind when you first heard the term ‘Middleware’? Let’s first try to understand it with the most general definition:-Middleware offers a means for communicating with the action being dispatched before they reach the reducer.Before understanding Redux Middleware, you should have a clear concept of redux. So let’s have a brief introduction about redux.ReduxRedux is an open-source JavaScript library for front-end development. It’s an application data flow architecture. It is used with React to solve the ‘state transfer problem.’ It maintains a single immutable store tree to keep the state of ... Read More

Feed: Planet MySQL; Author: MySQL Performance Blog; This is a three-part blog series that focuses on dealing with an unexpected high traffic event as it is happening. Part one of this series talked about the first six things you can do, and in part two, we will be discussing numbers seven through twelve.7. Get More MemoryComplexity: LowPotential Impact: HighIf your data does not fit into memory well, your MySQL performance is likely to be severely limited. If your data already fits in well, adding even more memory will not provide any performance improvements.Even when you’re running on very fast storage, ... Read More

Feed: AWS Compute Blog. Author: James Beswick. Enterprise customers frequently have repositories with thousands of documents, images and other media. While these contain valuable information for users, it’s often hard to index and search this content. One challenge is interpreting the data intelligently, and another issue is processing these files at scale.In this blog post, I show how you can deploy a serverless application that uses machine learning to interpret your documents. The architecture includes a queueing mechanism for handling large volumes, and posting the indexing metadata to an Amazon Elasticsearch Service domain. This solution is scalable and cost effective, and ... Read More