Tag: performance

Feed: Recent Announcements. NICE DCV version 2022.1 introduces performance improvements and multiple new features, such as support for Rocky Linux 8.5 and Ubuntu 22.04 servers. NICE DCV is a high-performance remote display protocol that helps customers securely access remote desktop or application sessions, including 3D graphics applications hosted on servers with high-performance GPUs ... Read More

Feed: AWS Big Data Blog. Amazon EMR is a cloud big data platform for running large-scale distributed data processing jobs, interactive SQL queries, and machine learning (ML) applications using open-source analytics frameworks such as Apache Spark, Apache Hive, and Presto. Apache Iceberg is an open table format for huge analytic datasets. Table formats typically indicate the format and location of individual table files. Iceberg adds functionality on top of that to help manage petabyte-scale datasets as well as newer data lake requirements such as transactions, upsert/merge, time travel, and schema and partition evolution. Iceberg adds tables to compute engines including ... Read More

Feed: Planet PostgreSQL. By Ryan Lambert -- Published June 24, 2022I recently started using the H3 hex grid extension in Postgres with the goal of making some not-so-fast queries faster. My previous post, Using Uber's H3 hex grid in PostGIS, has an introduction to the H3 extension. The focus in that post, admittedly, is a PostGIS focused view instead of an H3 focused view. This post takes a closer look at using the H3 extension to enhance performance of spatial searches. The two common spatial query patterns considered in this post are: Nearest neighbor style searches Regional analysis Setup and ... Read More

Feed: Planet MySQL; Author: Dimitri Kravtchuk; The following is a short HOWTO about deployment and use of Benchmark-kit (BMK-kit). The main idea of this kit is to simplify your life in running various MySQL benchmark workloads with less blood and minimal potential errors. Generally as simple as the following : $ bash /BMK/sb_exec/sb11-Prepare_50M_8tab-InnoDB.sh 32 # prepare data $ for users in 1 2 4 8 16 32 64 128 256 512 1024 do # run OLTP_RW for 5min each load level.. bash /BMK/sb_exec/sb11-OLTP_RW_50M_8tab-uniform-ps-trx.sh $users 300 sleep 15 done Preface I'm seeing the new (Lua-based) Sysbench since the v.1.0 as a ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Kiran Kumar Ballari. By Kiran Kumar Ballari, Principal Enterprise Technologist – AWSBy Robert M. Bata, Business Development Manager – AWS By Puneet Chaddah, CTO; and Sundeep Mallya, Head of Research Gateway Product – Relevance Lab Inc. Relevance Lab Running genomics and high performance computing (HPC) workloads is complicated. It takes time to set up and get started. Instead of building their own solutions, researchers are always looking for simple and efficient ways to run their research and genomics workloads. This means provisioning secure, performant, and scalable research environments with role-based access to workbench ... Read More

Feed: AWS Big Data Blog. This is post is co-authored by Jyothin Madari, Madhusudhan Muppagowni and Ayush Srivastava from GE. GE Proficy Manufacturing Data Cloud (MDC), part of the GE Digital’s Manufacturing Execution Systems (MES) suite of solutions, allows GED’s customers to increase the derived value easily and quickly from the MES by reliably bringing enterprise-wide manufacturing data into the cloud and transforming it into a structured dataset for advanced analytics and deeper insights into the manufacturing processes. In this post, we share how MDC modernized the hybrid cloud strategy by replatforming. This solution improved scalability, their data availability Service ... Read More

Feed: Redis. Author: Filipe Oliveira. Redis is developed with a great emphasis on performance. We do our best with every release to ensure you’ll experience a very stable and fast product. Nevertheless, if you’re finding room to improve the efficiency of Redis or are pursuing a performance regression investigation, you will need a concise methodical way of monitoring and analyzing Redis’ performance. This is the story of one of those optimizations. In the end, we’ve improved stream’s ingest performance by around 20%, an improvement you can already take advantage of on the Redis v7.0. A standard SPEC Before jumping into ... Read More

Feed: AWS Big Data Blog. Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon Simple Storage Service (Amazon S3) using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run. In 2019, Athena added support for federated queries to run SQL queries across data stored in relational, non-relational, object, and custom data sources. In 2021, Athena added support for the EXPLAIN statement, which can help you understand and improve the efficiency of your queries. The EXPLAIN statement provides a detailed breakdown ... Read More

Feed: Matillion. Author: Julie Polito; It is common to build large, sophisticated Matillion ETL Orchestration Jobs that perform a lot of work. One example might be a “Daily ETL” job that launches many other jobs during a batch window.The job performance analysis and tuning presented in this document is aimed at large, single Matillion ETL jobs that contain a lot of components, and that do a lot of data processing. Over time, it is natural for such workloads to take longer and longer to finish, as volumes increase and the data itself evolves.To tune a Matillion job, start with the ... Read More

Feed: CronJ. Author: Nupur Pal; There’s a lot of buzz about microservices these days. The trends have gained popularity in recent years as more and more enterprises aim to be more agile and adopt DevOps and continuous testing. Adapting to the rapid digital changing environment, businesses have to embrace and redesign their legacy applications to the latest technology architecture designs.This way they can scale up their product and services by offering the latest features catering to the present and futuristic goals of all stakeholders. The Microservice deployment approach leads to faster innovation of your application by improving the software delivery ... Read More