Tag: performance

Feed: CDH – Cloudera Engineering Blog. Author: Cy Jervis. In Part 1 of this blog, we covered some common challenges in memory tuning and baseline setup related to a production Solr deployment. In Part 2, you will learn memory tuning, GC tuning and some best practices. Memory Tuning We assume you have read part 1 of the blog and have a stable Solr deployment up running. The next step is memory tuning to get more out of Solr. Before changing any configuration please be aware that playing with some tuning knobs can cause unexpected consequences on the system, such as ... Read More

Feed: CDH – Cloudera Engineering Blog. Author: Cy Jervis. Configuring Apache Solr memory properly is critical for production system stability and performance. It can be hard to find the right balance between competing goals. There are also multiple factors, implicit or explicit, that need to be taken into consideration. This blog talks about some common tasks in memory tuning and guides you through the process to help you understand how to configure Solr memory for a production system. For simplicity, this blog applies to Solr in Cloudera CDH5.11 running on top of HDFS. The platform is Oracle JDK 8 and ... Read More

Feed: What's New. P2 instances are ideal for compute-intensive applications that require high-performance GPU coprocessors and massive parallel floating point performance such as deep learning, computational fluid dynamics, computational finance, seismic analysis, molecular modeling, genomics, and rendering workloads. P2 instances offer up to 16 NVIDIA Tesla® K80 GPUs, 192GB of total video memory, 40 thousand parallel processing cores yielding 70 teraflops of single precision floating point performance and over 23 teraflops of double precision floating point performance. P2 instance GPUs are connected to the same PCI fabric, reducing the latency of GPU to GPU transfers by up to 70%, and ... Read More

Feed: Planet big data. Author: Ronald van Loon. All of us are accustomed to the smart wearables, such as the ones we wear on a jogging track. We also have seen the concept of smart homes turn into a reality. We have seen a farmer sort and track his flock of sheep with the help of a mountable RFID device. Every physical element around us (including ourselves) have become a part of a real and rhythmic whole – communicating information with each other at all times. All thanks to the Internet of Things! Ever since the Internet of Things (IoT) ... Read More

Feed: Microsoft Azure Blog. Author: Abhishek Pathak. Diagnosing network connectivity and performance issues in the cloud can be a challenge as your network evolves in complexity. We are pleased to announce the preview of a new feature to check network connectivity in a variety of scenarios when using VM. The Azure Network Watcher Connectivity Check feature helps to drastically reduce the amount of time needed to find and detect connectivity issues in the infrastructure. The results returned can provide valuable insights to whether a connectivity issue is due to a platform or a potential user configuration. Network Watcher Connectivity Check ... Read More

Feed: AWS Big Data Blog. This is a guest post by Dillon Morrison at Looker. Looker is, in their own words, “a new kind of analytics platform–letting everyone in your business make better decisions by getting reliable answers from a tool they can use.” As the breadth of AWS products and services continues to grow, customers are able to more easily move their technology stack and core infrastructure to AWS. One of the attractive benefits of AWS is the cost savings. Rather than paying upfront capital expenses for large on-premises systems, customers can instead pay variables expenses for on-demand services. To further ... Read More

Feed: Planet MySQL; Author: Severalnines; Galera Cluster is a true multi-master cluster solution for MySQL and MariaDB, based on synchronous replication. Galera Cluster is easy-to-use, provides high-availability, as well as scalability for certain workloads. ClusterControl provides advanced deployment, management, monitoring, and scaling functionality to get your Galera clusters up-and-running using proven methodologies. Here are just some of the great resources we’ve developed for Galera Cluster over the last few years... Tutorials Galera Cluster for MySQL Galera allows applications to read and write from any MySQL Server. Galera enables synchronous replication for InnoDB, creating a true multi-master cluster of MySQL servers ... Read More

Feed: Microsoft Azure Blog. Author: Walter Harp. 14 great new cloud offerings were published to Azure Marketplace last month. Check ‘em out! – The Azure Marketplace Team Denodo Platform:  is a leading data virtualization product that provides agile, high performance data integration and data abstraction across the broadest range of enterprise, cloud and big data sources; exposes real-time data models for expediting the use by other applications and business users. Learn more on Azure Marketplace. Kinetica (BYOL):  is a GPU-accelerated, in-memory analytics database that delivers truly real-time response to queries on large, complex and streaming data sets: 100x faster performance ... Read More

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. The Intelligence Advanced Research Projects Activity (IARPA) Machine Intelligence from Cortical Networks (MICrONS) program seeks to revolutionize machine learning by better understanding the representations, transformations, and learning rules employed by the brain.We spoke with Dean Kleissas, Research Engineer working on the IARPA MICrONS Project at the Johns Hopkins University Applied Physics Laboratory (JHU/APL), and he shared more about the project, what makes it unique, and how the team leverages serverless technology. Could you tell us about the IARPA MICrONS Project? This project partners computer scientists, neuroscientists, biologists, and other researchers from ... Read More

Feed: CDH – Cloudera Engineering Blog. Author: Cy Jervis. Unmodified TPC-DS-based performance benchmark show Impala’s leadership compared to a traditional analytic database (Greenplum), especially for multi-user concurrent workloads. Additionally, benchmark continues to demonstrate significant performance gap between analytic databases and SQL-on-Hadoop engines like Hive LLAP, Spark SQL, and Presto. The past year has been one of the biggest for Apache Impala (incubating). Not only has the team continued to work on ever-growing scale and stability, but a number of key capabilities have been rolled out that further solidifies Impala as the open standard for high-performance BI and SQL analytics. For ... Read More