Tag: node

Feed: AWS Big Data Blog. In May 2020, we announced the general availability of real-time anomaly detection for Elasticsearch. With that release we leveraged the Random Cut Forest (RCF) algorithm to identify anomalous behaviors in the multi-dimensional data streams generated by Elasticsearch queries. We focused on aggregation first, to enable our users to quickly and accurately detect anomalies in their data streams. However, consider the example data in the following table. timestamp avg. latency region 12:00 pm 3.1 Seattle 12:00 pm 4.1 New York 12:00 pm 5.9 Berlin 12:01 pm 2.6 Seattle 12:01 pm 5.3 New York 12:01 pm 5.8 ... Read More

Feed: AWS Compute Blog. Author: James Beswick. Customers use AWS Lambda to build a wide range of applications, including mission-critical and compute-intensive applications. The most demanding workloads include machine learning inferencing, media processing, high performance computing (HPC), scientific simulations, and financial modeling. With the release of Advanced Vector Extensions 2 (AVX2) support for Lambda, builders can benefit from improved performance for these types of applications. Overview This blog post explains AVX2 and how you can take advantage of this instruction set in your Lambda functions. I walk through an example of how to enhance performance of a typical use case ... Read More

Feed: Microsoft Dynamics 365 Blog. Author: Christian Abeln. Companies that work with manufacturing and distribution need to be able to run key business processes 24/7, without interruption, and at scale. Challenges arise with unreliable connections or network latency when business processes compete for the same system resources when peak scale is required, or during periodic or regular maintenance for different regions, across time zones, or to meet different scheduling requirements. The ability to execute daily mission-critical processes must be agnostic to these situations.Cloud and edge scale units enable companies to execute mission-critical manufacturing and warehouse processes without interruptions. This functionality ... Read More

Feed: AWS Compute Blog. Author: Benjamin Smith. AWS Step Functions now integrates with Amazon API Gateway to enable backend orchestration with minimal code and built-in error handling. API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any scale. These APIs enable applications to access data, business logic, or functionality from your backend services. Step Functions allows you to build resilient serverless orchestration workflows with AWS services such as AWS Lambda, Amazon SNS, Amazon DynamoDB, and more. AWS Step Functions integrates with a number of services natively. Using Amazon ... Read More

Feed: Planet MySQL; Author: Vitess; IntroductionIn this blog, I would like to explore Vitess Operator for Kubernetes. This post demonstrates the sample implementation of Vitess in Kubernetes topology. I also explore common DBA tasks by demonstrating how they are handled in the Vitess ecosystem. Vitess, out of the box, comes with a lot of tools and utilities that one has to either incorporate or develop to manage MySQL topology. Let’s take a look at the capabilities of Vitess in these areas and demonstrate how they are performed under the operator realm.PrerequisitesGKE AccountKubectlMySQL ClientInstall vtctlclient locallygo get vitess.io/vitess/go/cmd/vtctlclientDownload the Operator example ... Read More

Feed: Blog – ArangoDB. Author: Christopher Woodward. This post is the fifth in a series of posts introducing the ArangoML features and tools. This post introduces the ArangoDB NetworkX adapter, which makes it easy to analyze your graphs stored in ArangoDB with NetworkX. In this post we: Briefly introduce NetworkXExplore the IMDB user rating datasetShowcase the ArangoDB integration of NetworkXExplore the centrality measures of the data using NetworkXStore the experiment with arangopipe Going forward, the ArangoML Series will no longer be numbered. Parts 1-4 deal with the same housing dataset and focus on introducing some core machine learning concepts. We ... Read More

Feed: AWS Big Data Blog. Many organizations have an Apache Hive metastore that stores the schemas for their data lake. You can use Amazon Athena due to its serverless nature; Athena makes it easy for anyone with SQL skills to quickly analyze large-scale datasets. You may also want to reliably query the rich datasets in the lake, with their schemas hosted in an external Hive metastore. In response to customers’ requests, AWS announced Athena’s support for Hive metastore in early 2020. This extends the ability in Athena to query external data stores, with a combined benefit of better performance and ... Read More

Feed: AWS Architecture Blog. As a modern company, you most likely have both a web-based and mobile app platform to provide content to customers who view it on a range of devices. This means you need to store multiple versions of images, depending on the device. The resulting image management can be a headache as it can be expensive and cumbersome to manage. Serverless Image Handler (SIH) is an AWS Solution Implementation you use to store a single version of every image featured in your content, while dynamically delivering different versions at runtime based on your end user’s device. The ... Read More

Feed: Planet MySQL; Author: Mirko Ortensi; MySQL highly available solutions, InnoDB Cluster (it uses InnoDB storage engine and is based on Group Replication plugin) and NDB Cluster (NDB storage engine), offer high scalability and redundant topologies. InnoDB Cluster can be configured with up to 9 replicas, in single primary configuration or multi-primary. NDB Cluster instead, while being a much different solution, offers the chance to have up to 4 data nodes replicated for a single shard of data (or node group) and up to a total number of 144 nodes. Redundancy ensures that multiple copies of data exist and are ... Read More

Feed: Planet PostgreSQL. pgBackRest is a well-known powerful backup and restore tool. It offers a lot of possibilities. In this post, we’ll see how to setup a dedicated repository host to backup a PostgreSQL 3-nodes cluster. The repository host will be called backup-srv and the 3 PostgreSQL nodes in Streaming Replication: pg1-srv, pg2-srv, pg3-srv. All the nodes will be running on CentOS 7. If you’re familiar with Vagrant, here’s a simple Vagrantfile to initiate 4 virtual machines using those names: # Vagrantfile Vagrant.configure(2) do |config| config.vm.box = 'centos/7' config.vm.provider 'libvirt' do |lv| lv.cpus = 1 lv.memory = 1024 end nodes ... Read More