Tag: cluster

Feed: AWS Big Data Blog. Apache Spark is a powerful data processing engine that gives data analyst and engineering teams easy to use APIs and tools to analyze their data, but it can be challenging for teams to manage their Python and R library dependencies. Installing every dependency that a job may need before it runs and dealing with library version conflicts is time-consuming and complicated. Amazon EMR 6.0.0 simplifies this by allowing you to use Docker images from Docker Hub and Amazon ECR to package your dependencies. This allows you to package and manage your dependencies for individual Spark ... Read More

Feed: Blue Medora. Author: Jameson Haas. With the recent release of automated dashboards with BindPlane for Google Cloud Monitoring, it is now easier than ever to fully monitor Kubernetes in production. To ensure everything is functioning as it should, you need to make sure your containers, clusters, pods and nodes are working in tandem. With all of the moving parts, monitoring the health and performance of your Kubernetes environment can be troublesome. To help, BindPlane makes it easy to monitor everything in a centralized location with, easy to use one-click automated dashboards. Once BindPlane is configured for your environment, you’re ... Read More

Feed: Microsoft Power BI Blog | Microsoft Power BI. Author: . With the ongoing concerns of COVID-19, it’s fair to say business hasn’t been as usual for the Power BI team. All of us have been working from home for over a month now and following strict social distancing guidelines to prevent the spread of this outbreak. We hope everyone out there is staying safe and healthy in these unprecedented times. Our thoughts are with those affected and the medical professionals tirelessly working to help those in need. On the brighter side, we’re continuing to roll out features as per ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Scott Kellish. By Scott Kellish, Partner Solutions Architects at AWSBy Basil Faruqui, Principal Solutions Marketing Manager at BMC Digital Business AutomationBy Joe Goldberg, Innovation Evangelist at BMCPredictive maintenance, which analyzes sensor data to predict equipment failures, has emerged as one of the most common business use cases of machine learning (ML) and the Internet of Things (IoT). To build and train ML models, you need data science expertise. If you’re going to run those ML models in production at scale, you need data engineering expertise to build a pipeline for data ingestion, storage, ... Read More

Feed: Clustrix Blog. Author: Shane Johnson. We already gutted Amazon Redshift in Part 1, we might as well finish with a fatality. Yes, the Mortal Kombat in the arcade at the roller rink kind of fatality. And yes, I had custom roller skates. Will I share pictures in a future blog post? No.Now, back to cloud data warehouses. Redshift is great if… You have money to burn, and enjoy bonfires. You love complexity, and prefer Reptangles over Legos. If you don’t, it’s time for something better (and less expensive). Here’s the thing. Redshift is up to 40% more expensive than ... Read More

Feed: Clustrix Blog. Author: Shane Johnson. If you needed an on-premises data warehouse today, would you choose a version of Postgres released in 2005 (Postgres 8.0.2)? How about a version of MySQL released in 2005 (MySQL 5.0.15)? Perhaps you’d ask Oracle if you could use Oracle Database 10g Release 2 even though it was released in 2005 and reached end-of-life a decade ago?I didn’t think so. You know better, and so do I. Amazon? Not so much. They built Redshift on ParAccel Analytic Database (PADB) in 2013, itself built on Postgres 8.0.2. ParAccel would go on to be acquired by ... Read More

Feed: AWS Compute Blog. Author: Roshni Pary. This post is contributed by Shankar Ramachandran, SA Specialist, Cost OptimizationIntroduction AWS’s breadth of services and pricing options offer the flexibility to effectively manage your costs, and still keep the performance and capacity per your business requirement. While the fundamental process of cost optimization on AWS remains the same – monitor your AWS costs and usage, analyze the data to find savings, take action to realize the savings; in this blog I will take a more tactical approach of reducing cost with changes in user demand. Before you start Before taking any actions to reduce ... Read More

Feed: AWS Big Data Blog. Since Amazon Redshift launched in 2012, its focus has always been on providing you with the best possible performance, at scale, and at the lowest possible cost. For most organizations across the globe, the amount of data going into their data warehouse is growing exponentially, and the number of people who want insights from that data increases daily. Because of this, Amazon Redshift is continually innovating to handle this growing volume of data and demand for insights.Amazon Redshift delivers fast performance, at scale, for the most demanding workloads. Getting there was not easy, and it ... Read More

Feed: Recent Announcements. Elastic resize across node type automates the steps of taking a snapshot, creating a new cluster, deleting the old cluster, and renaming the new cluster into a simple, quick, and familiar operation. Elastic resize operation can be run at any time or can be scheduled to run at a future time. Customers can quickly upgrade their existing DS2 or DC2 node type-based cluster to the new RA3 node type with elastic resize.   Elastic resize across node types is supported with release version 1.0.10013 or later. Refer to the AWS Region Table for Amazon Redshift availability. To ... Read More

Feed: Blog – Hazelcast. Author: Rafal Leszko. Cert-Manager became a standard way for issuing and rotating certificates in Kubernetes and OpenShift environments. Simple to install. Simple to use. Well integrated with Vault and other secret managers. No surprise it’s the way to go if you want to set up secure communication between your applications! In this blog post, I show how to secure Hazelcast communication using keys provisioned with cert-manager. I focus on all necessary steps, from installing cert-manager and issuing certificates to using them for the Hazelcast member-to-member and client-to-member communication. All you need to follow this tutorial is: ... Read More