Tag: Linux

Feed: AWS Big Data Blog. Data is ubiquitous in businesses today, and the volume and speed of incoming data are constantly increasing. To derive insights from data, it’s essential to deliver it to a data lake or a data store and analyze it. Real-time or near-real-time data delivery can be cost prohibitive, therefore an efficient architecture is key for processing, and becomes more essential with growing data volume and velocity. In this post, we show you how to build a scalable producer and consumer application for Amazon Kinesis Data Streams running on AWS Fargate. Kinesis Data Streams is a fully ... Read More

Feed: Planet MySQL; Author: Joshua Otwell; If you use SQL on a regular basis, then you are well aware that Window Functions are powerful. They allow us to simplify queries that would otherwise be quite the mess. We can provide meaningful insight across rows of data without collapsing the results into a single value. I have written numerous blog posts on Window Functions, many here recently. I decided to make this blog post a compilation of all the Window Function posts I have written, providing a one-stop source for any readers interested in learning more about Window Functions… Self-Promotion: If ... Read More

Feed: Blog – Hazelcast. Author: Huseyin Babal. We are happy to announce Hazelcast Cloud CLI (hzcloud) to provide full automation for your Hazelcast clusters and related operations. We all believe in the power of automation and if you already have Hazelcast within your pipeline, you can insert the missing piece by using hzcloud. To try examples here, you can create a Hazelcast Cloud account and get API Credentials Installation hzcloud supports various distributions including Mac, Linux, Windows, as well as different architectures including armd64 and even arm! You can select one of your favorite installation methods which are described here.  Getting ... Read More

Feed: Planet PostgreSQL. In one of my previous blog posts, Why PostgreSQL WAL Archival is Slow, I tried to explain three of the major design limitations of PostgreSQL’s WAL archiver which is not so great for a database with high WAL generation. In this post, I want to discuss how pgBackRest is addressing one of the problems (cause number two in the previous post) using its Asynchronous WAL archiving feature.Let me explain the problem in a bit more detail here.The PostgreSQL archiver process has an internal function pgarch_archiveXlog()  which calls the system()  system call which executes the archive_command  which will ... Read More

Feed: Planet PostgreSQL. As a consultant, I frequently need to install Postgres for customers. Of course I send them a list or prerequisites beforehand but, I don’t know why, there’s always a problem with one of them and, most often, the problem concerns port opening.Sysadmins will recommend you to use either nmap or netcat or netstat and you might need to combine those tools (which syntax you will keep forgetting) with grep to find if your port is listed. Then you will have to remember if the syntax you chose was to display open or close ports… That’s a little ... Read More

Feed: Recent Announcements. AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g. CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted. When creating an AWS Batch compute environment, customers can simply select Amazon Linux 2 in the console, or specify AmazonLinux2 as the EC2 Configuration; which is a new parameter that is also introduced as part of this launch.   Be advised that the previous version, ... Read More

Feed: Planet PostgreSQL. My previous blog on “PostgreSQL High Availability: Considerations and Candidates” mostly talked about defining an HA considerations for PostgreSQL, RPO and RTO and briefly touched on some of the open source solutions available. Granted that I didn’t list them all and people shared some additional ones that I may end up reviewing as well. In case you missed my previous blog, here is the link: https://www.highgo.ca/2020/08/10/postgresql-high-availability-the-considerations-and-candidates/ I think it’ll be unfair to assess the HA solutions available before laying out all core requirements and considerations. So in this blog, without discussing any particular solution, I am going ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Chris Sullivan. By Chris Sullivan, Director, Worldwide Strategic Alliances at AWS For more than a decade, customers have run their most strategic workloads on Amazon Web Services (AWS). This is due to AWS’s experience, maturity, reliability, security, and performance. Strategic workloads running on AWS include applications like SAP, vSphere-based workloads such as VMware Horizon, SharePoint, and Citrix, and databases like Oracle, SQL Server, SAP HANA, and IBM Db2. Additionally, operating systems from Red Hat, SUSE, Canonical, and Microsoft all run on AWS to support vital business processes. As customers have migrated these critical ... Read More

Feed: Cloudwards. Author: Aleksandar Kochovski; Data has become a currency in the modern world, and everyone is out to get your personal information. That’s the case whether it’s your internet service provider (ISP) tracking your online activity, a Silicon Valley giant farming your search information or a nosy government agency looking for suspicious activities. Zero-knowledge cloud storage can help keep your sensitive files away from prying eyes. Zero-knowledge encryption is a way of encrypting your data where only you have access to your encryption key, so no one else can decode it. When it comes to storing files online, zero-knowledge ... Read More

Feed: Planet MySQL; Author: Joshua Otwell; Top n Window Function queries over a specific subset of data are common in analysis and reporting requirements. Luckily, in MySQL, there are Window functions we can use for this type of query. To be quite honest, you don’t necessarily need Window Functions. You can retrieve those top 3 (or whatever) types of results with a regular SQL query. But, since we have those powerful Window Functions, why not use them? My thoughts exactly! Besides, no one wants a spaghetti code mess of SQL to try and understand. Not to mention, Window functions are ... Read More