Tag: S3

Feed: AWS Partner Network (APN) Blog. Author: AWS Admin. By Bojana Dobran, Senior Marketing Specialist at phoenixNAPThe growing need for business agility has redefined IT at the organizational and infrastructure levels. Building an agile IT architecture that can quickly adapt to business needs and support dynamic teams has become a critical focus in most modern organizations. An agile infrastructure is fast, robust, and easily scalable. Its creation usually involves collaboration between NetOps, DevOps, and SecOps teams—all of whom need to ensure the infrastructure is capable of handling bandwidth-heavy workloads, delivering uninterrupted connectivity, and transferring data quickly and safely. As a ... Read More

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. In many organisations, IT security and data governance processes can be complex since data is stored across multiple environments and applications. Data privacy, including data classification, is now a core component of security requirements. Organisations need an easier and more pragmatic approach in administering their data assets to mitigate operational risk.Mandatory data privacy regulations, including General Data Protection Regulation (GDPR), Health Insurance Portability and Accountability Act (HIPAA), and Information Security Manual (ISM) data stores were administered by IT security based on their environment, application, group of users, and/or use cases. Now, ... Read More

Feed: Teradata Blog. I have often been accused of putting everything through the lens of data and analytics.  Many of my long-time followers know of my fondness for finding quotes or pithy sayings from movies, books, and everyday life that reinforce the message of leveraging data to drive a better outcome.One such idea is from the book Robopocalypse by Daniel H. Wilson.  The gist of the story is that a computer achieves intelligence and quickly determines humans are the problem with the world, and you may have guessed, fun and hilarity do not ensue.  The part I love is the ... Read More

Feed: What's New. For each Workgroup, you can also view aggregated query-related metrics in AWS CloudWatch, and mandate Workgroup settings that apply to all queries running in the Workgroup. Examples of such settings include Amazon S3 locations where results are stored and encryption options. You can enforce cost controls by creating data usage controls that apply to all queries running in a Workgroup. For each Workgroup, you can set two categories of data usage controls. The first is set on the amount of data scanned per-query, enforced on a running query. If a query crosses a certain predefined threshold, Athena ... Read More

Feed: AWS Compute Blog. Author: Anuneet Kumar. This post is contributed by Adam McLean – Solutions Developer at AWS and Chirill Cucereavii – Application Architect at AWS In this post, we show you how to automatically refresh the container instances in an active Amazon Elastic Container Service (ECS) cluster with instances built from a newly released AMI. The Amazon ECS-optimized AMI  comes prepackaged with the ECS container agent, Docker agent, and the ecs-init upstart service. We recommend that you use the Amazon ECS-optimized AMI for your container instances unless your application requires any of the following: A specific operating system Custom security and monitoring agents installed ... Read More

Feed: What's New. FSx for Lustre provides high-performance file systems that are optimized for machine learning, analytics, high performance computing, and media processing workloads. These workloads commonly require data to be presented via a fast and scalable POSIX-compliant file system interface, and commonly have input data sets that are stored on durable, long-term data stores like Amazon S3. With AWS CloudFormation you can use deployment templates to quickly and easily spin up an FSx for Lustre file system linked to your Amazon S3 bucket, provision EC2 compute resources to process data on your file system, and spin down the entire ... Read More

Feed: What's New. AWS SFTP is a fully managed, highly available service, which works with your existing SFTP applications and automatically scales with your workloads. With AWS SFTP, your end users’ workflows remain unchanged, while data uploaded and downloaded over SFTP is stored in your Amazon S3 bucket. You can use AWS SFTP with a data lake to enable processing, analytics, machine learning, and archival in AWS. With this announcement, AWS SFTP is now available in a total of 14 AWS Regions: US East (N. Virginia) US East (Ohio) US West (Oregon)  US West (N. California) Canada (Central)  Europe (Ireland) ... Read More

Feed: What's New. Now customers can customize the Amazon S3 prefix using the Apache Hive format and timestamp formats (supported by the Java DateTimeFormatter class).   For a list of regions where Amazon Kinesis Data Firehose is available, see the AWS Region Table ... Read More

Feed: AWS Big Data Blog. Climate Change continues to have a profound effect on our quality of life. As a result, the investigation into sustainability is growing. Researchers in both the public and private sector are planning for the future by studying recorded climate history and using climate forecast models.To help explain these concepts, this post introduces the Global Historical Climatology Network Daily (GHCN-D). This registry is used by the global climate change research community. This post also provides a step-by-step demonstration of how Amazon Web Services (AWS) services improve access to this data for climate change research. Data scientists ... Read More

Feed: Cloudera Engineering Blog. Author: Tom Wheeler. In the last few years, IT security threats to enterprise systems have increased, which has necessitated installing log ingestion and analysis solutions in any enterprise network. This blog post illustrates how Cloudera built its own scalable solution for log ingestion and analytics using Apache Spot and Cloudera Altus. By leveraging transient workloads in the cloud, Cloudera reduced the solution’s operational costs by 50% when compared to traditional, persistent cluster approaches. At Cloudera, the Infosec team needed to build a centralized log ingestion and analytical solution to monitor all key systems in the company ... Read More