Tag: S3

Feed: AWS Big Data Blog. When we first looked into the possibility of building a cloud-based data warehouse many years ago, we were struck by the fact that our customers were storing ever-increasing amounts of data, and yet only a small fraction of that data ever made it into a data warehouse or Hadoop system for analysis. We saw that this wasn’t just a cloud-specific anomaly. It was also true in the broader industry, where the growth rate of the enterprise storage market segment greatly surpassed that of the data warehousing market segment.We dubbed this the “dark data” problem. Our ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Barbara Kessler. Continuing our MSP Partner Spotlight series from last week’s post, Unlocking Hybrid Architecture’s Potential with DevOps, automation is another critical area of capability for next generation Managed Service Providers (MSPs). Automation incorporating elements such as configuration templates, code deployment automation, and self-healing infrastructure reduces the need for manual interventions, the potential for errors, and the operating costs for MSPs.  This week we hear from Cloudreach (APN Premier and MSP Partner, with numerous AWS Competencies) and their perspective on the value of automation in the cloud. Automation in the Cloud By: Neil ... Read More

Feed: IDERA Community Blog; Author: Vicky Harp; On Monday, June 12, 2017, a security researcher discovered that sensitive personal data of nearly all the 200 million registered voters from the USA was left exposed to the Internet. The owner stored the data on a publicly accessible cloud server -- Amazon Simple Storage Service (S3) object storage -- without any protection against public access. Consequently, anyone with an Internet connection could have accessed the data, simply by navigating to a six-character subdomain of Amazon. S3 is notorious for being left unlocked to the public, even by some of the largest organizations ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: jessica-lee; Data is a potent business resource and the key to gaining and maintaining competitive advantage. Last month, IBM and Hortonworks announced a partnership to bring data science to the world on an open platform, offering Hortonworks Data Platform (HDP) along with IBM Data Science Experience (DSX) and IBM Big SQL to help everyone from data scientists to business leaders better analyze and manage their data and accelerate data-driven decision making. This collaboration marks the coming together of an industry leading 100% open source Hadoop distribution, an innovative data ... Read More

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. From introductory material to in-depth architectures, the AWS Public Sector Summit featured sessions relevant to healthcare and life science researchers.The full set of session videos are located here, along with slides to match, but in this post, we will recap healthcare and life sciences sessions with a focus on our customers, such as the American Heart Association, the NIH National Institute for Allergy and Infectious Diseases, and the National Marrow Donor Program, and how they use the AWS Cloud to unlock the value of data and share insights. Harmonize, Search, Analyze, ... Read More

Feed: Planet MySQL. Author: Sean Hull. via GIPHY Amazon releases a new database offering every other day. It sure isn’t easy to keep up. Join 35,000 others and follow Sean Hull on twitter @hullsean. Let’s say you’re hiring a devops & you want to suss out their database knowledge? Or you’re hiring a professional services firm or freelance consultant. Whatever the case you’ll need to sift through for the best people. Here’s how. Also: How to interview an AWS expert What database does Amazon support for caching? Caching is a popular way to speed up access to your backend database ... Read More

Feed: What's New. The new console shown in the screenshot below offers an intuitive wizard to quickly create delivery streams, graphics to easily understand the data flow for each destination (Amazon S3, Amazon Redshift, and Amazon Elasticsearch Service), a simple way to include AWS Lambda functions for data transformation, and an overall improved interface.  Kinesis Firehose is available in US East (N. Virginia), US West (Oregon), and EU (Ireland) regions. To get started, create a delivery stream in the console or explore the Kinesis Firehose developer guide.  ... Read More

Feed: What's New. AWS CloudTrail S3 Data Events allow you to record API actions on Amazon S3 objects and receive detailed information such as the AWS account of the caller, IAM user role of the caller, time of the API call, IP address of the API, and other details. You can programmatically access and act upon the Data Events after they are delivered to an Amazon S3 bucket or to Amazon CloudWatch Events. For example, you can quickly reapply the original Access Control List (ACL) on an object if the ACL of an object is modified.  ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Peter Williams. Learn now Financial Services partners like IHS Markit are using AWS to address financial regulatory requirements for financial risk management. FRTB Regulation New Basel financial risk regulations released in 2016 are transforming global bank risk systems. In January 2016, the Basel Committee on Banking Supervision published the Fundamental Review of the Trading Book (FRTB) standards, which introduced a new approach to evaluating risk across asset holdings, and will be mandated by 2020. The FRTB regulation establishes a new expected shortfall (ES) measurement of risk under stress, which replaces previous value-at-risk (VaR) based models ... Read More

Feed: AWS Big Data Blog. Many customers have taken advantage of the numerous benefits of running Apache HBase on Amazon S3 for data storage, including lower costs, data durability, and easier scalability. Customers such as FINRA have lowered their costs by 60% by moving to an HBase on S3 architecture along with the numerous operational benefits that come with decoupling storage from compute and using S3 as the storage layer. HBase on S3 allows you to turn on a cluster and immediately start querying against data within S3 rather than having to go through a lengthy snapshot restore process.With the ... Read More