Tag: S3

Feed: Recent Announcements. With this release, Athena workgroup administrators can configure workgroup settings to allow members to reference S3 Requester Pays buckets in queries. Once configured, the requester, instead of the bucket owner, pays for the Amazon S3 request and data transfer costs associated with the query.  For information about how to configure this setting for your workgroup, Create a Workgroup in the Amazon Athena User Guide. For more information about Requester Pays buckets, see Requester Pays Buckets in the Amazon Simple Storage Service Developer Guide.  ... Read More

Feed: AWS Big Data Blog. Data lakes are an increasingly popular way to aggregate, store, and analyze both structured and unstructured data. AWS Lake Formation makes it easy for you to set up, secure, and manage your data lakes.In Part 1 of this post series, you learned how to create and explore a data lake using Lake Formation. This post walks you through data discovery using the metadata search capabilities of Lake Formation in the console, and metadata search results restricted by column permissions. Prerequisites For this post, you need the following: Metadata search in the console In this post, ... Read More

Feed: Recent Announcements. Amazon FSx for Lustre provides a high-performance file system optimized for fast processing of workloads such as machine learning, high performance computing (HPC), video processing, financial modeling, and electronic design automation (EDA). Amazon FSx for Lustre file systems can be configured as standalone file systems or can be linked to an Amazon S3 bucket. When linked to an S3 bucket, an FSx for Lustre file system transparently presents S3 objects as files and allows you to write results back to S3, making it easy for you to process cloud data sets on S3 using a high-performance file ... Read More

Feed: DivvyCloud. Author: David Mundy; by David Mundy | Aug 15, 2019 | Product Information Feature Release 19.3: Secure S3 Buckets, Microsoft Teams, & Compliance Heat Map  We are excited to announce our newest release of 2019 which continues our mission to help you effectively leverage CSP security and management tools like AWS’ “GET BucketPolicyStatus”... by David Mundy | Aug 6, 2019 | Product Information, Security DivvyCloud is IT World Awards 2019 Silver Winner in Cloud Security We are honored to announce that DivvyCloud is the silver winner of Network Product Guide’s 2019 IT World Award for Cloud Security. The ... Read More

Feed: Recent Announcements. AWS SFTP is a fully managed, highly available service, which works with your existing SFTP applications and automatically scales with your workloads. With AWS SFTP, your end users’ workflows remain unchanged, while data uploaded and downloaded over SFTP is stored in your Amazon S3 bucket. You can use AWS SFTP with a data lake to enable processing, analytics, machine learning, and archival in AWS.  ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. Announcing the immediate availability of Db2 Big SQL on Cloudera’s platform, CDH v6.2.  Extending the recent support on CDH v5, Db2 Big SQL will now add support to Cloudera Distributed Hadoop (CDH) v6.2 platform along with Hortonworks Data Platform (HDP) v2.6 & v3.1. Db2 Big SQL is an advanced SQL engine optimized for advanced analytics in a Big Data environment. IBM infuses the power of industry leading Db2 in open source technologies for machine learning, interactive, adhoc and batch analytics use cases.  The core capabilites of a mature SQL engine brings enterprise SQL capabilies to Big Data platform ... Read More

Feed: Planet big data. Author: Praveen Sripati. Disclosure : The intention is NOT to help others hack, but to make sure they can secure their applications built on top of AWS or some other Cloud. A few mitigations to fix the SSRF vulnerability have been mentioned towards the end of the blog. Introduction  Capital One hosted their Services on AWS and it was hacked (, ). It's a feature in AWS which was exploited and a misconfiguration done by the Capital One which caused the hack by an ex-AWS employee. The information about the hack was every where in the ... Read More

Feed: DivvyCloud. Author: David Mundy; by David Mundy | Aug 14, 2019 | Blog Post, Public Sector, Security Government Institutions Risk Data Breaches by Avoiding Cloud Security Automation DivvyCloud co-founder and CTO, Chris DeRamus, recently published an article with HomelandSecurityToday.us on why cloud automation is the antidote for government agencies plagued by... by David Mundy | Aug 6, 2019 | Product Information, Security DivvyCloud is IT World Awards 2019 Silver Winner in Cloud Security We are honored to announce that DivvyCloud is the silver winner of Network Product Guide’s 2019 IT World Award for Cloud Security. The IT World Awards ... Read More

Feed: AWS Big Data Blog. Data lakes are an increasingly popular way to create a single repository to store and analyze both structured and unstructured data. AWS Lake Formation makes it easy for you to set up, secure, and manage data lakes. This post walks you through the creation and exploration of a data lake using Lake Formation:Creating the data lake o  Adding data to your data lake o  Creating catalog databases o  Adding tables from Amazon S3 to catalog databases Editing and adding metadata within the catalog o  Editing standard metadata o  Adding custom metadata Prerequisites For this post, ... Read More

Feed: Recent Announcements. PostgreSQL extension pgaudit has been updated to 1.3.0, to 1.3.2, pglogical to 2.2.1, PLV8 to 2.3.8, PostGIS to 2.5.1, prefix to 1.2.8, and wal2json to hash 9e962ba. A new extension pgTAP, a suite of database functions that make it easy to write unit tests in psql script, is added and supported with PostgreSQL version 11.2 and above. Extension pg_hint_plan has been updated to 1.3.2 for PostgreSQL versions 11, 10, 9.6 and 9.5. Please refer to the documentation for the various extensions and modules supported in various RDS PostgreSQL versions.  Amazon S3 Import feature is now available for ... Read More