Tag: S3

Feed: Recent Announcements. Based on the next generation AWS Nitro System, M5n, M5dn, R5n, and R5dn instances make 100 Gbps networking available to network-bound workloads without requiring customers to use custom drivers or recompile applications. Customers can also take advantage of this improved network performance to accelerate data transfer to and from Amazon S3, reducing the data ingestion time for applications and speeding up delivery of results. M5n, M5dn, R5n, R5dn instances are powered by custom second-generation Intel® Xeon® Scalable processors (Cascade Lake) with sustained all-core turbo frequency of 3.1 GHz. They also provide support for the new Intel Vector ... Read More

Feed: Recent Announcements. Amazon Kinesis Data Firehose is the easiest way to load streaming data into data stores and analytics tools. You can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics with existing business intelligence tools you are already using today.  With Amazon Kinesis Data Firehose, you don't need to write applications or manage resources. You configure your data producers to send data to Amazon Kinesis Data Firehose, and it automatically delivers the data to the destination that you specified. You can also configure Amazon Kinesis Data Firehose ... Read More

Feed: AWS Big Data Blog. Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud that offers fast query performance using the same SQL-based tools and business intelligence applications that you use today. Many customers also like to use Amazon Redshift as an extract, transform, and load (ETL) engine to use existing SQL developer skillsets, to quickly migrate pre-existing SQL-based ETL scripts, and—because Amazon Redshift is fully ACID-compliant—as an efficient mechanism to merge change data from source data systems.In this post, I show how to use AWS Step Functions and AWS Glue Python Shell to orchestrate tasks ... Read More

Feed: Recent Announcements. Amazon Kinesis Data Firehose is the easiest way to load streaming data into data stores and analytics tools. You can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics with existing business intelligence tools you are already using today.  With Amazon Kinesis Data Firehose, you don't need to write applications or manage resources. You configure your data producers to send data to Amazon Kinesis Data Firehose, and it automatically delivers the data to the destination that you specified. You can also configure Amazon Kinesis Data Firehose ... Read More

Feed: The Internet of Things on AWS – Official Blog. Author: Dr. Markus Bestehorn. Gaining access to sensor data or telemetry of industrial machines is a key requirement for implementing high-value use cases around smart manufacturing or Industry 4.0. For instance, predictive maintenance or automated quality control is not possible without having such data at a high temporal resolution.Given the heterogeneous environment of modern industrial production lines with many different machine types, it’s difficult to access machine data because the machines’ interfaces may use different protocols. This post provides a detailed look at the conversion of industrial protocols and extracting ... Read More

Feed: AWS Architecture Blog. Amazon Web Services (AWS) serves more than a million private and public sector organizations all over the world from its extensive and expanding global infrastructure.Like other countries, organizations all around New Zealand are using AWS to change the way they operate. For example, Xero, a Wellington-based online accountancy software vendor, now serves customers in more than 100 countries, while the Department of Conservation provides its end users with virtual desktops running in Amazon Workspaces. New Zealand doesn’t currently have a dedicated AWS Region. Geographically, the closest is Asia Pacific (Sydney), which is 2,000 kilometers (km) away, ... Read More

Feed: AWS Big Data Blog. DataSunrise, in their own words: DataSunrise is a database security software company that offers a breadth of security solutions, including data masking (dynamic and static masking), activity monitoring, database firewalls, and sensitive data discovery for various databases. The goal is to protect databases against external and internal threats and vulnerabilities. Customers often choose DataSunrise Database Security because it gives them unified control and a single-user experience when protecting different database engines that run on AWS, including Amazon Redshift, Amazon Aurora, all Amazon RDS database engines, Amazon DynamoDB, and Amazon Athena, among others. DataSunrise Security Suite ... Read More

Feed: R-bloggers. Author: Business Science. ## {html_document} ## ## [1] nn Bikes | Specialized.comn2. Get the Raw Data Use Chrome DevTools to locate the product information. In our case, there is a JSON-like dictionary containing what we need.2.1 Locate Data with Chrome DevTools Find the data by using the hover tool. 2.2 Find Product Data Nodes Find the nodes where the product data lives. 2.3 Filter HTML to Isolate Nodes Copy and paste the class into the html_nodes() function from the rvest library. html %>% html_nodes(".product-list__item-wrapper") 2.4 Find the Attribute That Contains the Data Extract the attributes with the html_attr() ... Read More

Feed: R-bloggers. Author: Alex Levashov. Some time ago I developed a little project that collects Aussie politicians tweets and present several visualizations. It’s available at https://rserv.levashov.biz/shiny/rstudio/ That time I has quite generous credits from AWS, so haven’t worried too much about costs. Unfortunately credits are about to expire, so I had to optimize the tech stack a bit to reduce ongoing costs of running that hobby project. First and easy part was to downsize EC2 instance, I had rather powerful c type instance, which I replaced by t2.medium Since the project isn’t extremely high load, it is good enough. More ... Read More

Feed: AWS Big Data Blog. Last year, AWS introduced EMR Notebooks, a managed notebook environment based on the open-source Jupyter notebook application.This post discusses installing notebook-scoped libraries on a running cluster directly via an EMR Notebook. Before this feature, you had to rely on bootstrap actions or use custom AMI to install additional libraries that are not pre-packaged with the EMR AMI when you provision the cluster. This post also discusses how to use the pre-installed Python libraries available locally within EMR Notebooks to analyze and plot your results. This capability is useful in scenarios in which you don’t have ... Read More