- Home
- Tag: step
Posts tagged step
Amazon EMR: A single function applied to the data in a job flow. The sum of all steps comprises a job flow.
Tag: step
Introducing the new AWS Step Functions Workflows Collection

Feed: AWS Compute Blog. Author: Benjamin Smith. Today, the AWS Serverless Developer Advocate team introduces the Step Functions Workflows Collection, a fresh experience that makes it easier to discover, deploy, and share Step Functions workflows. Builders create Step Functions workflows to orchestrate multiple services into business-critical applications with minimal code. Customers were looking for opinionated templates that implement best practices for building serverless applications with Step Functions. This blog post explains what Step Functions workflows are and what challenges they help solve. It shows how to use the new Step Functions workflows collection to find simple “building blocks”, reusable patterns, ... Read More
Building a low-code speech “you know” counter using AWS Step Functions

Feed: AWS Compute Blog. Author: Julian Wood. This post is written by Doug Toppin, Software Development Engineer, and Kishore Dhamodaran, Solutions Architect. In public speaking, filler phrases can distract the audience and reduce the value and impact of what you are telling them. Reviewing recordings of presentations can be helpful to determine whether presenters are using filler phrases. Instead of manually reviewing prior recordings, automation can process media files and perform a speech-to-text function. That text can then be processed to report on the use of filler phrases. This blog explains how to use AWS Step Functions, Amazon EventBridge, Amazon ... Read More
Orchestrating AWS Glue crawlers using AWS Step Functions

Feed: AWS Compute Blog. Author: Benjamin Smith. This blog post is written by Justin Callison, General Manager, AWS Workflow. Organizations generate terabytes of data every day in a variety of semistructured formats. AWS Glue and Amazon Athena can give you a simpler and more cost-effective way to analyze this data with no infrastructure to manage. AWS Glue crawlers identify the schema of your data and manage the metadata required to analyze the data in place, without the need to transform this data and load into a data warehouse. The timing of when your crawlers run and complete is important. You ... Read More
Combining Amazon AppFlow with AWS Step Functions to maximize application integration benefits

Feed: AWS Compute Blog. Author: James Beswick. This post is written by Ahmad Aboushady, Senior Technical Account Manager and Kamen Sharlandjiev, Senior Specialist Solution Architect, Integration. In this blog post, you learn how to orchestrate AWS service integrations to reduce the manual steps in your workflow. The example uses AWS Step Functions SDK integration to integrate Amazon AppFlow and AWS Glue catalog without writing custom code. It automatically uses Amazon EventBridge to trigger Step Functions every time a new Amazon AppFlow flow finishes running. Amazon AppFlow enables customers to transfer data securely between software as a service (SaaS) applications, like Salesforce, SAP, Zendesk, Slack, ServiceNow, and ... Read More
AWS Step Functions launches an interactive workshop for building and deploying application workflows
Feed: Recent Announcements. You can now learn to use AWS Step Functions with a new workshop called The AWS Step Functions Workshop. This self-paced tutorial teaches you how to use the primary features of Step Functions through a series of interactive modules. Each module contains lesson materials you can deploy to your AWS account, covering topics such as coordinating and orchestrating application workflows, managing workflow states, creating SDK integrations with other AWS services, and more. AWS Step Functions is a low-code, visual workflow service that you can use to connect to over 220 AWS services and 10,000 API actions. Developers ... Read More
Testing Amazon EventBridge events using AWS Step Functions

Feed: AWS Compute Blog. Author: James Beswick. This post is written by Siarhei Kazhura, Solutions Architect and Riaz Panjwani, Solutions Architect. Amazon EventBridge is a serverless event bus that can be used to ingest and process events from a variety of sources, such as AWS services and SaaS applications. With EventBridge, developers can build loosely coupled and independently scalable event-driven applications. It can be useful to know with EventBridge when events are not able to reach the desired destination. This can be caused by multiple factors, such as: Event pattern does not match the event rule Event transformer failure Event ... Read More
Orchestrate big data jobs on on-premises clusters with AWS Step Functions

Feed: AWS Big Data Blog. Customers with specific needs to run big data compute jobs on an on-premises infrastructure often require a scalable orchestration solution. For large-scale distributed compute clusters, the orchestration of jobs must be scalable to maximize their utilization, while at the same time remain resilient to any failures to prevent blocking the ever-growing influx of data and jobs. Moreover, on-premises compute resources can’t be extended on demand, therefore, the jobs may be competing for the same resources with different priorities. This post showcases serverless building blocks for orchestrating big data jobs using AWS Step Functions, AWS Lambda, ... Read More
Announcing new workflow observability features for AWS Step Functions
Feed: Recent Announcements. AWS Step Functions now provides a new console experience for viewing and debugging your workflow executions that makes it easier to search, filter, and root cause issues in your executions. AWS Step Functions is a low-code, visual workflow service that can be used to connect over 220 AWS services and 10,000 API actions to build applications using workflows. AWS Step Functions stores a detailed history for every execution so that you can view the path of execution, audit each transaction, and debug failures. Now, Step Functions makes it easier to navigate through the details of your workflow executions ... Read More
Debugging AWS Step Functions executions with the new console experience

Feed: AWS Compute Blog. Author: Benjamin Smith. Today, AWS Step Functions introduces a new opt-in console experience that makes it easier to analyze, debug, and optimize Standard Workflows. Builders create Step Functions workflows to orchestrate multiple services into business-critical applications with minimal code. Customers wanted better ways to debug workflow executions and analyze the payload as it passes through each state. This blog post explains the new capabilities of the enhanced Step Functions executions page. It shows how to debug workflows quickly, sort and filter on state events, and view the input and output path processing for each state. Overview ... Read More
Orchestrating Amazon S3 Glacier Deep Archive object retrieval using AWS Step Functions

Feed: AWS Compute Blog. Author: Eric Johnson. This blog was written by Monica Cortes Sack, Solutions Architect, Oskar Neumann, Partner Solutions Architect, and Dhiraj Mahapatro, Principal Specialist SA, Serverless. AWS Step Functions now support over 220 services and over 10,000 AWS API actions. This enables you to use the AWS SDK integration directly instead of writing an AWS Lambda function as a proxy. One such service integration is with Amazon S3. Currently, you write scripts using AWS CLI S3 commands to achieve automation around running S3 tasks. For example, S3 integrates with AWS Transfer Family, builds a custom security check, takes action on ... Read More
Recent Comments