Tag: workflow

Feed: What's New. You can now use Python scripts in AWS Glue to run small to medium-sized generic tasks that are often part of an ETL (extract, transform, and load) workflow. Previously, AWS Glue jobs were limited to those that ran in a serverless Apache Spark environment. You can now use Python shell jobs, for example, to submit SQL queries to services such as Amazon Redshift, Amazon Athena, or Amazon EMR, or run machine-learning and scientific analyses ... Read More

Feed: The Connector by Workato. Author: Bhaskar Roy; Like any technology, automation is constantly evolving. In 2018, for example, we watched the rise of robotic process automation (RPA) and the incorporation of cognitive technologies like AI. As we move into 2019, which of these trends will remain relevant—and what will be the state of automation be next January? Here are five automation trends worth keeping an eye on. 1. A stronger focus on delivering high-quality experiences quickly, not just automating away rote work. Initially, businesses saw automation as a means of eliminating repetitive, manual tasks—and this perspective still dominates today ... Read More

Feed: What's New. Amazon Redshift's sophisticated query planner uses a table's statistical metadata to choose the optimal query execution plan for better query performance. The analyze operation generates or updates the table statistics. With this update, you no longer need to explicitly run the ANALYZE command. If you do run it as part of your extract, transform, and load (ETL) workflow, automatic analyze skips tables with up-to-date statistics. Similarly, an explicit ANALYZE skips tables with up-to-date table statistics. For more information, see Automatic Analyze in the Amazon Redshift Database Developer Guide. Automatic Analyze is now available with the release version ... Read More

Feed: R-bloggers. Author: hfrick. Last week RStudio hosted their conference, rstudio::conf, in Austin and a whole lot of members of the R community came to see what’s new, where the community and the field might be heading and to enjoy tacos. R in production A major theme from this conference was R in production. Joe Cheng kicked this one off in his keynote about Shiny in production, presenting how the answer to “Can Shiny be used for production?” changed from “Yes, it’s quite possible” (in 2015) to “Yes, it’s quite easy” (in 2019). Of course, it isn’t all easy yet. There are still cultural challenges ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: William Vorhies. Summary: The world of healthcare may look like the most fertile field for AI/ML apps but in practice it’s fraught with barriers.  These range from cultural differences, to the failure of developers to really understand the environment they are trying to enhance, to regulatory and logical Catch 22s that work against adoption.  Part 3 of 3. According to data compiled by research firm Startup Health funding for digital healthcare totaled $14.6 billion in 2018.  The world of healthcare may look like the most fertile field for AI/ML apps but ... Read More

Feed: R-bloggers. Author: Jozef's Rblog. Including R Markdown in the workflow for presenting and publishing analyses that use code in R or other languages is a great way to make presentations, dashboards or reports good looking, reproducible and version controllable. In this post, we will look at three simple ways to improve that workflow even further with methods that are lesser known and can make producing results with R Markdown more efficient and reviewing them more interactive. If you are familiar with R notebooks, you probably know that as you edit the notebook in RStudio and save, the preview will ... Read More

Feed: The Internet of Things on AWS – Official Blog. Author: Philipp Sacha. Customers are building globally distributed IoT solutions with AWS IoT. A device that connects to AWS IoT must be provisioned in an AWS Region. However, when devices are shipped globally, you don’t know in which AWS IoT Region the device will connect when it starts operation. In this blog post, I will describe a global AWS IoT device provisioning process.Provisioning an IoT device A device must be provisioned to work with AWS IoT Core. To provision a device: The device should be created as a thing in ... Read More

Feed: Big Data Made Simple. Author: Nataliia Kharchenko. You would probably already know that big data analytics is a trend that has been gaining momentum in a variety of fields. And it is actively used in digital technology development. Huge data volumes are processed every day by machines to help us get a result that we need.Today, big data can be used in completely different sectors. Including the real estate sector. But if you’re asking questions like – what is the potential of big data in the real estate sector? Why is data analytics needed and what are its advantages? ... Read More

Feed: AWS Compute Blog. Author: Chris Munns. This post is courtesy of Eric Johnson, Senior Developer Advocate – AWS ServerlessWelcome to the fourth edition of the AWS Serverless ICYMI (in case you missed it) quarterly recap. Every quarter, we share all of the most recent product launches, feature enhancements, blog posts, webinars, Twitch live streams, and other interesting things that you might have missed! This edition of ICYMI includes all announcements from AWS re:Invent 2018! If you didn’t see them, check our Q1 ICYMI, Q2 ICYMI, and Q3 ICYMI posts for what happened then. So, what might you have missed this past quarter? ... Read More

Feed: What's New. Author: Keshia Rose. Do you want to be the first to see the latest features being built? Are you interested in shaping future releases of Tableau? These perks, including unique access to the Tableau Engineering team, are a part of the brand-new Tableau Developer Program. We are looking for the best and brightest of the community to be a part of the development process, testing and prototyping with experimental APIs as well as existing APIs. With this new Developer Program, you can unleash your creativity and build even more powerful solutions, rich integrations with third-party services, and ... Read More