Category: Big Data

Feed: AWS Big Data Blog. Amazon Redshift is a fast, scalable, secure, and fully-managed cloud data warehouse that makes it simple and cost-effective to analyze all of your data using standard SQL. Amazon Redshift has comprehensive security capabilities to satisfy the most demanding requirements. To help you to monitor the database for security and troubleshooting purposes, Amazon Redshift logs information about connections and user activities in your database. This process is called database auditing. Amazon Redshift Audit Logging is good for troubleshooting, monitoring, and security purposes, making it possible to determine suspicious queries by checking the connections and user logs ... Read More

Feed: AWS Big Data Blog. Amazon QuickSight is a fully-managed, cloud-native business intelligence (BI) service that makes it easy to connect to your data, create interactive dashboards, and share these with tens of thousands of users, either within the QuickSight interface or embedded in software as a service (SaaS) applications or web portals. With QuickSight providing insights to power your daily decisions, it becomes more important than even for administrators and developers to ensure their QuickSight dashboards and data refreshes are operating smoothly as expected. We recently announced the availability of QuickSight metrics within Amazon CloudWatch, which enables developers and ... Read More

Feed: Cloudera Blog. Author: Gino Gemignani. Posted in Culture | July 01, 2022 5 min read For this month’s #ClouderaLife Spotlight we did something a little different. In celebration of Pride Month, we sat down with two Clouderans who are influential in the company’s LGBTQ+ community: Autymn Harris and Jonathan Sanford. In this Q&A discussion, we asked them about their roles at Cloudera and what the LGBTQ+ resource groups are up to for Cloudera Pride celebrations. We then got into an informative discussion around important issues within the greater community to think about and suggest ways to take action.  So ... Read More

Feed: AWS Big Data Blog. Amazon Keyspaces (for Apache Cassandra) is a scalable, highly available, and managed Apache Cassandra–compatible database service. With Amazon Keyspaces you don’t have to provision, patch, or manage servers, and you don’t have to install, maintain, or operate software. Amazon Keyspaces is serverless, so you only pay for the resources that you use and the service can automatically scale tables up and down in response to application traffic. You can use Amazon Keyspaces to store large volumes of data, such as entries in a log file or the message history for a chat application as Amazon ... Read More

Feed: The Internet of Things on AWS – Official Blog. Author: Prashanth Shankar Kumar. Introduction In today’s market, business success often lies in the ability to glean accurate insights and prediction. However, floor engineers and analysts have a hard time getting the information at the right instance to make an informed decision when there is a failure during operations. To make it easy to detect and respond to events from IoT sensors and applications, AWS IoT Events allows you to detect events across thousands of IoT sensors sending different telemetry data. Events are patterns of data that could help identify ... Read More

Feed: Alation. Author: Michael Meyer. June 30, 2022 — As important as the responsibilities of a data curator are to self-service analytics, data curation best practices are still in their infancy. The evolution of communications technologies created an environment ripe for evolving the methods and features of the activity of curation. And as new technology allowed for more publishers and created a higher volume of content, information curation thrived. We are now seeing a similar transformation in the world of data, where there’s tension between the old world (single-source-of-truth data warehouses with top-down data governance) and the new world (distributed, ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Gabriel Paredes Loza. By Gabriel Paredes Loza, Business Unit Manager (IoT) — Storm ReplyBy Nicolas Corpancho Villasana, Sr. Solutions Architect — Storm Reply Storm Reply Today, more than ever, governments and businesses require the promotion of solutions targeting the measurement and impact of their efforts on sustainability as part of their agenda. Achieving Sustainable Development Goals (SDGs) requires a holistic and informed approach in the measurement, test, study, and research of real use cases. Firms spend substantial efforts in the identification and collection of quality data streams from different sources, such as IoT ... Read More

Feed: SAS Blogs. Author: Joao Oliveira. You’ve probably heard of DevOps, but do you know about DataOps? It builds on the DevOps approach to provide huge benefits in unlocking business value from data. Many people have heard of DevOps, even if they don’t know precisely what it means. It is an agile approach to software development, which brings together the development and testing processes. This is designed to shorten the development life cycle, and improve the quality of the software. However, what do we mean by DataOps? Unlocking business value more consistently with DataOps Understanding DataOps Like DevOps, DataOps borrows ... Read More

Feed: Journey to AI Blog; Author: Gustavo Espinosa Barrajon; The rise of data strategy There’s a renewed interest in reflecting on what can and should be done with data, how to accomplish those goals and how to check for data strategy alignment with business objectives. The amazing evolution of technology, cloud and analytics—and what it means for data use — changes quickly, which makes it easy to fall behind if your data strategy and related processes aren’t frequently revisited. From multicloud and multidata to multiprocess and multitechnology, we live in a multi-everything landscape. Luckily, today’s data management approaches aren’t limited ... Read More

Feed: Cloudera Blog. Author: Bill Zhang. Posted in Technical | June 30, 2022 5 min read We are excited to announce the general availability of Apache Iceberg in Cloudera Data Platform (CDP). Iceberg is a 100% open table format, developed through the Apache Software Foundation, and helps users avoid vendor lock-in. Today’s general availability announcement covers Iceberg running within key data services in the Cloudera Data Platform (CDP)—including Cloudera Data Warehousing (CDW), Cloudera Data Engineering (CDE), and Cloudera Machine Learning (CML). These tools empower analysts and data scientists to easily collaborate on the same data, with their choice of tools ... Read More