Tag: Cloudera

Feed: CDH – Cloudera Engineering Blog. Author: Tom Wheeler. For a user-facing system like Apache Impala, bad performance and downtime can have serious negative impacts on your business. Given the complexity of the system and all the moving parts, troubleshooting can be time-consuming and overwhelming. In this blog post series, we are going to show how the charts and metrics on Cloudera Manager (CM) can help troubleshoot Impala performance issues. They can also help to monitor the system to predict and prevent future outages. CM provides a comprehensive suite of time-series and pre-aggregated metrics and charts at varying levels of ... Read More

Feed: Cloud – Cloudera Engineering Blog. Author: Tom Wheeler. Cloudera now provides a pathway for migrating an Altus Director managed cluster to a cluster that takes advantage of other Cloudera Altus cloud services. This blog post will outline how to do that. SDX for Cloudera Altus persists both Apache Hive metadata and Apache Sentry data access policies independently from clusters in SDX namespaces. In this way, SDX for Cloudera Altus provides the missing link to share Altus Director managed workload with Altus cloud services. Separating metadata from the compute resources enables transient workloads and users never have to worry about ... Read More

Feed: Teradata Blog. As 2018 comes to a close, it's time to start thinking about the future of technology and what technological advances will be on the horizon in the coming year. Teradata's experts have compiled a list of their predictions for 2019 in the areas of artificial intelligence, data and analytics, connected cars, security, blockchain, the cloud and much more. Take a look at their predictions and share your own with us on our social channels @Teradata.   Todd Walter, Teradata's chief technologist  Currently, we’re in early days of an emerging market of connected cars. There are many things to ... Read More

Feed: Actian. Author: John Bard. Actian DataFlow is a parallel workflow platform for end-to-end data access, transformation, preparation, and predictive analysis that eliminates performance bottlenecks in your data-intensive applications.  Complementary to the Actian Vector analytic database, DataFlow leverages concurrency, parallelism and pipelining to accelerate data movement between locations in your data architecture, creating faster results.  DataFlow eliminates memory constraints, as well as the need for data movement into specific data stores before analytics are run. DataFlow understands the available resources before breaking up the execution into smaller chunks that can be run in parallel to take maximum advantage of horizontal ... Read More

Feed: Cloud – Cloudera Engineering Blog. Author: Tom Wheeler. At Cloudera, we spend our time helping customers benefit from data. We help them with different types of data—structured, semi-structured, or raw unstructured. We also help them implement solutions for storing, tracing, securing, processing, enriching, analyzing, and visualizing it. Over the past several years, we’ve observed that customers are increasingly working with their data in the cloud, and Microsoft’s Azure cloud service is a popular deployment option. Cloudera University is pleased to announce a free course, built in collaboration with Microsoft and offered through our OnDemand learning platform, which will teach ... Read More

Feed: CDH – Cloudera Engineering Blog. Author: Tom Wheeler. In mid-2017, we were working with one of the world’s largest healthcare companies to put a new data application into production. The customer had grown through acquisition and in order to maintain compliance with the FDA, they needed to aggregate data in real-time from dozens of different divisions of the company. The consumers of this application, of course, did not care how we built the data pipeline. However, they cared greatly that if it broke, and the end-users did not get their data, they would be out of compliance and could ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Antonio Cachuan. It’s not a secret that containers technology (popularly known as dockers) is becoming one of the top choices in software projects [1], but What about data projects/clusters? Many companies and projects have intentions to take advantages of it. Some examples are Cloudera [2] and the apache-spark-on-k8s project [3], personally, I suggest if you want more information as what exactly is called “Big Data as a Service” to check the last Strata Data Conference [4] of Anant Chintamaneni and Nanda Vijaydev (BlueData). In this article, I will guide you with ... Read More

Feed: CDH – Cloudera Engineering Blog. Author: Tom Wheeler. Two new strains of malware–XBash and DemonBot–are targeting Apache Hadoop servers for Bitcoin mining and DDOS purposes. This malware is scanning the internet so vigorously for Hadoop clusters that an infection can occur within minutes of an insecure cluster being placed on the open internet. This blog post describes the mechanism this malware uses and offers specific actions to protect your Hadoop-based clusters. A History of Hadoop Malware Roughly two years ago there were a spate of attacks against the open source database solution MongoDB, as well as Hadoop. These attacks were ransomware: the ... Read More

Feed: AWS Big Data Blog. Since we launched Amazon Redshift, thousands of customers have trusted us to get uncompromising speed for their most complex analytical workloads. Over the course of 2017, our customers benefited from a 3x to 5x performance gain, resulting from short query acceleration, result caching, late materialization, and many other under-the-hood improvements. In this post, we highlight recent improvements to Amazon Redshift and how our continued focus on performance enhancements is benefiting customers. We also discuss performance testing derived from industry-standard benchmarks that help us measure the impact of these ongoing improvements.Recent performance improvements With the largest ... Read More

Feed: Planet big data. Author: David Smith. A monthly roundup of news about Artificial Intelligence, Machine Learning and Data Science. This is an eclectic collection of interesting blog posts, software announcements and data applications from Microsoft and elsewhere that I've noted over the past month or so. Open Source AI, ML & Data Science News PyTorch 1.0 is now in preview, and brings a streamlined workflow from model development to production. Relatedly, Sam Charrington compares the growing PyTorch ecosystem with that of Tensorflow. Tensorflow 1.11 is released, with binaries for cuDNN 7.2 and TensorRT 4, and new functions for querying ... Read More