Tag: Classification

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. In a fast-moving project like Apache Hadoop, there are always exciting new features introduced in each release. While it is tempting to make the most of these new features by upgrading to the latest release, users are often concerned about their code continuing to run. In this post, you’ll get an overview of the the Hadoop API annotations and compatibility policies. Hadoop annotates specific APIs to be safe for use by end-users. By using these APIs, users can ensure their code works across a set of releases and be aware of ... Read More

Feed: R-bloggers. Author: Fabio Veronesi. Power analysis is extremely important in statistics since it allows us to calculate how many chances we have of obtaining realistic results. Sometimes researchers tend to underestimate this aspect and they are just interested in obtaining significant p-values. The problem with this is that a significance level of 0.05 does not necessarily mean that what you are observing is real.In the book “Statistics Done Wrong” by Alex Reinhart (which you can read for free here: https://www.statisticsdonewrong.com/) this problem is discussed with an example where we can clearly see that a significance of 0.05 does not mean that ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Amelia Matteson. This article was written by Michael Rundell. A Curated List of Data Science Interview Questions Preparing for an interview is not easy – naturally there is a large amount of uncertainty regarding the data science interview questions you will be asked. No matter how much work experience or technical skill you have, an interviewer can throw you off with a set of questions that you didn’t expect. For a data science interview, an interviewer will ask questions spanning a wide range of topics, requiring strong technical knowledge and communication ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. In December 2012, we described how an internal application built on CDH called Cloudera Support Interface (CSI), which drastically improves Cloudera’s ability to optimally support our customers, is a unique and instructive use case for Apache Hadoop. In this post, we’ll follow up by describing two new differentiating CSI capabilities that have made Cloudera Support yet more responsive for customers: How Cloudera Impala has turbo-charged CSI with support for real-time log file analysis and visualization How Cloudera Search enables interactive data exploration of multiple sources simultaneously from within CSI So, let’s ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: priyanka-jain; We are experiencing another industrial revolution. A revolution around data and its ability to impact every industry and profession today. From the time you start your day checking the weather data on your mobile phone, calculating the time it takes to reach your workplace with traffic data, we are all creators and consumers of data. This growth in data has also contributed to new challenges of securing it, governing it and protecting privacy. You need to constantly evaluate your data processing practices to ensure that you comply with upcoming ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: marc-haber; A decade ago, information governance was dictated and enacted by a select group of people. Today, while the principles of information governance are largely owned by the same select group of people, everyone has a hand and shared responsibility in the enactment and fulfillment of governance. Whether it is through quality assessment, monitoring and reviewing usage, adherence to policies and rules or engagement on the annotation and structuring of data. The data owner, architect or developer are usually most familiar with this information, and are therefore responsible for ... Read More

Feed: All - O'Reilly Media. Author: Medha Agarwal. Fractal art (source: Pixabay) Check out the Strata Business Summit at the Strata Data Conference in New York City, Sept. 25-28, 2017, to learn more from data-driven businesses—including American Express, BBC Worldwide, and LinkedIn. Early price ends August 11. Driverless cars aren’t the only application for deep learning on the road: neural networks have begun to make their way into every corner of the automotive industry, from supply-chain management to engine controllers. In this installment of our ongoing series on artificial intelligence (AI) and machine learning (ML) in the enterprise, we speak ... Read More

Feed: Hadoop – Cloudera Engineering Blog. Author: Justin Kestelyn. One of the first questions Cloudera customers raise when getting started with Apache Hadoop is how to select appropriate hardware for their new Hadoop clusters. Although Hadoop is designed to run on industry-standard hardware, recommending an ideal cluster configuration is not as easy as delivering a list of hardware specifications. Selecting hardware that provides the best balance of performance and economy for a given workload requires testing and validation. (For example, users with IO-intensive workloads will invest in more spindles per core.) In this blog post, you’ll learn some of the ... Read More

Feed: AWS Big Data Blog. Many customers have taken advantage of the numerous benefits of running Apache HBase on Amazon S3 for data storage, including lower costs, data durability, and easier scalability. Customers such as FINRA have lowered their costs by 60% by moving to an HBase on S3 architecture along with the numerous operational benefits that come with decoupling storage from compute and using S3 as the storage layer. HBase on S3 allows you to turn on a cluster and immediately start querying against data within S3 rather than having to go through a lengthy snapshot restore process.With the ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: William Vorhies. Summary:  A year ago we wrote about the emergence of fully automated predictive analytic platforms including some with true One-Click Data-In Model-Out capability.  We revisited the five contenders from last year with one new addition and found the automation movement continues to move forward.  We also observed some players from last year have now gone in different directions.    Just about a year ago we wrote the original article for which this is the update.  Although it was just a year ago it seems like much longer ago that several ... Read More