Tag: BigInsights

Feed: Hadoop Dev. Author: Nailah Bissoon. Adding logical Big SQL workers should be done in non-peak hours when there are no Big SQL applications running on the system. Big SQL maybe restarted one or more times so that the underlying memory can be shuffled correctly within each compute node during logical worker operations. An introduction to this feature is presented in Logical Big SQL Workers Boost Performance. Important: Add and reconfigure logical Big SQL workers when all compute nodes (or Big SQL Workers from Ambari) are active. In ‘Add Services Wizard’->‘Customize Services’-> ‘Advanced bigsql-env’ drop down menu there are 2 ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Frank Mong. Big Data was challenged from the day it was coined…it’s a problem looking for an answer. Likewise, data science presents an amazing opportunity to answer our biggest questions, but its fate has been tied to the breadth, quantity, freshness and speed of the data it relies upon. For years, these competing issues have been left for organizations to solve on their own. No more. Hortonworks executed a major coup in the battle for big data dominance today with IBM selecting the Hortonworks Data Platform (HDP) distribution for their existing and future customers ... Read More

Feed: Database Trends and Applications : All Articles. IBM and Hortonworks are expanding their partnership focused on extending data science and machine learning to more developers and across the Apache Hadoop ecosystem.The companies are combining the Hortonworks Data Platform (HDP) with the IBM Data Science Experience and IBM Big SQL into new integrated solutions designed to help users better analyze and manage data for better decision making. “The combination of IBM’s data science and Hortonworks’ open and connected data platforms will benefit not only our respective clients, but also the Apache open source community because of our combined investment and collaboration,” said Rob ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Raj Dalal. Among the marquee brands that a data science professional would like to join, Uber is likely to be top of many lists. But do you really have what it takes to become a Uberite? BigInsights Principal Raj Dalal met up with Uber’s Chief Data Architect M C Srivas on a recent visit to San Francisco, where, in the course of the hour-long conversation, Srivas spoke of what data analytics meant for Uber, and how data innovation was being used to further, what is now popularly known around the world ... Read More

Feed: Hadoop Dev. Author: QinLiu. This blog provides you with steps to add metric widgets for a custom service in Ambari. It assumes that you have a running cluster with the Metrics Collector started and have the working custom service defined in the stack but not installed yet. It will cover the steps to add metric widgets to the service dashboard, collect metrics, push the metrics to the Metrics Collector, and deploy the service having metric widgets on the service dashboard. In this example, VSFTPD in IOP 4.2 will be used as the custom service and temp_disk_usage as the metric ... Read More

Feed: IBM Big Data & Analytics Hub - All Content. Author: steve-lockwood. This is the fourth in a series of blogs on analytics and the cloud. Read our introduction to the series. This blog concerns itself with the rise of open source software and how it is used for a whole host of analytical purposes. However, as will be seen in this blog, there are significant gaps in open source capability in this space and may always will be.IBM has a long history of working in open technology. IBM has directly contributed to the open source movement's success. It was ... Read More

Feed: Hadoop Dev. Author: George_Mathew. IBM® Open Platform (IOP) 4.3 with Apache Hadoop based on Ambari, includes a new pack of serviceability tools to assist on the deployment of the product, maintenance and diagnosis. These serviceability features will help customers to facilitate the installation of the product, as well as technical support personnel to identify operations causing downtime or disruption and restore the product into service. Requirements The script should be run from the Ambari server node. Passwordless ssh has to be setup from Ambari server node to the client nodes as detailed in Knowledge Center Documentation (Procedure → Step ... Read More

Feed: Hadoop Dev. Author: Bharath_D. Recently I have been asked by customers if there is a way for their applications running on mobile or desktop to upload a file to BigInsights clusters hosted on a secure cloud. Since secure clouds do not allow direct connections to HDFS ports. Instead connections from outside world applications has to be routed via Apache Knox gateway which has REST URL mappings defined for webhdfs . Apache Knox Gateway provides authentication support and a single rest interface to access several Bigdata services namely HDFS ,AMBARI , HIVE . Hence Knox is a perfect choice for ... Read More

Feed: IBM Big Data & Analytics Hub - All Content. Author: andrea-braida. For today’s data scientists and data engineers, the data lake is a concept that is both intriguing and often misunderstood. While there are many good resources about data lakes on ibm.com and other websites, there is also a lot of hype and spin. As a result, it can be difficult to get a clear understanding of the challenges, opportunities and methods that can help companies build data lakes that deliver real business advantage.We recently listened in to a fascinating conversation between John Mertic, Director of Program Management at ... Read More

Feed: Hadoop Dev. Author: Bharath_D. This article is intended for customers who would want to migrate their Kerberos server due to performance reasons, KDC corruption, KDC server data loss with minimal downtime. It can also be applied in scenarios where Kerberos principals could not be recovered due to catastrophic failures. Prior Knowledge of Kerberos is mandatory before proceeding with this article do not attempt the steps on production cluster unless you have tested on development cluster and you are comfortable with the nuances of Kerberos server.While every attempt has been made to ensure the script is bug free. It is ... Read More