Category: IBM

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. As we are wrapping up 2018 and looking ahead to the New Year, we are delighted to share some new capabilities added to our products and some details on events coming early next year.   Product news: Excited to announce the availability of IBM Db2 Big SQL v5.0.4 (on HDP 2.6) IBM Db2 Big SQL, an advanced SQL engine on Hadoop, has been making strides with the fast-evolving open source ecosystem by supercharging your analytical workloads on data lakes. The core capabilities of Big SQL focusses on data virtualization, SQL compatibility, scalability, performance, and of course ... Read More

Feed: Hadoop Dev. Author: JessicaLeeYau. Today (December 4, 2018), I am very excited to announce the first release of IBM Big Replicate for Backup v2.0, now available! Big Replicate is a replication technology that gives you LIVE DATA — consistent data everywhere, spanning platforms and locations, even for changing data at petabyte scale. Big Replicate enables data replication for Hadoop and cloud object stores with continuous data availability and consistency exceeding the most demanding enterprise SLAs. Big Replicate for Backup is an add-on to Big Replicate for Hadoop which provides backup and data restoration capabilities to your LIVE DATA environment ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. Announcing the immediate availability of IBM Db2 Big SQL v5.0.4 IBM Db2 Big SQL, an advanced SQL engine on Hadoop, has been making strides with the fast-evolving open source ecosystem by supercharging your analytical workloads on data lakes. The core capabilities of Db2 Big SQL focusses on data virtualization, SQL compatibility, scalability, performance, and of course enterprise security/governance, making it a desirable query engine to seek insights from disparate data sources including Hadoop. Db2 Big SQL v5.0.4 is now being released that introduces a solution for automatic failover for HA and enhanced performance capabilities to data lakes ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. IBM Db2 Big SQL v6.0 BETA is now generally available. This release of Db2 Big SQL is for environments that have the latest version of Hortonworks Data Platform (HDP) v3.0.1. IBM Db2 Big SQL, an advanced SQL engine on Hadoop, has been making strides with the fast-evolving open source ecosystem by supercharging your analytical workloads on data lakes. The core capabilities of Big SQL focusses on data virtualization, SQL compatibility, scalability, performance, and of course enterprise security/governance, making it a desirable query engine to seek insights from disparate data sources including Hadoop.  What’s new in Db2 ... Read More

Feed: Hadoop Dev. Author: Mara_Matias. The objective of this series is to explore performance for BigSQL Federation using practical examples. This series is divided into two parts. Part 1 will look at function performance with emphasis on pushdown analysis Part 2 will look at performance for queries that join nicknames with local tables and/or other nicknames You are reading Part 2. We will be taking over where we left off on Federation Performance – Part 1 . The setup described will be added to the existing from Part 1. All the code shown comes from either jsqsh, or bash command ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. Data is the new oil. Like crude oil, data is not useful when it is raw. But once it is refined and cleansed, the analytics done with it can enable deep analytics and open up new opportunities for your business. To make data simple and easily accessible, we are excited to bring Data news by combining news from Db2, Db2 Big SQL, Big Replicate, and other data news… Product news: 1. Hortonworks and Cloudera publically announced a definitive agreement to merge to create World’s leading next generation data platform Watch the CNBC video to ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. New release of Hortonworks Data Platform is now available from IBM HDP 3.0 delivers new capabilities for the enterprise to enable agile application deployment, new machine learning/deep learning workloads, real-time database, & security and governance. It is a key component of the modern data architecture and can be deployed both on-premises and the cloud. Many of the new enhancements to HDP 3.0 are based on Apache Hadoop 3.1 and include containerization, GPU support, erasure coding and namenode federation. The new FASTER, SMARTER, HYBRID platform has a lot of innovation and improved usability to make ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. IBM Db2 Big SQL leads SQL Engines on Hadoop Bloor Research released a Market Report paper on SQL Engines on Hadoop. It compares a myriad of SQL engines on Hadoop and based on use cases, has placed Db2 Big SQL as a leader in Hadoop use cases, performance and SQL support. Figure: SQL Engines on Hadoop, Market Report Paper by Bloor Research, December 2017Hadoop is part of every enterprises’ data management platform for various needs. One major need is the ability to execute SQL on Hadoop data. As most applications for business intelligence and ... Read More

Feed: Hadoop Dev. Author: JessicaLeeYau. Today (July 10, 2018), I am very excited to announce the the GA of IBM Big Replicate for Hadoop 2.12, IBM Big Replicate for Object Stores 2.12, IBM Big Replicate for Hive 2.0, and IBM Big Replicate for Security 2.0 coming on July 13th, 2018! Big Replicate is a replication technology that gives you LIVE DATA — consistent data everywhere, spanning platforms and locations, even for changing data at petabyte scale. Big Replicate enables data replication for Hadoop and cloud object stores with continuous data availability and consistency exceeding the most demanding enterprise SLAs. Moving ... Read More

Feed: Hadoop Dev. Author: Jing Chen He. Apache Kafka is a popular distributed messaging system that has many use cases. In a high level picture, producers write messages to topics on Kafka, and consumers read messages from the topics and process the messages. A consumer tells Kafka which messages have been successfully processed by committing the offset of the messages within the topic. There is a concept of partitions where the messages are grouped on Kafka during both producer writing and consumer reading. One of the questions Kafka users often encounter is the ordering of the messages, and one of ... Read More