Tag: Hive

Feed: Planet MySQL; Author: MC Brown; Nicolas Tobias has written an awesome guide to setting up replication from MariaDB to Hadoop/HDFS using Tungsten Replicator, in Spanish! He’s planning more of these so if you like what you see, please let him know! Semana santa y yo con nuevas batallas que contar.Me hayaba yo en el trabajo, pensando en que iba a invertir la calma que acompa;a a los dias de vacaciones que libremente podemos elegir trabajar y pense: No seria bueno terminar esa sincronizacion entre los servidores de mariaDB y HIVE? Ya habia buscado algo de info al respecto en ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Shane Kumpf. This is the 5th blog of the Hadoop Blog series (part 1, part 2, part 3, part 4). In this blog, we will explore running Docker containers on YARN for faster time to market and faster time to insights for data intensive workloads at scale. For over half a decade, the Apache Hadoop YARN community has been hard at work enabling the building blocks for running a diverse set of data intensive workloads at unprecedented scale. The YARN community is constantly looking at ways to enable new use cases and improve existing ... Read More

Feed: Planet MySQL; Author: MC Brown; Nicolas Tobias has written an awesome guide to setting up replication from MariaDB to Hadoop/HDFS using Tungsten Replicator, in Spanish! He’s planning more of these so if you like what you see, please let him know! Semana santa y yo con nuevas batallas que contar.Me hayaba yo en el trabajo, pensando en que iba a invertir la calma que acompa;a a los dias de vacaciones que libremente podemos elegir trabajar y pense: No seria bueno terminar esa sincronizacion entre los servidores de mariaDB y HIVE? Ya habia buscado algo de info al respecto en ... Read More

Feed: Big Data Made Simple - One source. Many perspectives.. Author: Baiju NT. Docker containers provide a way to package applications with everything needed to run them, including base operating system images, databases, libraries, and binaries. By running a Docker engine on a host machine, Docker containers interact solely with the kernel of the host OS, meaning all containerized apps function the same regardless of the underlying infrastructure. Furthermore, you can run multiple apps on a single host machine, which leads to impressive cost savings by letting enterprises run more apps on existing hardware. The statistics for Docker are telling ... Read More

Feed: Planet big data. Author: Andrew Brust. A Difference of Agendas The cloud providers seek to supply you with core components, and enough platform programmability to facilitate them being cobbled together.  The cloud providers could present a much more integrated experience, with tools that provide a higher level of abstraction over these base components – but they don’t. Each public cloud vendor provides a platform, rather than full-on solutions that run on the platform.  The goal is to provide building blocks that others can compose into full solutions.  The cloud providers see more value in providing innovative, breakthrough capabilities in ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Packt Publishing. When the first release of Spark became available in 2014, Hadoop had already enjoyed several years of growth since 2009 onwards in the commercial space. Although Hadoop solved a major hurdle in analyzing large terabyte-scale datasets efficiently, using distributed computing methods that were broadly accessible, it still had shortfalls that hindered its wider acceptance. Limitations of Hadoop A few of the common limitations with Hadoop were as follows: I/O Bound operations: Due to the reliance on local disk storage for saving and retrieving data, any operation performed in Hadoop ... Read More

Feed: AWS Big Data Blog. Many companies across the globe use Amazon DynamoDB to store and query historical user-interaction data. DynamoDB is a fast NoSQL database used by applications that need consistent, single-digit millisecond latency.Often, customers want to turn their valuable data in DynamoDB into insights by analyzing a copy of their table stored in Amazon S3. Doing this separates their analytical queries from their low-latency critical paths. This data can be the primary source for understanding customers’ past behavior, predicting future behavior, and generating downstream business value. Customers often turn to DynamoDB because of its great scalability and high ... Read More

Feed: R-bloggers. Author: David Schlepps. Capture errors, warnings and messages, but keep your list operations going In a recent post about text mining, I discussed some solutions to webscraping the contents of our STATWORX blog using the purrr-package. However, while preparing the next the episode of my series on text mining, I remembered a little gimmick that I found quite helpful along the way. Thus, a little detour: How do I capture side-effects and errors when I perform operations on lists with purrr rather than using a loop? First of all, a quick motivating example: Imagine we will build a ... Read More

Feed: Planet big data. Author: Andrew Brust. Today’s leading cloud platforms include numerous components for storing, processing and analyzing large volumes of data.  All the basics are there: storage, analysis and processing, streaming data processing, data pipelining, data warehousing, BI and even AI.  But while it’s great to have all those raw components, how do you tie them together into a comprehensive architecture? While the parts are great, they still must be assembled into the whole. In this blog we’ll explore the various data processing and management components available to you on the Amazon Web Services (AWS) platform.  We’ll discuss ... Read More

Feed: Blog. Author: Lisa Waugh; We are pleased to announce the availability of the Aqua Data Studio version 19.0 release.  This release greatly enhances several areas of the product. You can now view explain plans for NoSQL data warehouse platforms, like Hive, Spark and Impala.   Gain faster insights to your data  with the enhancements to the visual analytics tool. Ability to share workspaces, thereby increasing collaboration and usability in team environments Enhancements to Aqua Data Studio’s filtering capabilities.  Allowing users to quickly analyze their data and gain insight through data visualization Our new combined fields offer a quick and convenient ... Read More