Tag: row

Feed: Google Cloud Big Data and Machine Learning Blog. Author: Google Cloud Big Data and Machine Learning Blog Team. Innovation in data processing and machine learning technology Monday, June 26, 2017 By Jibran Saithi, Lead Architect, Qubit At Qubit, we enable over 400 million personalized experiences per month, and to power those experiences we process data from websites, mobile apps and other customer touchpoints. Managing and processing this data in near-real time is a significant challenge; various stages of the pipeline process events at over 500K messages per second, all of which need to be validated, enriched and routed with ... Read More

Feed: Databasejournal.com - Feature Database Articles. Author: . Latches can be confusing. Sessions can wait for them and when those waits become excessive performance degrades. To many they appear to be the same as locks, but they aren't, even though lock waits, when the times get excessive, can also degrade performance. So, what are the differences between latches and locks? Let's examine both and see where they differ, what can cause latch waits and how latch waits can be investigated. Latches are similar to locks but they operate on memory to protect code and internal data structures by preventing concurrent ... Read More

Feed: Planet MySQL. Author: TwinDB. When we started working with a customer they asked us to setup for them more reliable and performant MySQL database. At the time they were using Percona XtraDB cluster with ELB to balance read traffic between PXC nodes. There was no writer redundancy – if a writer node was down, the app was down. The app by the way is a Magento backed online shop. All stuff was running in AWS. We started to design the new database architecture. The first component we threw away was ELB. A simple OLTP sysbench test showed that ELB ... Read More

Feed: Planet MySQL. Author: Jaime Crespo. For the impatient: # echo -e "deb http://repo.mysql.com/apt/debian/ stretch mysql-5.7ndeb-src http://repo.mysql.com/apt/debian/ stretch mysql-5.7" > /etc/apt/sources.list.d/mysql.list # wget -O /tmp/RPM-GPG-KEY-mysql https://repo.mysql.com/RPM-GPG-KEY-mysql # apt-key add /tmp/RPM-GPG-KEY-mysql # apt update # apt install mysql-server# echo -e "deb http://repo.mysql.com/apt/debian/ stretch mysql-5.7ndeb-src http://repo.mysql.com/apt/debian/ stretch mysql-5.7" > /etc/apt/sources.list.d/mysql.list# wget -O /tmp/RPM-GPG-KEY-mysql https://repo.mysql.com/RPM-GPG-KEY-mysql# apt-key add /tmp/RPM-GPG-KEY-mysql# apt update# apt install mysql-serverIn the latest stable version of Debian, if you ask to install mysql-server, you now get installed mariadb automatically, with no (evident) way of installing Oracle’s MySQL. Any major version upgrade has to be done carefully (not only for MariaDB, but ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Chad Metcalf. One of the more common requests we receive from the community is to package Apache HBase with Cloudera’s Distribution for Apache Hadoop. Lately, I’ve been doing a lot of work on making Cloudera’s packages easy to use, and recently, the HBase team has pitched in to help us deliver compatible HBase packages. We’re pretty excited about this, and we’re looking forward to your feedback. A big thanks to Andrew Purtell, a Senior Architect at TrendMicro and HBase Contributor, for leading this packaging project and providing this guest blog post. -Chad Metcalf ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Amr Awadallah. (guest blog post by Pete Skomoroch) In a previous post, I outlined how to build a basic trend tracking site called trendingtopics.org with Cloudera’s Distribution for Hadoop and Hive.  TrendingTopics uses Hadoop to identify the top articles trending on Wikipedia and displays related news stories and charts.  The data powering the site was pulled from an Amazon EBS Wikipedia Public Dataset containing 8 months of hourly pageview logfiles.  In addition to the pageview logs, the EBS data volume also includes the full text content and link graph for all articles.  This ... Read More

Feed: Planet MySQL. Author: Frederic Descamps. Last Thursday, I was introducing MySQL Document Store in Ghent, BE at Percona University. I was explaining how great is this technology and how MySQL can replace your NoSQL database but still provides you all the benefits from a RDBMS. This is the full presentation: Then somebody came with a nice question. Let me put first some context: we will create a collection to add people in it we will create a virtual column on the age we will index that column we will query and add records to that collection Collection creation and ... Read More

Feed: Planet MySQL. Author: Valeriy Kravchuk. This is a "Howto" kind of post, and some speculations and historical references aside, it will show you how to build MariaDB ColumnStore (current version 1.0.9) from GitHub source, how to install and configure it for basic usage, as well as how to resolve some minor problems you may get in the process. Keep reading and eventually you'll get the real Howto below :) * * * I try not to care about any software issues besides good old MySQL, InnoDB storage engine internals, query optimization and some MyRocks or a little bit of ... Read More

Feed: AWS Big Data Blog. Amazon Redshift Spectrum enables you to run Amazon Redshift SQL queries against data that is stored in Amazon S3. With Amazon Redshift Spectrum, you can extend the analytic power of Amazon Redshift beyond the data that is stored on local disks in your data warehouse. You can query vast amounts of data in your Amazon S3 “data lake” without having to go through a tedious and time-consuming extract, transfer, and load (ETL) process. Amazon Redshift Spectrum applies sophisticated query optimization and scales processing across thousands of nodes to deliver fast performance.In this blog post, we have ... Read More

Feed: Cloudera Engineering Blog » Hadoop. Author: Christophe Bisciglia. A while back, we noticed a blog post From Arun Jacob over at Evri (if you haven’t seen Evri before, it’s a pretty impressive take on search UI). We were particularly interested in helping Arun and others use EC2 and Hadoop to process data stored on EBS as Amazon makes many public data sets available. After getting started, Arun volunteered to write up his experience, and we’re happy to share it on the Cloudera blog.  -Christophe BackgroundA couple of weeks ago I managed to get a Hadoop cluster up and running on ... Read More