Tag: Hadoop

Feed: AWS Big Data Blog. Many AWS customers use a multi-account strategy. A centralized AWS Glue Data Catalog is important to minimize the amount of administration related to sharing metadata across different accounts. This post introduces capability that allows Amazon Athena to query a centralized Data Catalog across different AWS accounts.Overview of solution In late 2019, AWS introduced the ability to Connect Amazon Athena to your Apache Hive Metastore. Using this functionality, you can also configure Athena to point to a Data Catalog in a different account. The Hive Metastore functionality uses an AWS Lambda function to federate queries to ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Fahad Zaidi. Having spent the better part of the last decade helping organisations in the U.S. and the U.K. use data to drive profit, efficiency, and performance improvements, I thought it would be helpful to jot down best practices for organizations that are looking to get the most value out of their enterprise-level financial and operational data sets. Every organisation entering the roaring 20s knows that they must use their data as a strategic differentiator to gain a competitive advantage and this article lists five things all companies must do to ... Read More

Feed: James Serra's Blog. Author: James Serra. As a followup to my blog post Azure Data Lake Store Gen2 is GA, I wanted to give some pointers when using ADLS Gen2 as well as blob storage, as it can get a bit confusing with all the options that are available. Azure Data Lake Store (ADLS) Gen2 should be used instead of Azure Blob Storage unless there is a needed feature that is not yet GA’d in ADLS Gen2. The major features that are missing from ADLS Gen2 are premium tier, soft delete, page blobs, append blobs, and snapshots. The major features ... Read More

Feed: Microsoft Azure Blog. Author: Russell McDonald. Cryptocurrency mining attacks continue to represent a threat to many of our Azure Linux customers. In the past, we've talked about how some attackers use brute force techniques to guess account names and passwords and use those to gain access to machines. Today, we're talking about an attack that a few of our customers have seen where a service is exploited to run the attackers code directly on the machine hosting the service. This attack is interesting for several reasons. The attacker echoes in their scripts so we can see what they want ... Read More

Feed: AWS Big Data Blog. This is a guest post by Verizon Media Group.At Verizon Media Group (VMG), one of the major problems we faced was the inability to scale out computing capacity in a required amount of time—hardware acquisitions often took months to complete. Scaling and upgrading hardware to accommodate workload changes was not economically viable, and upgrading redundant management software required significant downtimes and carried a large amount of risk. At VMG, we depend on technologies such as Apache Hadoop and Apache Spark to run our data processing pipelines. We previously managed our clusters with Cloudera Manager, which ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Valeria. The history of Database management systems could be interpreted as a Darwinian evolution process.The dominance of relational databases gives way to the data warehouses one, which better adapt to the earliest business intelligence requirements; then, alongside the rise of the most popular big data platforms such as Hadoop or spark, comes the era of the NoSQL databases, which were designed to privilege scalability among other features (instead of consistency for example). However, what has happened during the years, is more likely a specialization process.In fact, we are experiencing the coexistence ... Read More

Feed: MemSQL Blog. Author: Floyd Smith. Why did the world need MemSQL? In this blog post, updated from a few years ago, early MemSQL Product Manager Carlos Bueno explains why MemSQL works better, for a wide range of purposes, than a NoSQL setup. (Thanks, Carlos!) We’ve updated the blog post with new MemSQL product features, graphics, and relevant links. To wit, you should also see Rick Negrin’s famous blog post on NoSQL and our recent case study on replacing Hadoop with MemSQL. Tell us if this sounds familiar. Once upon a time a company ran its operations on The Database ... Read More

Feed: Neo4j Graph Database Platform. Author: Bryce Merkl Sasaki. It’s a story too good not to tell: When you take a look back at everything that’s happened in the Neo4j community over the past 10 years, it’s amazing to see how far we’ve come.What the decade began, Neo4j was a small, shy, open source community clustered around a bunch of alpha geeks (that’s a compliment!) in Malmö, Sweden. And now, Neo4j is the clear leader in the graph database sector – a sector the community created from scratch – with hundreds of customers and thousands of developers around the globe.The ... Read More

Feed: MemSQL Blog. Author: Floyd Smith. SME Solutions Group is a MemSQL partner. An SME customer, a utility company, was installing a new meter network, comprising 2 million meters, generating far more data than the old meters. The volume of data coming in, and reporting needs, were set to overwhelm their existing, complex, Hadoop-based solution. The answer: replacing 10 different data processing components with a single MemSQL cluster. The result: outstanding performance, scalability for future requirements, the ability to use standard business intelligence tools via SQL, and low costs. SME Solutions Group (LinkedIn page here) helps institutions manage risks and ... Read More

Feed: Puppet.com Blog RSS Feed. Author: ; I’m proud to announce the release of Puppet Enterprise 2.5, downloadable right now and free to use on up to 10 nodes. Just over a year ago, in February of 2011, Puppet Labs released our first commercial product, Puppet Enterprise. We were about 25 people at the time, and our revenue up until then consisted of training, services, and support for our open source Puppet project. That release taught us a lot, and it was our first major step in moving us to a product company. In the intervening year, a lot has ... Read More