Tag: Apache

Feed: What's New. You can now use Python scripts in AWS Glue to run small to medium-sized generic tasks that are often part of an ETL (extract, transform, and load) workflow. Previously, AWS Glue jobs were limited to those that ran in a serverless Apache Spark environment. You can now use Python shell jobs, for example, to submit SQL queries to services such as Amazon Redshift, Amazon Athena, or Amazon EMR, or run machine-learning and scientific analyses ... Read More

Feed: Microsoft Azure Blog. Author: Taylor Cox. We are excited to share the release of the Microsoft Azure HDInsight Metastore Migration Tool (HMMT), an open-source script that can be used for applying bulk edits to the Hive metastore. The HDInsight Metastore Migration Tool is a low-latency, no-installation solution for challenges related to data migrations in Azure HDInsight. There are many reasons why a Hive data migration may need to take place. You may need to protect your data by enabling secure transfer on your Azure storage accounts. Perhaps you will be migrating your Hive tables from WASB to Azure Data ... Read More

Feed: Microsoft Azure Blog. Author: Rob Caron. Now in preview Azure Monitor logs in Grafana - now in public preview Grafana offers great dashboarding capabilities, rich visualizations, and integrations with over 40 data sources. Grafana integration is now available in preview for Microsoft Azure Monitor logs. This integration is achieved through the new Log Analytics plugin, now available as part of the Azure Monitor data source. If you’re already using Grafana for your dashboards, this new plugin can help you create a single pane of glass for your various monitoring needs. The new plugin enables you to display any data ... Read More

Feed: Neo4j Graph Database Platform. Author: Mark Needham. Welcome to the 3rd edition of This Week in Neo4j for 2019. We’ve got a variety of different things for you this week. Christophe Willemsen has written an excellent deep dive into the Full-Text Search feature released in Neo4j 3.5, Dr Jim Webber explains how Neo4j can be used for large scale systems using less servers, Emil is interviewed on Azeem Azhar’s podcast, and of course we have the next post in Jennifer Reif’s Marvel Series! This week’s featured community member is my colleague Michael Simons – Java-Champion, JUG-Lead, conference speaker and ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Abhas Ricky. The 2018 Hortonworks’ DataWorks Summit events offered me a unique opportunity to talk to customers about the technology zeitgeist. I attended the Hortonworks events in Singapore and Japan, and I came away with a clearer understanding of several emerging technology trends in Asia that are shaping the future of business and fuelling the adoption of hybrid cloud. These events also provided a chance to hear how Fortune 500 executives are creating next-generation data platforms to support future innovations. As-a-Service Models Are Taking Over As I traveled and talked with current and potential ... Read More

Feed: AWS Big Data Blog. Although structured data remains the backbone for many data platforms, increasingly unstructured or semistructured data is used to enrich existing information or to create new insights. Amazon Athena enables you to analyze a wide variety of data. This includes tabular data in comma-separated value (CSV) or Apache Parquet files, data extracted from log files using regular expressions, and JSON-formatted data. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run.In this blog post, I show you how to use JSON-formatted data and translate a nested data structure ... Read More

Feed: Neo4j Graph Database Platform. Author: Bryce Merkl Sasaki. Editor’s Note: Alastair Green (Neo4j Query Languages Lead) and Martin Junghanns (Neo4j Cypher for Apache Spark project) will be speaking at the Spark + AI Summit in San Francisco this April.Want to Extend the Graph Capabilities of Spark?Let’s get straight to it: The Apache Spark community is joining hands with the growing graph data movement, and we need your help to keep moving forward.Databricks contributor Xiangrui Meng is sponsoring the idea of property graphs built on Spark DataFrames, with Cypher queries, along with graph algorithms from the GraphFrames project. This would ... Read More

Feed: Planet MySQL; Author: Alexander Rubin; PREVIOUS POST Parallel query execution is my favorite, non-existent, feature in MySQL. In all versions of MySQL – at least at the time of writing – when you run a single query it will run in one thread, effectively utilizing one CPU core only. Multiple queries run at the same time will be using different threads and will utilize more than one CPU core. On multi-core machines – which is the majority of the hardware nowadays – and in the cloud, we have multiple cores available for use. With faster disks (i.e. SSD) we can’t utilize ... Read More

Feed: Microsoft Azure Blog. Author: Tyler Fox. We recently introduced support for HDInsight in Microsoft Azure CLI as a public preview. With the addition of the new HDInsight command group, you can now utilize all of the features and benefits that come with the familiar cross-platform Azure CLI to manage your HDInsight clusters. Key Features Cluster CRUD: Create, delete, list, resize, and show properties for your HDInsight clusters. Script actions: Execute script actions, list and delete persistent script actions, promote ad-hoc script executions to persistent script actions, and show the execution history of script actions on HDInsight clusters. Operations Management ... Read More

Feed: Hazelcast Blog. Author: Justin Pease. Hazelcast has been delivering the power of in-memory technology in a way that is easy to develop, deploy, and scale. In line with that overarching theme, we are happy to announce the release of a new online self-paced learning site, the Hazelcast Training Center. We’re seeing Hazelcast as a requirement on more job listings than Gemfire, Apache Ignite and Oracle Coherence, combined. Market adoption continues to be tremendous, and we have a wide array of initiatives launching in 2019 that will only add fuel to that fire. Given the high-demand on Hazelcast expertise, now ... Read More