Tag: Apache

Feed: What's New. On CPU instances, TensorFlow 1.13 is custom-built directly from source to accelerate performance on Intel Xeon Platinum processors that power EC2 C5 instances. Training a ResNet-50 model with synthetic ImageNet data using the Deep Learning AMI results in 9.4X faster throughput than stock TensorFlow 1.13 binaries. GPU instances come with an optimized build of TensorFlow 1.13 that is configured with NVIDIA CUDA 10 and cuDNN 7.4 to take advantage of mixed precision training on Volta V100 GPUs powering EC2 P3 instances. For developers looking to scale their TensorFlow training to multiple GPUs, the Deep Learning AMIs come ... Read More

Feed: Planet big data. Author: David Smith. A monthly roundup of news about Artificial Intelligence, Machine Learning and Data Science. This is an eclectic collection of interesting blog posts, software announcements and data applications from Microsoft and elsewhere that I've noted over the past month or so. Open Source AI, ML & Data Science News TensorFlow Privacy: a Python library for training machine learning models with differential privacy, for use with sensitive data to generate models that don't learn details about specific people. Tensorflow Federated, an open-source library for Federated Learning, enabling many participating clients to train shared ML models ... Read More

Feed: All - O'Reilly Media. Author: Tim O'Reilly. Gradual steps (source: Pixabay) This post was originally published on Quartz. The pursuit of monopoly has led Silicon Valley astray. Look no further than the race between Lyft and Uber to dominate the online ride-hailing market. Both companies are gearing up for their IPOs in the next few months. Street talk has Lyft shooting for a valuation between $15 and $30 billion dollars, and Uber valued at an astonishing $120 billion dollars. Neither company is profitable; their enormous valuations are based on the premise that if a company grows big enough and ... Read More

Feed: Microsoft Azure Blog. Author: Linda Wang. Microsoft announced the general availability of Azure Data Lake Storage (ADLS) Gen2 and Azure Data Explorer in early February, which arms Azure with unmatched price performance and security as one of the best clouds for analytics. Azure Data Factory (ADF), is a fully-managed data integration service, that empowers you to copy data from over 80 data sources with a simple drag-and-drop experience and operationalize and manage the ETL/ELT flows with flexible control flow, rich monitoring, and continuous integration and continuous delivery (CI/CD) capabilities. In this blog post, we’re excited to update you on the latest ... Read More

Feed: Blog Post – Corporate – DataStax. Author: Louise Westoby, Senior Director, Product Marketing. Open source software has become a natural go-to as enterprises seek to scale efficiently and affordably. Drawn by the allure of frictionless acquisitions, vendorless negotiations, and the open source appeal to potential new talent, companies of all types and sizes now use open source technology to drive growth and innovation. Likewise, Apache Cassandra™ adoption has increased significantly since Facebook open sourced the project in 2008. Designed for the modern world, Cassandra enables organizations to build transformative applications that have outgrown the capabilities of traditional relational databases ... Read More

Feed: Blog Post – Corporate – DataStax. Author: Sarah Burr, Customer Marketing Manager. How are today’s leading enterprises using DataStax to change the world? Find out at DataStax Accelerate, the world’s premier Apache Cassandra™ conference, which will take place May 21–23, 2019 in Washington, D.C. There, we will announce winners of the inaugural Stax Awards, which will be given to DataStax customers in three different categories: The Best Use of DataStax in a Hybrid/Multi-Cloud Environment Award recognizes enterprises that have deployed DataStax Enterprise across multiple cloud providers or in a hybrid cloud environment. The Modern Applications Powered by DataStax Award ... Read More

Feed: Cloudera Engineering Blog. Author: Grant Henke. Although the Kudu server is written in C++ for performance and efficiency, developers can write client applications in C++, Java, or Python. To make it easier for Java developers to create reliable client applications, we’ve added new utilities in Kudu 1.9.0 that allow you to write tests using a Kudu cluster without needing to build Kudu yourself, without any knowledge of C++, and without any complicated coordination around starting and stopping Kudu clusters for each test. This post describes how the new testing utilities work and how you can use them in your ... Read More

Feed: Big Data Made Simple. Author: Arun Kumar L. Jupyter is one of the powerful tools for development. However, it doesn’t support Spark development implicitly. A lot of times Python developers are forced to use Scala for developing codes in Spark. This article aims to simplify that and enable the users to use the Jupyter itself for developing Spark codes with the help of PySpark. Kindly follow the below steps to get this implemented and enjoy the power of Spark from the comfort of Jupyter. This exercise approximately takes 30 minutes.Installing PrerequisitesPySpark requires Java version 7 or later and Python version ... Read More

Feed: Microsoft Azure Blog. Author: Rob Caron. Now in preview AzCopy support in Azure Storage Explorer now available in public preview AzCopy in Azure Storage Explorer is now in public preview. AzCopy is a popular command-line utility that provides performant data transfer into and out of a storage account. AzCopy enhances the performance and reliability through a scalable design, where concurrency is scaled up according to the number of machine’s logical cores. Azure Storage Explorer provides the UI interface for various storage tasks, and now it supports using AzCopy as a transfer engine to provide the highest throughput for transferring ... Read More

Feed: MemSQL Blog. Author: Floyd Smith. A version of this blog post first appeared in the developer-oriented website, The New Stack. It describes how MemSQL works with Apache Kafka to guarantee exactly-once semantics within a data stream. Apache Kafka usage is becoming more and more widespread. As the amount of data that companies deal with explodes, and as demands on data continue to grow, Kafka serves a valuable purpose. This includes its use as a standardized messaging bus due to several key attributes. One of the most important attributes of Kafka is its ability to support exactly-once semantics. With exactly-once ... Read More