Tag: Apache

Feed: IBM Big Data & Analytics Hub - All Content; Author: jessica-lee; Data application resiliency is high on the agenda for CIOs. Gary Brunell from IBM looks at the in-house solution developed by Hotels.com, and how the IBM Big Replicate offering compares. Gary Brunell is a Certified Thought Leader, and a Distinguished IT Specialist at IBM. Gary works with a wide range of clients in the financial services sector, from startups to Fortune 50 companies. Jessica Lee: Hotels.com has developed an intrepid approach to data consistency data management challenges. What’s the story behind its data strategy? Gary Brunell: Hotels.com, an ... Read More

Feed: Hadoop Dev. Author: Nagapriya Tiruthani. New release of Hortonworks Data Platform is now available from IBM HDP 3.0 delivers new capabilities for the enterprise to enable agile application deployment, new machine learning/deep learning workloads, real-time database, & security and governance. It is a key component of the modern data architecture and can be deployed both on-premises and the cloud. Many of the new enhancements to HDP 3.0 are based on Apache Hadoop 3.1 and include containerization, GPU support, erasure coding and namenode federation. The new FASTER, SMARTER, HYBRID platform has a lot of innovation and improved usability to make ... Read More

Feed: AWS Big Data Blog. Bushfires are frequent events in the warmer months of the year when the climate is hot and dry. Countries like Australia and the United States are severely impacted due to the bushfires causing devastating effects to human lives and property. Over the years the prediction of bushfires has been a subject of study in various research projects. Many of these projects use complex machine learning algorithms. These algorithms learn to predict the bushfires from the real-time spread for the fire over a particular geographical region­.In this blog post, we use event processing paradigm provided by ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Matt Spillar. We’ve just published our most recent customer video! This video gives a look at how Freddie Mac is leveraging big data, artificial intelligence, and machine learning to improve the mortgage appraisal process. Freddie Mac makes home possible for millions of families and individuals by providing mortgage capital to lenders. Since its creation in 1970, its made housing more accessible and affordable for homebuyers and renters in communities nationwide. The company is building a better housing finance system for homebuyers, renters, lenders and taxpayers. Data is essential in the mortgage life cycle. With today’s new rapid ... Read More

Feed: AWS Big Data Blog. RStudio Server provides a browser-based interface for R and a popular tool among data scientists. Data scientist use Apache Spark cluster running on  Amazon EMR to perform distributed training. In a previous blog post, the author showed how you can install RStudio Server on Amazon EMR cluster. However, in certain scenarios you might want to install it on a standalone Amazon EC2 instance and connect to a remote Amazon EMR cluster. Benefits of running RStudio on EC2 include the following:Running RStudio Server on an EC2 instance, you can keep your scientific models and model artifacts ... Read More

Feed: What's New. Amazon Neptune is a fast, reliable, fully-managed graph database service that makes it easy to build and run applications that work with highly connected datasets and supports the popular graph models Property Graph and W3C's RDF. If you have a BAA in place with AWS, you can immediately start using Amazon Neptune to build applications using Apache TinkerPop Gremlin or SPARQL queries that efficiently navigate highly connected datasets containing protected health information (PHI). If you do not have a BAA in place with AWS or have any other questions about running HIPAA-regulated workloads on AWS, please contact ... Read More

Feed: What's New. AWS Deep Learning AMIs also support popular frameworks including TensorFlow, PyTorch, and Apache MXNet with Gluon —all pre-installed and fully-configured for you to start developing your deep learning models in minutes while taking full advantage of the computational power of Amazon EC2 instances. For a complete list of frameworks and versions supported by the AWS Deep Learning AMI, see the release notes. Get started quickly with the AWS Deep Learning AMIs using the getting-started guides and beginner-to-advanced level tutorials in our developer guide. You can also subscribe to our discussion forum to get launch announcements and post your questions ... Read More

Feed: Hortonworks Blog – Hortonworks. Author: Will Xu. We are excited to announce the general availability of Hortonworks Data Analytics Studio (DAS), a new service that improves the productivity of business analysts by delivering faster insights from data at scale. DAS also enables IT teams to meet the requirements of business by optimizing cluster and storage operation. DAS makes business analysts self-sufficient and enhance their efficiency by providing them with diagnostic information, operational tools, and intelligent recommendations. At the same time, IT teams can use DAS to proactively resolve cluster issues by getting visibility into cluster utilization through intuitive tools ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: ajit jaokar. Introduction Recently, google launched a Dataset search – which is a great resource to find Datasets.  In this post, I list some IoT datasets which can be used for Machine Learning or Deep Learning applications. But finding datasets is only part of the story.  A static dataset for IoT is not enough i.e. some of the interesting analysis is in streaming mode. To create an end to end streaming implementation from a given dataset, we need knowledge of full stack skills. These are more complex (and in high demand) ... Read More

Feed: R-bloggers. Author: Tony Hirst. Over the last couple of days, I’ve been fettling the build scripts for the TM351 VM, which typically uses vagrant to build a VirtualBox VM from a set of shell scripts, so they can be used to build a single Docker container that runs all the TM351 services, specifically Jupyter notebooks, OpenRefine, PostgreSQL and MongoDB. Docker containers are typically constructed to a run a single service, with compositions of containers wired together using Docker Compose to create applications that deliver, or rely on, more than one running service. For example, in a previous post (Setting up ... Read More