Tag: metadata

Feed: erwin Expert Blog – erwin, Inc.. Author: Zak Cole. Big Data is causing complexity for many organizations, not just because of the volume of data they’re collecting, but because of the variety of data they’re collecting.Big Data often consists of unstructured data that streams into businesses from social media networks, internet-connected sensors, and more. But the data operations at many organizations were not designed to handle this flood of unstructured data. Dealing with the volume, velocity and variety of Big Data is causing many organizations to re-think how they store and govern their data. A perfect example is the ... Read More

Feed: AWS Compute Blog. Author: Rachel Richardson. This post is courtesy of Otavio Ferreira, Manager, Amazon SNS, AWS Messaging.Amazon SNS is a fully managed pub/sub messaging and event-driven computing service that can decouple distributed systems and microservices. By default, when your publisher system posts a message to an Amazon SNS topic, all systems subscribed to the topic receive a copy of the message. By using Amazon SNS subscription attributes, you can customize this default behavior and make Amazon SNS fit your use cases even more naturally. The available set of Amazon SNS subscription attributes includes FilterPolicy, DeliveryPolicy, and RawMessageDelivery. You ... Read More

Feed: Microsoft Azure Blog. Author: Ashish Thapliyal. Fast Interactive BI, data security and end user adoption are three critical challenges for successful big data analytics implementations. Without right architecture and tools, many big data and analytics projects fail to catch on with common BI users and enterprise security architects. In this blog we will discuss architectural approaches that will help you architect big data solution for fast interactive queries, simplified security model and improved user adoption with BI users. Traditional approach to fast interactive BI Deep analytical queries processed on Hadoop systems have traditionally been slow. MapReduce jobs or hive ... Read More

Feed: All - O'Reilly Media. Author: Rohit Jain. Compass (source: Pixabay) Check out the "Data Engineering & Architecture" sessions at the Strata Data Conference in New York, September 11-13, 2018. Technologies for streaming, storing, and querying big data have matured to the point where the computer industry can usefully establish standards. As in other areas of engineering, standardization allows practitioners to port their learnings across a multitude of solutions, and to more easily employ different technologies together; standardization also allows solution providers to take advantage of sub-components to expeditiously build more compelling solutions with broader applicability. Unfortunately, little has been ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Igor Bobriakov. What is computer vision? Nowadays, computer vision (CV) is one of the most widely used dimensions of machine learning. The main task of computer vision is to understand the contents of the image. It is used almost in all spheres of the modern technology such as image and video classification, content filtering, security, face detection which even resides in your smartphone's camera app. The computer vision field evolves continuously. Building a model for visual recognition is both difficult and time-consuming task. Fortunately, there are a lot of ready-to-use solutions ... Read More

Feed: Cloudwards. Author: Joseph Gildred; The benefits of Amazon Glacier for data backup may be a no-brainer when it comes to dollars and cents, but implementation tends to get a smidge puzzling if you don’t know what to do after feeding Amazon your credit card digits. The question is how to get data from your device into a Glacier Vault and, lucky you, we’ve got the answer. Contrary to popular opinion, it isn’t a matter of yelling at your computer screen. The problem is that Amazon Glacier is a data repository, but lacks the means to traffic data data. It ... Read More

Feed: Planet MySQL; Author: Airbnb Engineering; Capturing Data Evolution in a Service-Oriented ArchitectureBuilding Airbnb’s Change Data Capture system (SpinalTap), to enable propagating & reacting to data mutations in real time.The dining hall in the San Francisco Office is always gleeming with natural sunlight!Labor day weekend is just around the corner! Karim is amped for a well deserved vacation. He logs in to Airbnb to start planning a trip to San Francisco, and stumbles upon a great listing hosted by Dany. He books it.A moment later, Dany receives a notification that his home has been booked. He checks his listing calendar and ... Read More

Feed: SAS Blogs. Author: Oliver Schabenberger. What if? Two simple words. A bold question. Driver of change and progress. Fuel for innovation. “What if?” perfectly captures core values of the SAS culture: to be curious, forward-thinking and to challenge assumptions in solving problems. Today, I would like to introduce to you the people behind four of our new technologies and share how their curiosity is at the heart of progress and how it transforms lives through analytics. Saving lives  I remember it like it was yesterday. One day last year, I received an email message that informed me that Jared ... Read More

Feed: R-bloggers. Author: rOpenSci - open tools for open science. This week version 2.0 of the mongolite package has been released to CRAN. Major new features in this release include support for MongoDB 4.0, GridFS, running database commands, and connection pooling. Mongolite is primarily an easy-to-use client to get data in and out of MongoDB. However it supports increasingly many advanced features like aggregation, indexing, map-reduce, streaming, encryption, and enterprise authentication. The mongolite user manual provides a great introduction with details and worked examples. GridFS Support! New in version 2.0 is support for the MongoDB GridFS system. A GridFS is ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: jay-limburn; Data can be an organization’s most valued asset, providing insights that help strengthen business. Knowing what works and what does not can help you invest more resources in what would work in the future.But there are two main challenges that might impede you from realizing the true value of your data and slowing your journey to adopting artificial intelligence (AI). Challenge 1: Inefficient data management The first challenge is the inefficiency in managing all the disparate data that flows through your enterprise. You need to ensure a fluid ... Read More