Tag: metadata

Feed: SAS Blogs. Author: Jim Harris. Data preparation is the task of blending, shaping and cleansing data to get it ready for analytics or other business purposes. Data preparation begins with attempting to find the data best-suited for a specific purpose – an exercise that many users cite as frustrating and time-consuming. With so much data available from numerous sources in various formats, it's crucial to be able to discover the right data quickly. Only then can you expedite the process of getting value out of the vast data assets from across your enterprise. Creating and maintaining a comprehensive, well-documented data catalog ... Read More

Feed: CDH – Cloudera Engineering Blog. Author: Cy Jervis. Modeling EHR Data in Healthcare In this case study, we take a look at modeling electronic health record (EHR) data with deep learning and Deeplearning4j (DL4J). We draw inspiration from recent research showing that carefully designed neural network architectures can learn effectively from the complex, messy data collected in EHRs. Specifically, we describe how to train an  long short-term memory recurrent neural network (LSTM RNN) to predict in-hospital mortality among patients hospitalized in the intensive care unit (ICU). Of particular note, we show that even for a dataset orders of magnitude ... Read More

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. Many local administrations deal with air pollution through the collection and analysis of air quality data. With AWS, cities can now create a serverless analytics solution using AWS Glue and AWS QuickSight for processing and analyzing a high volume of sensor data. This allows you to start quickly without worrying about servers, virtual machines, or instances, so you can focus on your core business logic to help your organization meet its analytics objectives.You can pick up data from on-premises databases or Amazon Simple Storage Service (Amazon S3) buckets, transform it, and ... Read More

Feed: What's New. IBM Spectrum Scale is a flexible, software-defined storage solution that can be deployed as highly available, high-performance file storage. It can scale in several dimensions, including performance (bandwidth and IOPS), capacity, and number of nodes that can mount the file system. The product’s high performance and scalability helps address the needs of applications whose performance (or performance-to-capacity ratio) demands cannot be met by traditional scale-up storage systems. The IBM Spectrum Scale software is being made available through a 90-day trial license evaluation program. This Quick Start automates the deployment of IBM Spectrum Scale on AWS for users ... Read More

Feed: Microsoft Azure Blog. Author: Milan Gada. In May 2017, we announced the global public preview of the Video Indexer service at the Microsoft Build Developers Conference in Seattle. As part of Microsoft Cognitive Services, Video Indexer was introduced as a unique integrated bundling of Microsoft's cloud-based artificial intelligence and cognitive capabilities applied specifically for video content. It has since become the industry's most comprehensive Video AI service available, making it easy to extract insights from videos. For the last four months, we have received a tremendous, enthusiastic response from our global customers and partners who began using Video Indexer ... Read More

Feed: R-bloggers. Author: The USGS OWI blog. A magnitude 8.1 earthquake was measured in the Pacific region offshore Chiapas, Mexico at 04:49:21 UTC on September 8th 2017. Working in the Water Mission Area for the USGS, our Data Science Team was already hard at work polishing up water visualizations for the devastating Hurricane Harvey, as well as creating a new visualization for Hurricane Irma. That is to say, the resources available for a timely visualization were already spent. By 10 am on Friday however, a team of USGS groundwater scientist had realized that the affects of the earthquake were being ... Read More

Feed: SQL Server Customer Advisory Team. Author: Dimitri Furman. Reviewed by: John Hoang, Denzil Ribeiro, Rajesh Setlem, Mike Weiner Introduction Instant File Initialization (IFI) is a well-known feature of SQL Server, providing significant performance improvement for operations that require an increase in the size of data files, such as database creation, restore, and file growth. Without IFI enabled, zeroes have to be written into the newly allocated file space, which is a time-consuming size-of-data operation. With IFI enabled, space is allocated to the file, but zeroes are not written. SQL Server documentation provides details on how this feature works, and ... Read More

Feed: R-bloggers. Author: Scott Chamberlain, Maëlle Salmon, Noam Ross, Karthik Ram. The R package ecosystem now contains more than 10K packages, and several flagship packages belong under the rOpenSci suite. Some of these are: magick for image manipulation, plotly for interactive plots, and git2r for interacting with git. rOpenSci is a community of people making software to facilitate open and reproducible science/research. While the rOpenSci team continues to develop and maintain core infrastructure packages, an increasing number of packages in our suite are contributed by members of the extended R community. In the early days we accepted contributions to our ... Read More

Feed: R-bloggers. Author: Yihui Xie. Today I’m excited to announce a new R package, blogdown, to help you create general-purpose (static) websites with R Markdown. The first version of blogdown is available on CRAN now, and you can install it with: install.packages("blogdown") The source package is hosted on Github in the repository rstudio/blogdown. Since blogdown is a new package, you may install and test the development version using devtools::install_github("rstudio/blogdown") if you run into problems with the CRAN version. Introduction In a nutshell, blogdown is an effort to integrate R Markdown with static website generators, so that you can generate web ... Read More

Feed: Percona Database Performance Blog. Author: Sveta Smirnova. Sveta Smirnova  | September 11, 2017 |  Posted In: Database Monitoring, InnoDB, Insight for DBAs, Insight for Developers, MySQL PREVIOUS POST In this post, we will discuss how to fix cardinality for InnoDB tables manually. As a support engineer, I often see situations when the cardinality of a table is not correct. When InnoDB calculates the cardinality of an index, it does not scan the full table by default. Instead it looks at random pages, as determined by options innodb_stats_sample_pages, innodb_stats_transient_sample_pages and innodb_stats_persistent_sample_pages, or by the  CREATE TABLE option STATS_SAMPLE_PAGES. The default value for persistent statistics is 20 ... Read More