Tag: workflow

Feed: Big Data Made Simple - One source. Many perspectives.. Author: Baiju NT. The most common and traditional data processing applications are becoming insufficient in handling a great volume of data sets so prominent in corporate computing today. Therefore, it is a little difficult to find a platform which can help the companies stay competitive in this Big Data race. Apache Spark is one such open source tool which is developed for Big Data processing. It is undoubtedly one of the most popular and highly used data processing software. Advantages of using Spark Even processing complex and highly difficult analytics ... Read More

Feed: erwin Expert Blog – erwin, Inc.. Author: Marios Forsos. In the current data-driven business climate, the benefits of process and process-based strategy are more desirable to organizations than ever.Industry regulations and competition traditionally have driven organizational change, but such “transformation” has rarely been comprehensive or truly transformative. Rather, organizational transformation has come in waves, forcing companies and their IT ecosystems to ride them as best as they can – sometimes their fortunes have risen, and sometimes they have waned. The advent of Brexit and GDPR have again forced today’s organizations to confront external stimuli’s impact on their operations. The ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Kateryna Lytvynova. The best trained soldiers can’t fulfill their mission empty-handed. Data scientists have their own weapons — machine learning (ML) software. There is already a cornucopia of articles listing reliable machine learning tools with in-depth descriptions of their functionality. Our goal, however, was to get the feedback of industry experts. And that’s why we interviewed data science practitioners — gurus, really —regarding the useful tools they choose for theirprojects. The specialists we contacted have various fields of expertise and are working in such companies as Facebook and Samsung. Some of them represent AI startups ... Read More

Feed: Cloudera Manager – Cloudera Engineering Blog. Author: Cy Jervis. Cloudera Director 2.6 and Cloudera Manager 5.13 offer a simple way to have TLS configured for Cloudera Manager and CDH clusters. In this blog post, Bill Havanki describes how to use the new feature and offers technical details behind how the automatic configuration happens. An important tenet of information security is defense in depth. The idea behind defense in depth is to have multiple layers of security protecting valued assets, so that if one layer should fail, the others remain working. A real life example of defense in depth is ... Read More

Feed: R-bloggers. Author: Dr. Shirin Glander. I’ll be giving talks and workshops at the following three upcoming conferences; hope to meet some of you there! Traditional machine learning workflows focus heavily on model training and optimization; the best model is usually chosen via performance measures like accuracy or error and we tend to assume that a model is good enough for deployment if it passes certain thresholds of these performance criteria. Why a model makes the predictions it makes, however, is generally neglected. But being able to understand and interpret such models can be immensely important for improving model quality, ... Read More

Feed: R-bloggers. Author: rOpenSci - open tools for open science. Evolutionary biologists are increasingly using R for building,editing and visualizing phylogenetic trees.The reproducible code-based workflow and comprehensive array of toolsavailable in packages such as ape,phangorn andphytools make R an ideal platform forphylogenetic analysis.Yet the many different tree formats are not well integrated,as pointed out in a recentpost. The standard data structure for phylogenies in R is the “phylo”object, a memory efficient, matrix-based tree representation.However, non-biologists have tended to use a tree structurecalled the “dendrogram”, which is a deeply nested list withnode properties defined by various attributes stored at each level.While ... Read More

Feed: Actian. Author: Nick Vancas. The usefulness of an analytic database is closely tied to its ability to ingest, store, and process vast quantities of data. Data is typically ingested from multiple sources such as operational databases, CSV files, and continuous data streams. In most cases, daily data loads are measured in tens or hundreds of millions of rows, so the traditional SQL INSERT mechanism is not well suited for these data volumes.In this blog post we’ll look at Actian Vector, our columnar database ideally suited for analytic applications, and evaluate a variety of CSV data ingestion options that operate ... Read More

Feed: SAS Blogs. Author: Peter Plochan. Dass das Management von Modellrisiken eine umfassende Perspektive erfordert, habe ich in Teil 1 meiner Serie "Modellrisiko – worum geht’s dabei eigentlich?" beschrieben. Diese folgenden fünf Prinzipien sind grundlegend für den Erfolg beim Design und bei der Implementierung eines Model Risk Management Framework: Abbildung 1: Komponenten eines Model Risk Management Framework 1. Decken Sie das gesamte Spektrum in der Modellbildung ab, aber priorisieren Sie dabei Beziehen Sie alle Modelle und alle Prozesse im Modelllebenszyklus in Ihre Aktivitäten ein, die für das Thema Modellrisiko relevant sind. Nutzen Sie diesen ganzheitlichen Blick, um die wichtigsten Bereiche ... Read More

Feed: Alation. Author: Jason Ma. “The key point is that no organization governs information simply because it can; there has to be a business context, and the increasing realization of this context explains the rise of information stewardship applications.”  – May 2018 Gartner Market Guide for Information Stewardship ApplicationsThe rise of data lakes, IOT analytics, and big data pipelines has introduced a new world of fast, big data. Now, agility and self-service are favored over batch processing and dependency on IT. This new world of analytics has introduced a different set of complexities that have propelled IT organizations to build ... Read More

Feed: What's New. Amazon Elastic Container Registry (ECR) now meets the criteria for PCI compliance in AMER, EMEA, and APAC. ECR PCI DSS compliance in China is pending approval. You can now use ECR to store, manage, and deploy Docker container images that are subject to Payment Card Industry Data Security Standard (PCI DSS) compliance. In addition to Amazon ECR, Amazon Elastic Container Service (ECS) also already meets the criteria for PCI compliance in AMER, EMEA, and APAC. PCI DSS is a proprietary information security standard administered by the PCI Security Standards Council and applies to all entities that store, ... Read More