Tag: Documentation

Feed: R-bloggers. Author: rOpenSci - open tools for open science. The grainchanger package provides functionality for data aggregation to a coarser resolution via moving-window or direct methods. Why do we need new methods for data aggregation? As landscape ecologists and macroecologists, we often need to aggregate data in order to harmonise datasets. In doing so, we often lose a lot of information about the spatial structure and environmental heterogeneity of data measured at finer resolution. The issues around scale disconnects are both conceptual and practical: Conceptual issues Technical issues The scale we measure this stuff at varies too Ecological response ... Read More

Feed: Redis Labs. Author: Chris Cheung. At RedisConf19, we officially released a new module called Redis Gears. You may have already seen some other modules by either Redis Labs or the community at large, but Gears will defy any expectations you have. It really pushes the limits of what is possible with modules. Gears scripts At first glance, Redis Gears looks like a general-purpose scripting language that can be used to query your data in Redis. Imagine having a few hashmaps in your Redis database with user-related information such as age and first/last name. Here is the execution breakdown for ... Read More

Feed: R-bloggers. Author: rOpenSci - open tools for open science. We’re delighted to announce that we have received new funding from the Alfred P. Sloan Foundation. The $678K grant, awarded through the Foundation’s Data & Computational Research program, will be used to expand our efforts in software peer review. Software peer review has become a core part of rOpenSci, helping improve scientific software quality, drive best engineering practices into scientific communities, and building community and collaboration through open, constructive reviews. We’re excited to expand our work in this important area. Here’s what we’ll be doing in the next two years ... Read More

Feed: R-bloggers. Author: Jamie Lendrum. Introduction This post will be taking a bit of an unexpected diversion. As I was experimenting with hierarchical clustering I ran into the issue of how many clusters to assume. From that point I went deep into the rabbit hole and found out some really useful stuff that I wish I’d have known when I wrote my previous post. I’ve discovered that choosing a number of clusters is a whole topic in itself, and there are, in general, two ways of validating a choice of cluster number: Internal validation indices – these use the properties ... Read More

Feed: All - O'Reilly Media. Author: Ben Lorica, Harish Doddi, David Talby. Monument in Bydgoszcz (source: Krzysztof Mizera on Wikimedia Commons) Check out the "Financial Services" sessions at the Strata Data Conference in New York City, September 23-26, 2019. Early price ends August 9. As companies use machine learning (ML) and AI technologies across a broader suite of products and services, it’s clear that new tools, best practices, and new organizational structures will be needed. In recent posts, we described requisite foundational technologies needed to sustain machine learning practices within organizations, and specialized tools for model development, model governance, and ... Read More

Feed: SAS Blogs. Author: Rick Wicklin. Heat maps have many uses. You can use a heat map to visualize correlation matrices, to visualize longitudinal data ("lasagna plots"), and to visualize counts in any two-dimensional table. As of SAS 9.4m3, you can create heat maps in SAS by using the HEATMAP and HEATMAPPARM statements in PROC SGPLOT. Prior to SAS 9.4m3, you could create heat maps by using the Graph Template Language (GTL) in Base SAS or the HeatmapCont and HeatmapDisc functions in SAS/IML software. I like to emphasize the difference between a continuous heat map and a discrete heat map ... Read More

Feed: Microsoft Azure Blog. Author: Ziv Rafalovich. Co-locate your Azure resources for improved application performance The performance of your applications is central to the success of your IT organization. Application performance can directly impact your ability to increase customer satisfaction and ultimately grow your business. Many factors can affect the performance of your applications. One of those is network latency which is impacted, among other things, by the physical distance between the virtual machines deployed. For example, when you place your Microsoft Azure Virtual Machines in a single Azure region, the physical distance between the virtual machines is reduced. Placing ... Read More

Feed: R-bloggers. Author: Mark White. Simulating data is an invaluable tool. I use simulations to conduct power analyses, probe how robust methods are to violating assumptions, and examine how different methods handle different types of data. If I’m learning something new or writing a model from scratch, I’ll simulate data so that I know the correct answer—and make sure my model gives me that answer. But simulations can be complicated. Many other programming languages require for loops to do a process multiple times; nesting many conditional statements and other for loops within for loops can quickly be difficult to read ... Read More

Feed: R-bloggers. Author: John Mount. While reading Dr. Nina Zumel’s excellent note on bias in common ensemble methods, I ran the examples to see the effects she described (and I think it is very important that she is establishing the issue, prior to discussing mitigation). In doing that I ran into one more avoidable but strange issue in using xgboost: when run for a small number of rounds it at first appears that xgboost doesn’t get the unconditional average or grand average right (let alone the conditional averages Nina was working with)! Let’s take a look at that by running a ... Read More

Feed: MemSQL Blog. Author: Jacky Liang. MemSQL Forums are available anytime you have a question about MemSQL, want to know more about MemSQL, or are willing and able to help others. And now the MemSQL Forums, coming up on their one-year anniversary, have their first Community Star: Ziv Meidav, a big data architect. The community of MemSQL users, developers, and employees gather at the MemSQL Forums to ask questions, offer support, and discuss strategies for leveraging MemSQL. Got a nasty error message? Post it on a Forum. Want to suggest a feature? Same thing. What the MemSQL Forums Do The ... Read More