Tag: column

Feed: R-bloggers. Author: R on Jacob Long. It has been a long time coming, but my R packagepanelr is now onCRAN. Since I started work on itwell over a year ago, it has become essential to my own workflow and I hopeit can be useful for others. panel_data object class One key contribution, that I hope can help other developers, is the creation ofa panel_data object class. It is a modified tibble, which is itself amodified data.frame. panel_data frames are grouped by entity, so manyoperations (e.g., mean(), cumsum()) performed by dplyr’s mutate()are groupwise operations. The panel_data frame also works very ... Read More

Feed: R-bloggers. Author: Giorgio Garziano. Category Tags This is the fourth part of our post series about the exploratory analysis of a publicly available dataset reporting earthquakes and similar events within a specific 30 days time span. In this post, we are going to show a cluster analysis of earthquakes located into the California state mainland. In the specific we will show a California map where earthquakes are highlighted by different color based on their magnitude we will determine the optimal number of clusters by means of the elbow method we will take advantage of the kmeans clustering;k-means clustering aims ... Read More

Feed: R-bloggers. Author: Anindya Mozumdar. If you search for the phrase “fastest man on earth” in Google, chances are that it will return the answer “Usain Bolt”. It certainly does so for me, even though the results might be different if Google decides to personalize the results for you. This is because currently he holds the world record for being the quickest (9.58s) to run a 100 metres race. Justin Gatlin once did it in 9.45s, but that does not count as the record because he was assisted by the wind. However, as statisticians, we know that a single data ... Read More

Feed: Microsoft Power BI Blog | Microsoft Power BI. Author: . We have an exciting release this month. On top of incremental improvements for several of our recent released features, such as the key influencers visual and our new filter pane, we also have a new performance analyzer pane. This new pane lets you get a behind the scenes view of what’s happening when your report is loading, which can help you optimize your report and improve your end user’s experience. Here’s the complete list of May updates: Reporting Analytics Modeling Visualizations Data connectivity Other For a summary of the ... Read More

Feed: SAS Blogs. Author: Nuth Ratanachu-ek. Customer risk rating models play a crucial role in complying with the Know Your Customer (KYC) and Customer Due Diligence (CDD) requirements, which are designed to assess customer risk and prevent fraud. Today, the most common form of the Customer Risk Rating model is a score-based risk rating model. This model looks at customer attributes, assigns a score to an attribute, and aggregates those risks into a customer risk score. The aggregation can range from a method as simple as adding or subtracting scores, applying weights before summing up the value, or other sophisticated ... Read More

Feed: AWS Big Data Blog. You generally write unit tests for your code, but do you also test your data? Incorrect or malformed data can have a large impact on production systems. Examples of data quality issues are:Missing values can lead to failures in production system that require non-null values (NullPointerException). Changes in the distribution of data can lead to unexpected outputs of machine learning models. Aggregations of incorrect data can lead to wrong business decisions. In this blog post, we introduce Deequ, an open source tool developed and used at Amazon. Deequ allows you to calculate data quality metrics ... Read More

Feed: MariaDB Knowledge Base Article Feed. Author: . MariaDB starting with 10.4.0Beginning in MariaDB 10.4, you can control the ordering of execution on table operations using parentheses. Syntax ( expression ) [ORDER BY [column[, column...]]] [LIMIT {[offset,] row_count | row_count OFFSET offset}] Description Using parentheses in your SQL allows you to control the order of execution for SELECT statements and Table Value Constructor, including UNION, EXCEPT, and INTERSECT operations. MariaDB executes the parenthetical expression before the rest of the statement. You can then use ORDER BY and LIMIT clauses the further organize the result-set. Note: In practice, the Optimizer may ... Read More

Feed: R-bloggers. Author: John Mount. In this note we share a quick study timing how long it takes to perform some simple data manipulation tasks with R data.frames. We are interested in the time needed to select a column, alter a column, or select a row. Knowing what is fast and what is slow is critical in planning code, so here we examine some common simple cases. It is often impractical to port large applications between different work-paradigms, so we use porting small tasks as approximate stand-ins for measuring porting whole systems. We tend to work with medium size data ... Read More

Feed: R-bloggers. Author: rOpenSci - open tools for open science. NASA generates and provides heaps of data to the scientific community. Not allof it is looking out at the stars. Some of it is looking back at us here onEarth. NASA’s Earth science program observes, understands and models theEarth system. We can use these data to discover how our Earth is changing,to better predict change, and to understand the consequences for life on Earth. The Earth science program includes thePrediction of Worldwide Energy Resource (POWER)project, which was initiated to improve upon the current renewable energy dataset and to create new ... Read More

Feed: R-bloggers. Author: Chuck Powell. Every time there is a new major update from The RFoundation (like the recent 3.6.0release in April). I’m always happy to seethe continuing progress and the combination of new features and bugfixes, but I also dread the upgrade because it means I have to addressthe issue of what to do about the burgeoning number of packages(libraries) I have installed. Up until now I confess I simply have sort of “winged it”, done theupgrade and either manually thought about what packages I “really”needed or just grabbed a few essentials and then let my needs dictatewhatever else ... Read More