Tag: Hadoop

Feed: R-bloggers. Author: Alastair Rushworth. Exploring categorical data with inspectdf What’s inspectdf and what’s it for? I often find myself viewing and reviewing dataframes throughout thecourse of an analysis, and a substantial amount of time can be spentrewriting the same code to do this. inspectdf is an R package designedto make common exploratory tools a bit more useful and easy to use. In particular, it’s very powerful be able to quickly see the contents ofcategorical features. In this article, we’ll summarise how to use theinspect_cat() function from inspectdf for summarising andvisualising categorical columns. First of all, you’ll need to have ... Read More

Feed: R-bloggers. Author: R on The broken bridge between biologists and statisticians. ANOVA is routinely used in applied biology for data analyses, although, in some instances, the basic assumptions of normality and homoscedasticity of residuals do not hold. In those instances, most biologists would be inclined to adopt some sort of stabilising transformations (logarithm, square root, arcsin square root…), prior to ANOVA. Yes, there might be more advanced and elegant solutions, but stabilising transformations are suggested in most traditional biometry books, they are very straightforward to apply and they do not require any specific statistical software. I do not think ... Read More

Feed: IBM Big Data & Analytics Hub - All Content; Author: holly-vatter; Data scientists are one of the most valuable teams a company can have. But some businesses overlook how important it is to equip their data scientists with the tools that can help them unlock value from data.In particular, it is essential that companies remain adaptive and agile when taking in vast amounts of unstructured data. To get the most value from their data and their data scientists, businesses need a capable, easy-to-use data warehouse that offers built-in data science and parallel processing. These demands point to a data ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Vincent Granville. Monday newsletter published by Data Science Central. Previous editions can be found here. The contribution flagged with a + is our selection for the picture of the week. To subscribe, follow this link.   Featured Resources and Technical Contributions  Assumptions of Linear Regression in One Picture + How to learn the maths of Data Science - using your high school maths knowledge Free Book: Statistics, Dataviz, and Data Cleaning with R  Everything You Wanted To Know About Recommender Systems  Simplified Logistic Regression  Alternatives to R-squared (with pluses and minuses)  Machine Learning : Unsupervised – ... Read More

Feed: R-bloggers. Author: hrbrmstr. I mentioned EtherCalc in a previous post and managed to scrounge some time to put together a fledgling {ethercalc} package (it’s also on GitLab, SourceHut, Bitbucket and GitUgh, just sub out the appropriate URL prefix). I’m creating a package-specific Docker image (there are a couple out there but I’m not supporting their use with the package as they have a CORS configuration that make EtherCalc API wrangling problematic) for EtherCalc but I would highly recommend that you just use it via the npm module. To do that you need a working Node.js installation and I highly ... Read More

Feed: R-bloggers. Author: Ian Johnson. I am going to use regression, decision trees, and the random forest algorithm to predict combined miles per gallon for all 2019 motor vehicles.  The raw data is located on the EPA government site After preliminary diagnostics, exploration and cleaning I am going to start with a multiple linear regression model. The variables/features I am using for the models are: Engine displacement (size), number of cylinders, transmission type, number of gears, air inspired method, regenerative braking type, battery capacity Ah, drivetrain, fuel type, cylinder deactivate, and variable valve.  There are 1253 vehicles in the dataset ... Read More

Feed: R-bloggers. Author: Niklas Junker. Networks are everywhere. We have social networks like Facebook, competitive product networks or various networks in an organisation. Also, for STATWORX it is a common task to unveil hidden structures and clusters in a network and visualize it for our customers.In the past, we used the tool Gephi to visualize our results in network analysis. Impressed by this outstanding pretty and interactive visualization, our idea was to find a way to do visualizations in the same quality directly in R and present it to our customers in an R Shiny app. Our first intention was ... Read More

Feed: R-bloggers. Author: Sean Lopp. This RStudio Connect patch release addresses an urgent security update and an important bug fix. Security Update: Password AuthenticationA vulnerability has been identified for customers using RStudio Connect’s built-in password authentication. Due to the risks involved, password authentication will now require the configuration setting Server.Address for operations that will send emails. If this setting is not configured an error will occur for these operations. More detailed information about the vulnerability will be released in a future post. We have received no reports of impacted customers, but we recommend customers using password authentication upgrade immediately. Bug ... Read More

Feed: R-bloggers. Author: Mango Solutions. We are delighted to announce that Helen Hunter, Chief Data Officer at Sainsbury’s will deliver the opening keynote address at this year’s London EARL conference. As Chief Data Officer at Sainsbury’s plc, Helen’s remit is to maximise the value of the Group’s data asset: democratising access and finding creative ways to unlock its insight potential in support of Sainsbury’s strategy to ‘know our customers better than anyone else’ Over the last 8 years at Sainsbury’s in roles including Director of Innovation, and Director of Data and Relationship Marketing, Helen has brought to bear her experience ... Read More

Feed: Teradata Blog. You probably already know that leading analyst firms have been quoting data lake failure rates of 85% for some time now. You may not be aware that one of those same leading analyst firms are now also forecasting that, by 2020, 30% of data lakes will be built on standard relational DBMS (database management system) technology “at equal or lower cost than Hadoop” because – and I quote - “application performance is superior” and “most data going into data lakes is relational.” Put those two things together and you start to understand why MapR has recently gone to the ... Read More