Tag: statistics

Feed: Featured Blog Posts - Data Science Central. Author: sairam. Data Science has been coined everywhere, and everybody wants to express their views and thoughts on this subject even though they are a novice or lack adequate knowledge about data science! The idea that everyone can become a data scientist only by studying a few technological advances and solving any complicated problems cripples the world today.  Let us first understand the career perspectives of data science. Data science has three pillars: Business Expert - Data Analyst Technology Expert - Data Engineer Statistics & Algorithm - Data Scientist First, make it ... Read More

Feed: Featured Blog Posts - Data Science Central. Author: Sergey Lukyanchikov. InterSystems IRIS – the All-Purpose Universal Platform for Real-Time AI/ML Author: Sergey Lukyanchikov Challenges of real-time AI/ML computations We will start from the examples that we faced as Data Science practice at InterSystems: A “high-load” customer portal is integrated with an online recommendation system. The plan is to reconfigure promo campaigns at the level of the entire retail network (we will assume that instead of a “flat” promo campaign master there will be used a “segment-tactic” matrix). What will happen to the recommender mechanisms? What will happen to data ... Read More

Feed: Planet PostgreSQL. This diary-of-an-engineer post from our Citus open source engineering team was originally published on the Azure Postgres Blog. When working on the internals of Citus, an open source extension to Postgres that transforms Postgres into a distributed database, we often get to talk with customers that have interesting challenges you won’t find everywhere. Just a few months back, I encountered an analytics workload that was a really good fit for Citus. But we had one problem: the percentile calculations on their data (over 300 TB of data) could not meet their SLA of 30 seconds. To make ... Read More

Feed: R-bloggers. Author: Theory meets practice.... Abstract:We attempt a mathematical description of the risk scoring algorithm used in the Google and Apple exposure notification framework (v1). This algorithm is used in many digital contact tracing apps for COVID-19, e.g., in Germany or Switzerland. This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. The markdown+Rknitr source code of this blog is available under a GNU General Public License (GPL v3) license from github.MotivationMy phone runs a digital COVID-19 contact tracing app based on the Apple and Google exposure notification (GAEN) framework [Apple| Google| Wikipedia]. Since my future health ... Read More

Feed: AWS Public Sector Blog. Author: Nader Nanjiani. According to the National Center for Education Statistics, only 60 percent of college students receive a degree within six years. Universities—like Portland State University (PSU) and Oklahoma State University (OSU-OKC)—are using data lakes for analytics and machine learning to improve academic achievement by helping students reach their educational goals faster.And now, with the launch of an Education Pricing Program (EPP) for Amazon Simple Storage (Amazon S3), education institutions can use storage to build a data lake for up to 45 percent off public pricing for the S3 One Zone–Infrequent Access and S3 ... Read More

Feed: AWS Big Data Blog. Stream processing is very useful in use cases where we need to detect a problem quickly and improve the outcome based on data, for example production line monitoring or supply chain optimizations.This blog post walks you through process of streaming existing data files and ongoing changes from Amazon Simple Storage Service (Amazon S3) to Amazon Kinesis. You achieve this by using AWS Database Migration Service (AWS DMS). AWS DMS enables you to seamlessly migrate data from supported sources to relational databases, data warehouses, streaming platforms, and other data stores in AWS cloud. Many SaaS, third-party ... Read More

Feed: R-bloggers. Author: Kelly Loucks. Each winter season, avalanches pose a serious threat to those who adventure in mountainous regions. An avalanche is defined as a mass of snow sliding, flowing, or tumbling down an inclined surface, typically destroying everything in its path. This post showcases the history of various activities that contribute to the total avalanche deaths that occur in the United States every year. Data – CAICThe Colorado Avalanche Information Center (CAIC) collected data on avalanches from 1951 to 2020. The dataset includes a date, setting, state, primary activity, and number of deaths for each avalanche event that resulted ... Read More

Feed: CronJ. Author: Nupur Pal; Since the outbreak of the novel corona-virus, UX design for kids and adults are in high demand .With the outbreak of COVID-19 pandemic we have seen a major shift from the offline to the online world.People have started using online facilities to buy daily necessities from online grocery stores via apps.Furthermore, with the help of many video conferencing apps, education has also shifted to the online platform .According to statistics, there is an increase of 36-40% of screen time. This percentage is particularly for kids, who spend most of the time online for their education.But ... Read More

Feed: SAS Blogs. Author: Yiu-Fai Yung. A note from Udo Sglavo: In Digital transformation, scientific computing, and peace of mind, I mention that the COVID-19 pandemic is paralyzing the world. However, new challenges are also inspiring new ideas to tackle those challenges. We might ask questions about what is causal in nature, trying to figure out relationships among various aspects of life. But hang on: didn’t we learn that correlation does not imply causation? In this post, Yiu-Fai Yung, Senior Manager in Scientific Computing R&D, introduces causal analysis techniques and illustrates how we can understand and evaluate the impact of ... Read More

Feed: Planet PostgreSQL. Sometimes, PostgreSQL databases need to import large quantities of data in a single or a minimal number of steps. This is commonly known as bulk data import where the data source is typically one or more large files. This process can be sometimes unacceptably slow. There are many reasons for such poor performance: indexes, triggers, foreign keys, GUID primary keys, or even the Write Ahead Log (WAL) can all cause delays. In this article, we will cover some best practice tips for bulk importing data into PostgreSQL databases. However, there may be situations where none of these ... Read More