Category: Datawarehousing

Feed: Recent Announcements. Starting today, you can use Glue Spark ETL jobs to read, transform, and load data from Amazon DocumentDB (with MongoDB compatibility) and MongoDB tables into services such as Amazon S3 and Amazon Redshift for downstream analytics ... Read More

Feed: AWS Partner Network (APN) Blog. Author: Sanjay Nighojkar. By Suraj Nathani, Sr. Solutions Architect at Mactores CognitionBy Anil Patel, Data Engineer at Mactores CognitionBy Sanjay Nighojkar, Manager, Partner Solutions Architect at AWSSeagate Technology is a United States-based data storage company with worldwide manufacturing facilities that generate huge amounts of manufacturing and testing data. With petabytes of data accumulated over 20 years, and more being generated each day, it was imperative for Seagate to have systems in place to ensure the cost of collecting, storing, and processing data did not exceed their return on investment (ROI). Seagate’s on-premises big data ... Read More

Feed: Matillion. Author: Julie Polito; Over the years, I’ve been extremely fortunate to be a part of some truly amazing teams. Thinking back, if I had to choose just one attribute that contributed to our shared success, it would be the relentless pursuit of greater efficiency. This is, of course, a very broad and multi-faceted topic where  opportunities abound, so it can be difficult to decide where to focus time and energy when expounding upon it. But in this case, it’s pretty clear what made the difference. No surprise, It’s collaboration It’s no coincidence that these particular teams placed a ... Read More

Feed: Teradata Blog. Bayes’ theorem, also known as Bayes’ rule or Bayes’ law named after 18th-century British mathematician Thomas Bayes, is a mathematical formula used to calculate conditional probability. In other words, it is used to calculate the probability of an event based on its association with another event. It incorporates prior knowledge while calculating the probability of occurrence of the same in the future. It is often used in today’s highly demanding Machine Learning and Artificial Intelligence applications and is now one of the most useful concepts for understanding few Vantage algorithms to predict the probability of an outcome. So, let’s try to understand ... Read More

Feed: Recent Announcements. Previously, we launched the now popular RA3.16xlarge nodes for the largest workloads with 48vCPUs, 384 GiB of memory, and support for up to 64TB of Redshift managed storage per node. RA3.4xlarge nodes offer one-fourth compute (12 vCPU), and memory (96 GiB) compared to RA3.16xlarge at one-fourth of the price. By choosing the RA3 node size and number of nodes, you can now provision the right amount of compute for your workload. RA3 nodes are built on the AWS Nitro System and feature high bandwidth networking and large high-performance SSDs as local caches. RA3 nodes leverage your workload ... Read More

Feed: MemSQL Blog. Author: Floyd Smith. Analyst firm 451 Research has come up with new research that sees a bright future for HOAP – hybrid operational and analytical processing. The report is titled 451 Perspective: A HOAP-ful future for hybrid operational and analytical processing. This new type of processing has received several different names, from different analyst firms and consultancies: By any of these names, this new style of data processing – which unifies transactions and operational analytics, including many data warehousing-type functions – is widely believed to have a bright future. And MemSQL is right in the middle of ... Read More

Feed: Matillion. Author: Julie Polito; Want the very best Matillion ETL experience? Each new version of Matillion ETL is better than the last. Make sure you are on the latest version to take advantage of the new features, new components, and improvements. In this blog, find out about the new components, features, and improvements introduced in Matillion ETL v1.44.  New and updated data source components Box component (new) and Data Transfer component (update)  Box contains a lot of data files, most commonly CSV files and spreadsheets. This component will tell you what data exists within the Box and help you ... Read More

Feed: Matillion. Author: Julie Polito; We’ve updated all of our Matillion ETL base operating systems on your virtual machine (VM) to use a CentOS Operating System, Apache Tomcat version 8.5.51 and an internal Postgres database. This will be available for all new spin-ups of Matillion ETL across all platforms and products from version 1.44 onwards. In-place upgrades, that is, updates performed either using the ‘Update’ button from the Admin Menu or manually via ‘yum’, will mean the VM will remain on your existing Operating System and version of Tomcat. Therefore we recommend that you spin up a new instance and ... Read More

Feed: Actian. Author: Pradeep Bhanot. Having a lot of data available to you is a good thing, right?  That depends.  Data is a raw material, like a mineral mined from the ground.  It contains a potential for creating value, but that potential is only realized through refinement.Your company produces a lot of data every day (every second really). Merely creating and/or possessing this data doesn’t mean it is generating value for you.  Harvesting value from your company data requires a transformation process to convert data into information, to actionable insights, to decisions, and then to action. Data management professionals, IT ... Read More

Feed: Actian. Author: Sampa Choudhuri. Modern businesses don’t run on a single application – they leverage many IT systems to provide the capabilities to enable operational processes and users to be effective.  To ensure complex IT environments run smoothly, companies are placing increased focus on how systems are integrated, and the activities required to manage integrations across the ecosystem.  While system integration is a multi-layered challenge, the essential part to get right is your enterprise data integration strategy.An enterprise data integration strategy is a set of policies, processes, design guidelines, and governance controls that you put in place to ensure ... Read More