Category: MongoDB

Feed: CronJ. Author: Ayush Goel; As discussed in my last blog, there are 2 types of databases SQL and NoSQL. So in this blog, we will be looking at one type of NoSQL database that is MongoDB. MongoDB is an example of a document-type database, which means it stores data in JSON-like documents. One of the biggest reasons for its popularity is the data model used is a highly elastic one that allows us to combine and store data of multivariate types. MongoDB Architecture Let’s first discuss the architecture of MongoDB. A typical MongoDB architecture has 3 parts-  Database: A database ... Read More

Feed: CronJ. Author: Vignesh M; AI is been in our imagination for the last 40 50 years.In fact, from all the way from 2001 Space Odyssey to even like Ex Machina, there’s been a lot of movies about our fascination with AI.Unfortunately, that’s been a very negative twist around AI because ultimately all those movies are about the machines turning on humans and ultimately killing them. So I would like to offer a more optimistic outlook about AI. But it’s clear that this is something that’s really caught our imagination.The other thing that was clear was that this is all ... Read More

Feed: DivvyCloud. Author: David Mundy; by David Mundy | Jul 30, 2019 | Amazon Web Services, Blog Post, Security Capital One Data Breach Impacts 100 Million Customers In yet another cloud misconfiguration involving AWS S3 Buckets, Capital One joins Facebook as another major enterprise to expose the data of over 100 million users. What happened? It would appear that Capital one... by David Mundy | Jul 29, 2019 | Blog Post, Product Information, Security DivvyCloud Listed in CRN's 2019 Emerging Vendors List We are honored to announce that DivvyCloud was included on CRN’s 2019 list of “Emerging IT Vendors You Need ... Read More

Feed: DivvyCloud. Author: David Mundy; by David Mundy | Jun 7, 2019 | Blog Post, Security JCrush Joins the Database Leak Club Last week, TechCrunch reported security researchers at vpnMentor discovered that JCrush, a dating app designed for the Jewish community, left a MongoDB database containing 18.454 GB of unencrypted records unprotected and publicly... by David Mundy | Jun 5, 2019 | Amazon Web Services, Blog Post, Compliance, Containers, Google Cloud Platform, Governance, Microsoft Azure, Product Information, Security DivvyCloud is a way to deploy policy, minimize blast radius, and give developers the freedom to operate within the guide rails of ... Read More

Feed: Cloud Data Transformation Software | Matillion. Author: Laura Malins, ETL Product Manager; Laura Malins, ETL Product ManagerAt their recent summit, Snowflake announced support for External Tables. This represents an advancement in data storage as users can now store, query and manage data both in their Snowflake data warehouse and out in object cloud storage. External Tables allow Snowflake users to query data across their Snowflake cloud data warehouse and data in external storage objects, bringing users closer to their data, in a performant and cost efficient manner. We are happy to announce that External Tables are fully supported in ... Read More

Feed: DivvyCloud. Author: David Mundy; by David Mundy | Jun 5, 2019 | Amazon Web Services, Blog Post, Compliance, Containers, Google Cloud Platform, Governance, Microsoft Azure, Product Information, Security DivvyCloud is a way to deploy policy, minimize blast radius, and give developers the freedom to operate within the guide rails of safety. Feature Release 19.2 Introducing Compliance Scorecard, Threat Detection, IaC Protection, and Enhanced IAM Protection   We are... by David Mundy | Jun 5, 2019 | Product Information, Security DivvyCloud Wins 2019 Fortress Cyber Security Award for Private & Public Cloud The Business Intelligence Group today announced that DivvyCloud ... Read More

Feed: Cloud Data Transformation Software | Matillion. Author: Laura Malins, ETL Product Manager; Laura Malins, ETL Product ManagerData in a MongoDB database can have many nested elements, including both arrays and structs. Some of the top-level objects can be flattened via the MongoDB component, but this still leaves many nested arrays in the data. Here we look at how to flatten out this data in a Transformation job using Snowflake’s JSON handling functionality.Data formatAn example of the format is below. Here the many nested arrays and structs can be seen.Snowflake has native functionality for handling the nested JSON using the ... Read More

Feed: Cloud Data Transformation Software | Matillion. Author: Laura Malins, ETL Product Manager; Laura Malins, ETL Product ManagerData in a MongoDB database can have many nested elements, including both arrays and structs. Some of the top-level objects can be flattened via the MongoDB component, but this still leaves many nested arrays in the data. Here we look at how to flatten out this data in a Transformation job using Snowflake’s JSON handling functionality.Data formatAn example of the format is below. Here the many nested arrays and structs can be seen.Snowflake has native functionality for handling the nested JSON using the ... Read More

Feed: DivvyCloud. Author: David Mundy; This misconfiguration epidemic has seen the theft or loss of more than 14 billion data records in the last five years as reported by Breach Level Index. Misconfiguring a cloud database, storage container, or search engine can have massive consequences, especially if they contain personal information. Just ask Facebook, when earlier this year, 540 million user records were exposed due to a misconfigured S3 bucket. A publicly accessible MongoDB database with misconfigured settings put Verification.io in the news when they exposed 150 gigabytes of customer data. Elasticsearch, a more recent culprit, left companies including Rubrik, ... Read More

Feed: Cloud Data Transformation Software | Matillion. Author: Laura Malins, ETL Product Manager; Laura Malins, ETL Product ManagerA customer came to us who had lots of data in a MongoDB with many nested elements. Including both arrays and structs. Their previous workflow was to load this data into an Amazon Redshift table. The MongoDB component within Matillion ETL for Amazon Redshift would then flatten the top-level objects, but this still left many nested arrays. Therefore, a Transformation job was used to flatten the remaining arrays and JSON structures by cross joining to a sequencer table to catch each array element ... Read More