Tag: storage

Feed: AWS Government, Education, & Nonprofits Blog. Author: publicsector. We hope you have had a chance to catch up on the security and compute services announced at re:Invent. Next up, we have the re:Invent updates on storage and ingestion that will benefit our public sector customers.AWS Snowball Edge – Petabyte-scale Data Transfer with On-Board Compute AWS Snowball Edge is our newest 100TB data transfer device, offering highly secure, on-board storage and in-flight compute capabilities with AWS Greengrass. Organizations can use AWS Snowball Edge to move massive amounts of data into and out of the AWS Cloud, use the device as ... Read More

Feed: MapD Blog - Thoughts on GPU databases, data visualization and integrated analytics. Author: Todd Mostak. 2016 was a pretty amazing year for MapD. Not only did we launch our company with the announcement of our A Round of funding in late March, but we were able to steadily build on that event throughout the year, culminating in the release of our 2.0 version of the product just nine months later. In the interim, we were fortunate to pick up some prestigious awards including Gartner Cool Vendor, Fast Company Innovation by Design, The Business Intelligence Group’s Startup of the Year, ... Read More

Feed: Planet MySQL. Author: MySQL Performance Blog. Barrett Chambers  | November 14, 2016 |  Posted In: MongoDB, MySQL PREVIOUS POST This blog post looks at MongoDB and MySQL, and covers high-level MongoDB strengths, weaknesses, features, and uses from the perspective of an SQL user. Delving into NoSQL coming from an exclusively SQL background can seem like a daunting task. I have worked with SQL in both small MySQL environments and large Oracle SQL environments.  When is it a good choice? MongoDB is an incredibly robust, scalable, and operator-friendly database solution. MongoDB is a good choice when your developers will also be responsible for ... Read More

Feed: AWS Compute Blog. Author: Stefano Buliani. This is a guest post from Linda Hedges, Principal SA, High Performance Computing.—–One question we often hear is, “How well will my application scale on AWS?” For high performance computing (HPC) workloads that cross multiple nodes, the cluster network is at the heart of scalability concerns. AWS uses advanced Ethernet networking technology, which, like all things AWS, is designed for scale, security, high availability, and low cost. This network is exceptional and continues to benefit from Amazon’s rapid pace of development. Again and again, customers find that the most demanding applications run very ... Read More

Feed: Planet PostgreSQL. It’s a common misconception that high volume read-write workloads in PostgreSQL inevitably causes database inefficiency. We’ve heard of cases where users encounter slowdowns doing only a few hundred writes per second and turn to systems like Dynamo or Cassandra out of frustration. However PostgreSQL can handle these workloads without a problem as long as it is configured correctly. The problems stem from what’s known as “bloat,” a phenomenon of PostgreSQL and other MVCC databases which causes increased space usage and decreased performance. We’ll see how autovacuum, a tool to combat bloat, is typically misunderstood and misconfigured. By ... Read More

Feed: Planet MySQL. Author: Pinterest Engineering. Pinterest’s stateful online systems process tens of petabytes of data every day. As we build products and scale billions of Pins to 150 million people, we need new applications that work in a way where computation co-locates with data. That’s why we adopted RocksDB. It’s adaptable, supports basic and advanced database operations with high performance and meets the majority of requirements for building large-scale, production-strength distributed stateful services. Yet two critical pieces were missing for us: real-time data replication and cluster management for RocksDB-based stateful services. To fill this gap, we built a RocksDB ... Read More

Feed: Planet PostgreSQL. There are couple of different ways to implement database encryption – commonly on operating system, filesystem, file or column level, leaving out transport level encryption which is supported since 15 years. Each of those approaches counters a different threat model, and one can easily imagine that in the case of databases, where the systems were originally not designed with encryption in mind, it is not exactly easy to first agree on a certain way of doing things – and then there would be for sure a lot of technical pitfalls on the way. But today, after a ... Read More

Feed: Planet big data. Author: dereksdata. Apache Kudu is now out in the wild and already making waves. Here’s why you should care.In short, Apache Kuduhttp://kudu.apache.org/is a distributed datastore-as-a-filesystem.Kudu essentially takes over at the Avro/Parquet/ORC layer for what is nowadays called ‘lambda architectures’ (because we need more jargon, yeah?). There is considerable engineering, operations and data munging being performed on a mature Hadoop cluster that can be attributed to working around the limitations of HDFS, which is designed and optimised for analysis of large scale read-only type data. Solutions to support near-real time work such as HBase work around this ... Read More

Feed: Planet PostgreSQL. One of the few areas where out-of-the-box functionality by PostgreSQL is not 100% satisfying is the “bloat problem”. Combating bloat or just trying to ensure that your table data is physically ordered according to some column(s) (a.k.a. clustering) until now required accepting some inconvenient compromises. Extended periods of full table locking (no read or write activities) with built-in VACUUM FULL or CLUSTER commands or involving third party tooling, usually meaning “pg_repack”, were necessary. “pg_repack” offers good benefits like a lot smaller full-lock time, ordering by specific columns, but needs a bit of fiddling around – installing the ... Read More

Feed: Databasejournal.com - Feature Database Articles. Author: . By Seth Proctor, CTO, NuoDB Today, organizations are spending a lot of time trying to simplify, align development with operations, and manage commodity or virtualized resources on-demand. This helps to reduce costs, improve efficiency and evolve solutions in a more agile fashion. Over the past few years, I’ve been having conversation after conversation with architects, developers, and CTOs around Docker and container computing. As a long-time Sun Microsystems engineer, these are familiar topics, but the recent popularity is still impressive. These conversations are with large companies and small, in virtually every industry, ... Read More