Tag: metadata

Feed: Recent Announcements. You can now access your instance's tags from the EC2 Instance Metadata Service. Tags enable you to categorize your AWS resources in different ways, for example, by purpose, owner, or environment. This is useful when you have many resources of the same type—you can quickly identify a specific resource based on the tags that you've assigned to it. Previously, you could access your instance tags from the console or by using the describe-tags API. Now, by accessing tags from your instance metadata, you no longer need to use the DescribeInstance or DescribeTag API calls to retrieve tag ... Read More

Feed: Recent Announcements. Today, Amazon Location Service added metadata for tracking position updates to help developers reduce cost, improve accuracy, and simplify the development of tracking applications. Amazon Location Service Trackers already make it easy for developers to build highly scalable device-tracking applications by enabling them to retrieve the current and historical location of their tracked devices, and automatically evaluate device-positions relative to linked areas of interest (geofences). With the new metadata feature, developers can enrich these applications with additional information about each device’s position, for example the speed, direction, or engine temperature of vehicles, by including three user-defined key-values pairs ... Read More

Feed: Recent Announcements. SageMaker Model Registry, a purpose-built service which enables customers to catalog their ML models, now provides endpoint visibility from Studio UI, ability to store custom metadata and view/store broad array of metrics for a given model. SageMaker Model Registry catalogs customer’s models in a logical group (a.k.a. model group) and stores incremental versions of models as model package versions. Now, customers can associate custom metadata and custom metrics on a model package version. They can also store a broad array of metrics and baselines on a model package version; such as- data quality, model quality, model bias ... Read More

Feed: AWS Architecture Blog. As you increase the number of objects in Amazon Simple Storage Service (Amazon S3), you’ll need the ability to search through them and quickly find the information you need. In this blog post, we offer you a cost-effective solution that uses a serverless architecture to search through your metadata. Using a serverless architecture helps you reduce operational costs because you only pay for what you use. Our solution is built with Amazon S3 event notifications, AWS Lambda, AWS Glue Catalog, and Amazon Athena. These services allow you to search thousands of objects in an S3 bucket ... Read More

Feed: Cloudera Blog. Author: Xiaoyu Yao. Posted in Technical | June 02, 2021 11 min read Apache Ozone is a distributed object store built on top of Hadoop Distributed Data Store service.  It can manage billions of small and large files that are difficult to handle by other distributed file systems. As an important part of achieving better scalability, Ozone separates the metadata management among different services:  Ozone Manager (OM) service manages the metadata of the namespace such as volume, bucket and keys.Storage Container Manager(SCM) service manages the metadata of the cluster nodes and all the containers and pipelines.Datanode service ... Read More

Feed: Recent Announcements. This January, we launched Amazon EMR integration with Apache Ranger, a feature that allows you to define and enforce database, table, and column-level permissions when Apache Spark users access data in Amazon S3 through the Hive Metastore. Previously, with Apache Ranger is enabled, you were limited to only being able to read data using Spark SQL statements such as SHOW DATABASES and DESCRIBE TABLE. Now, you can also insert data into, or update the Apache Hive metadata tables with these statements: INSERT INTO, INSERT OVERWRITE, and ALTER TABLE. This feature is enabled on Amazon EMR 6.4 in the following ... Read More

Feed: R-bloggers. Author: %>% dreams. [This article was first published on %>% dreams, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here) Want to share your content on R-bloggers? click here if you have a blog, or here if you don't. I joined RStudio to contribute to their blog, and the first thing I did was use R to pull metadata from the blog. Related ... Read More

Feed: Recent Announcements. The Amazon EC2 Instance Metadata Service, Amazon Time Sync Service, and Amazon VPC DNS server can now be accessed over IPv6 endpoints by instances built on the Nitro System. These local instance services have IPv6 addresses that can be accessed from your Amazon EC2 instances. These IPv6 endpoints use Unique Local Addresses (ULA); IPv6 for local instance services is useful for running software and containers in an IPv6-only single stack configuration. Additionally, if you are starting your transition to IPv6 in a dual-stack environment, the endpoints for the Instance Metadata Service, Amazon Time Sync Service, and Amazon ... Read More

Feed: Alation. Author: Jason Rushin. July 19, 2021 — What Is Metadata? Metadata is information about data. A clothing catalog or dictionary are both examples of metadata repositories. Indeed, a popular online catalog, like Amazon, offers rich metadata around products to guide shoppers: ratings, reviews, and product details are all examples of metadata. An asset alone is just the tip of the iceberg; metadata tells you “what lies beneath.” Folks who work closely with data, like analysts, data scientists, and IT teams, rely on metadata to give them crucial context for how to use a given asset. Today, metadata is ... Read More

Feed: Recent Announcements. AWS Elemental MediaPackage now supports timed ID3 metadata passthrough for live and VOD streams in HLS, CMAF, and DASH formats. ID3 metadata tags enable data to be embedded into video streams at specified timecodes and used by downstream systems or clients to enhance the playback experience. By dynamically adding metadata to a stream, you can enable use cases such as ad-insertion beaconing, client-side dynamic graphical overlays, content chapters, and audio track listing. In addition, MediaPackage now also supports Key Length Value (KLV) metadata for DASH live streams, as per the latest MISB ST1910.1 specification. Similar to timed ... Read More