Video Metadata: Describing the Details that Matter

Modern surveillance systems generate an overwhelming (and mostly unused) amount of data. This is especially true when recording video in 24/7 operations, which is essential to capturing evidence, incidents and events. It is not only hard to pick out what really matters in a scene, but also extremely time consuming. Making data more identifiable and actionable is a key problem to solve. Applying metadata to describe key details in a scene allows data to be more identifiable and actionable.

This is why metadata is the foundation for gathering intelligence from surveillance video and/or audio streams. Metadata provides a fast way to find, evaluate, and act on the singular details that matter the most through one, hundreds or thousands of video and audio footage streams. Metadata is now an essential part of effective security and business operations.

What is Metadata?
Typically, Metadata is referred to as ‘data about other data.’ In the context of video surveillance, that translates to ‘data about video data’. Video metadata accurately describes the details that matter in a scene. For instance, attributes for metadata can describe all sort of details about moving objects of interest, e.g. location, time, colors, sizes, shapes, coordinates, volume decibels, speed, direction, etc.
Additionally, foundational details can be added, such as video stream description, codec, time stamps and device identity.

The aforementioned are ‘meta’ descriptions of details in, or related to, a scene. Based on AI machine and deep learning, Meta descriptions can be more (or less) granular. This allows for classifying a group of pixels as a person, animal, vehicle or other pre-defined object classes. Being more precise with more refined descriptions of people or objects e.g. vehicle type, make model, color, speed, direction, etc.

The Value of Metadata
Metadata not only provides details about people, objects and events in a scene. It also allows large amounts of video and recorded footage to quickly group, sort, search, recover and use. As a result, the overall use cases for metadata fit into three areas.

1. Real-time alarm triggering and notifications
2. Post event forensic searching
3. Statistical analysis and reporting

Adding Intelligence to Scenes
Metadata essentially assigns digital meaning to each video frame about the objects and events within it. In other words, it adds interpretation or intelligence about the scene rather than just the raw video footage, which needs to be processed manually by an operator.

Once software can interpret scenes in this way, it can understand the scene details and enable the scene to be acted upon in real-time via events, after events (post-event), via manual search or simply analyzed for statistical analysis. This enables the use of metadata to design baselines that define what is ‘normal’ for any scene feed from any individual camera. In turn, this allows software to recognize any degree of deviation, anomaly or specific behavior or activities, etc. as well as predict what will happen in that scene to a specific probability.

Harnessing the Full Potential of Metadata
Video metadata adds immense value to a video management system. In fact, its true potential is realized when applied to multiple inputs spanning visual, audio, activity, and process-related inputs. In the management of any site, things like RFID tracking, GPS coordinates, tampering alerts, noise detection, and point of sale transactional data, are all high value data sources. Unifying this metadata generated from many different sources means gaining much more insights than one can ever get from each system alone. Interoperability is key, and open-protocols and industry standards are essential to this effort. Ultimately seamless metadata integration will allow us to harness massive amounts of data from all kids of systems and gain a greater understanding of everything around us.

This article originally appeared in the November / December 2022 issue of Security Today.

About the Author

Joe Danielson, Global Enterprise Solutions, Axis Communications, AB.

Featured

  • IoT Saves the Day

    IoT Saves the Day

    Today, creating a safe environment across schools, hotels, office buildings, housing complexes and other facilities has become a necessity. There are so many dangers lurking in buildings of all sizes and shapes from fire hazards, vaping issues, chemical/air quality issues, intruders and so much more. Read Now

  • One Pane, Less Pain

    One Pane, Less Pain

    Just because a solution is built on an open-standards platform doesn’t ensure that all the vendors’ systems will work together as promised. Some features may not be supported, or not supported to their fullest potential. Read Now

  • Revamping Wrigley Field

    Revamping Wrigley Field

    When talking about baseball in the United States, it’s hard not to think of the Chicago Cubs and Wrigley Field. With a history spanning more than 100 years, the Chicago Cubs are one of the most recognized teams in professional sports. Read Now

  • Welcome to Big D

    I’ll admit it, I am partial. There is no better place to have a tradeshow event than Dallas. TEC 2023 caught the vision and brought it premier education and networking event to Big D.< Read Now

    • Industry Events

Featured Cybersecurity

New Products

  • Camden Door Controls ‘SER” Surface Boxes and Extension Rings

    Camden Door Controls ‘SER” Surface Boxes and Extension Rings

    Camden Door Controls has introduced new ‘SER” surface boxes and extension rings that provide a complete solution for new construction. In addition, they provide a simple and robust solution when replacing round wired and manual push plate switches with either Camden’s wired or wireless SureWave™ no-touch switches or Kinetic™ no-battery wireless switches. 3

  • QCS7230 System-on-Chip (SoC)

    QCS7230 System-on-Chip (SoC)

    The latest Qualcomm® Vision Intelligence Platform offers next-generation smart camera IoT solutions to improve safety and security across enterprises, cities and spaces. The Vision Intelligence Platform was expanded in March 2022 with the introduction of the QCS7230 System-on-Chip (SoC), which delivers superior artificial intelligence (AI) inferencing at the edge. 3

  • HID Signo Readers

    HID Signo Readers

    HID Global has announced its HID® Signo™ Biometric Reader 25B that is designed to capture and read fingerprints in real-world applications and conditions. 3