What is automatic content recognition and how does it work?
This article was originally published in 2019 and has been updated to reflect current ACR technology, advertising use cases, privacy considerations, and measurement practices.
Television viewing is more fragmented than it used to be.
A single household may move between live TV, streaming apps, gaming consoles, set-top boxes, and other connected devices, all through the same screen. For advertisers, that makes a seemingly simple question much harder to answer: What was actually playing on the television?
Automatic content recognition, or ACR, helps provide that visibility.
ACR is technology built into certain internet-connected devices, most commonly smart TVs, that can identify the content appearing on the screen. Depending on the device and provider, that may include television programs, movies, advertisements, streaming content, video games, and programming delivered through connected devices.
The easiest comparison is Shazam. Just as Shazam listens to a short audio sample and identifies a song, ACR analyzes a small portion of audio or video and matches it with known content.
For advertisers, this can provide a clearer view of what reaches the television screen across an increasingly fragmented media landscape.
What Is ACR?
Automatic content recognition identifies media playing on a compatible device.
In a smart TV environment, the technology creates a digital fingerprint from small samples of the content appearing on screen. That fingerprint is compared with a reference library containing known programs, movies, advertisements, and other media.
When a match is found, the system can identify what content appeared, when it appeared, and how long it remained on screen.
Because recognition happens at the screen level, ACR may identify content regardless of how it reached the television. That could include a traditional linear broadcast, a streaming service, a gaming console, or a connected set-top box.
This is why ACR is sometimes described as “glass-level” or “screen-level” data. It focuses on what reaches the television screen rather than relying only on what a particular app, network, or device reports was selected.
ACR is not available on every television, and it is not automatically active on every compatible device. Data availability depends on the manufacturer, market, device settings, and whether the user has agreed to the collection of viewing data.
How Does ACR Work?
The exact process varies by manufacturer and technology provider, but ACR generally works in four stages.
1. The Viewer Provides Consent
ACR data collection begins with consumer consent.
On participating smart TVs, viewers may be given the option to enable viewing-data collection during setup or through the television’s privacy settings.
For example, VIZIO states that viewing data is not collected unless the user enables the feature during setup or within the device settings. Users can also turn it off later without affecting the television’s performance.
Consent is a critical part of the process. In 2017, the Federal Trade Commission required VIZIO to clearly disclose its viewing-data practices and obtain affirmative consent before collecting and sharing that information.
2. The Device Creates a Fingerprint
Once ACR is enabled, the television analyzes small audio or visual samples from the content appearing on screen.
Rather than storing a full copy of the program, the system creates a compact digital fingerprint representing the content’s unique characteristics.
3. The Content Is Matched
The fingerprint is compared against a reference library containing known television programs, movies, advertisements, and other media.
When the system finds a match, it can determine what appeared on screen and when.
For example, ACR may recognize that a participating household watched a particular program, saw a specific advertisement, or used a gaming console during a certain viewing window.
4. The Data Is Made Actionable
The resulting viewing data can be aggregated and made available to approved partners for uses such as media measurement, audience analysis, campaign reporting, content recommendations, and advertising.
This does not mean an advertiser receives a list showing exactly what a named person watched.
ACR data is generally accessed through aggregated datasets, modeled audiences, measurement platforms, clean rooms, or other privacy-conscious environments. The exact process depends on the provider, use case, and applicable privacy requirements.
Four Ways Advertisers Use ACR Data
ACR data can help advertisers understand what appeared on participating television screens and connect that exposure to broader media planning, targeting, and measurement. Its most common applications fall into four areas.
- Measuring Campaign Exposure
ACR can help determine whether an advertisement appeared on compatible television screens, including when it appeared and how frequently it was detected. This can support analysis of reach, frequency, duplication, and exposure across linear and streaming environments.
- Understanding Viewing Behavior
ACR data can provide insight into the programs, genres, networks, apps, and viewing environments associated with an audience.
A brand may use those insights to understand whether its audience tends to watch live sports, cooking competitions, travel programming, or home renovation content. That information can guide media planning, sponsorship decisions, audience strategy, and creative development.
- Building Audiences
Depending on the provider and available privacy controls, ACR-derived insights may be used to create audience segments based on viewing behavior.
An advertiser might want to reach opted-in households that frequently watch a particular type of programming or that were exposed to a relevant campaign.
- Connecting Screens
ACR can also support cross-screen campaigns.
For example, a household exposed to an awareness-focused television ad could later receive a different message through mobile display, online video, paid social, digital audio, or another CTV placement, where supported by the platform and appropriate permissions.
The first message may introduce the brand. The next could provide product details, reviews, local availability, or a stronger call to action.
What Can ACR Actually Tell Advertisers?
ACR can help identify what content or advertisements appeared on participating screens, when they appeared, and how frequently they were detected.
It cannot confirm who in the household was watching, whether anyone was paying attention, or whether the exposure directly caused a later action.
That distinction is important.
ACR is a valuable source of viewing data, but it is still one signal within a wider audience and measurement strategy.
As television viewing continues to spread across platforms and devices, ACR can help advertisers gain a clearer view of what reaches the screen and connect that exposure with broader campaign activity.