I discovered Virtual Board Replacement only some years ago, I think it was the UEFA Euro 2024. First I learned about the technology and then, as it is often the case, needed to find the proper words so I was able to even google for it. Sometimes it is also called Virtual Perimeter Advertising or just Virtual Advertising. According to this article in 2024 “virtual perimeter advertising has been around for about seven years and has been used in national and international soccer leagues for a long time”
The thing is when a sports event is broadcast on TV or the Internet you have these LED boards (that in simpler times just were painted wooden boards) with ads that you can see when you attend the actual event. Turns out what you see in a broadcast is not necessarily what you see at the venue itself. In the processing of the video the ads get replaced so the advertisers can target their audience depending on the location of the broadcast, meaning a Champions League final broadcast on German TV will show German beer ads, while in China at the same place viewers will see some Chinese brand. See this Reddit post for a live example.

It’s quite hard to find actual information about how this works but I read about things like tracking the cameras or having some invisible (due to the LED refresh rate) information on the LED boards and maybe more. With so-called “Parallel Ads” the LED boards simultaneously transmit up to four ads at different frequencies. Professional cameras can capture these different signals simultaneously and distribute them to different audiences although this approach seems obsolete by now.
One approach is a hardware-based system, where camera movements are tracked eletronically. To differentiate between the foreground and background, the LED boards emit an infrared signal that is recorded in the camera as an additional color channel. It’s just like a green screen with an invisible color. Because the hardware tracking is complicated the virtual overlays were restricted to the main camera though I don’t know if this is still the case. Purely software based solutions don’t share that restriction so naturally most companies try to go this way. Today everyone seems to use AI, at least that’s what they are advertising anway.
At least at the EURO 2024 the technology wasn’t perfect so it was fun to experience the occasional glitch such as disappearing players (take a close look at the left side of the goal in this image).

I tried to find out more about the state of the art with respect to the FIFA World Cup 2026 but couldn’t get any specific information, so I’ll just post some links to companies or more background info.
There’s a company called Supponor which claims to be the “number 1 solution for delivering cutting edge technology to top tier sport leagues and federations”. However Supponor is also the company who lost a patent trial against AIM Sport and Noerr in 2022. As a result they were no longer able to use their “hardware-based technology for electronic perimeter advertising in German stadiums”. An article covering the use of the Supponor/TGI technology in the German Bundesliga features a nice side-by-side comparison of footage. According to this AIM is another provider of virtual ad services besides Supponor.
Uniqfeed is another supplier of a software-based solution who has examples of other sports such as Baseball, Tennis, Table Tennis and Badminton.
Shikenso has a whitepaper that includes figures about implementation costs and ROI.
“SponixTech Breaks New Ground in UEFA World Cup Qualifiers with Multi-Camera Virtual Advertising” meaning they are doing a pure post-processing workflow without access to camera data.
On ResearchGate you can find the paper “An End-To-End Pipeline for Virtual Banner Replacement in Football Broadcasts” with more technical considerations and a reference to a “SoccerNet-banner” dataset they are using.
On one hand I find it fascinating that the technology works almost flawlessly because it’s not super easy to do the replacement with all the moving parts on the picture, different perspectives, replay and so on in realtime. On the other hand it’s quite spooky that you no longer get an “authentic” broadcast of the actual event. What’s next? Removing the referee? Replacing some players with other players people for a pay-per-view fanbase?
