A Novel System for Automatic Detection of TV Commercial Breaks
Keywords:
TV Commercial Break Detection, Image Hashing, Video HashingAbstract
This paper explores the problem of automating the detection of commercial breaks in live broadcasts and video recordings, distinguishing them from regular channel content with a focus on the use of visual signals, commonly referred to as “bumpers”, to clearly distinguish commercial content from regular programming. Accurate measurement of commercial break duration is crucial for regulatory compliance, ensuring timely airing for advertisers, and maintaining verifiable records for broadcasters. Through an examination of regulatory frameworks in various countries, such as Spain, Uruguay, and the United States, this paper discusses how these regulations are applied and explores the potential for automated detection technologies to aid broadcasters and regulators in monitoring compliance. The paper describes the results of the implementation of a system for automatic TV advertising detection, including its design and performance analysis.
Downloads
References
“Directive - 2018/1808 - EN - EUR-Lex.” Accessed: Jan. 12, 2025. [Online]. Available: https://eur-lex.europa.eu/eli/dir/2018/1808/oj/eng
N. Rondan, M. Juayek, J. Joskowicz, and R. Sotelo, “Automatic Detection of TV Commercial Breaks,” 2024 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, 2025, To be published.
“Ley N° 20383.” Accessed: Jan. 09, 2025. [Online]. Available: https://www.impo.com.uy/bases/leyes/20383-2024
“BOE-A-2010-5292 Ley 7/2010, de 31 de marzo, General de la Comunicación Audiovisual.” Accessed: Jan. 09, 2025. [Online]. Available: https://www.boe.es/buscar/act.php?id=BOE-A-2010-5292
“Children’s Educational Television | Federal Communications Commission.” Accessed: Jan. 09, 2025. [Online]. Available: https://www.fcc.gov/consumers/guides/childrens-educational-television
C. R. and T. C. (CRTC) Government of Canada, “TV and Radio Advertising Basics.” Accessed: Jan. 09, 2025. [Online]. Available: https://crtc.gc.ca/eng/television/publicit/publicit.htm
“Acts, Policies & Guidelines | Ministry of Information and Broadcasting.” Accessed: Jan. 09, 2025. [Online]. Available: https://mib.gov.in/documents/notification/acts-policy-guidelines
A. C. and M. Authority, “Advertising rules for broadcasters | ACMA.” Accessed: Jan. 09, 2025. [Online]. Available: https://www.acma.gov.au/advertising-rules-broadcasters
“A/85, Techniques for Establishing and Maintaining Audio Loudness for Digital Television,” ATSC : NextGen TV. Accessed: Jan. 09, 2025. [Online]. Available: https://www.atsc.org/atsc-documents/a85-techniques-for-establishing-and-maintaining-audio-loudness-for-digital-television/
E. Abdelfattah and S. Joshi, “Comparison of Machine Learning Classification and Clustering Algorithms for TV Commercials Detection,” IEEE Access, vol. 11, pp. 116741–116751, 2023, doi: 10.1109/ACCESS.2023.3325888.
W. Tang, Y. Wo, and G. Han, “Geometrically robust video hashing based on ST-PCT for video copy detection,” Multimedia Tools Appl., vol. 78, no. 15, pp. 21999–22022, Aug. 2019, doi: 10.1007/s11042-019-7513-8.
A. Gomes, M. P. Queluz, and F. Pereira, “Automatic detection of TV commercial blocks: A new approach based on digital on-screen graphics classification,” in 2017 11th International Conference on Signal Processing and Communication Systems (ICSPCS), Dec. 2017, pp. 1–6. doi: 10.1109/ICSPCS.2017.8270456.
P.-C. Su and C.-S. Wu, “Efficient copy detection for compressed digital videos by spatial and temporal feature extraction,” Multimed Tools Appl, vol. 76, no. 1, pp. 1331–1353, Jan. 2017, doi: 10.1007/s11042-015-3132-1.
D. A. Sadlier, S. Marlow, N. O’Connor, and N. Murphy, “Automatic TV advertisement detection from MPEG bitstream,” Pattern Recognition, vol. 35, no. 12, pp. 2719–2726, Dec. 2002, doi: 10.1016/S0031-3203(01)00251-5.
T. Arsan, E. E. Bulut, B. Eren, A. Uzgor, and S. Yolcu, “A novel IPTV framework for automatic TV commercials detection, labeling, recognition and replacement,” Multimed Tools Appl, vol. 82, no. 6, pp. 8561–8579, Mar. 2023, doi: 10.1007/s11042-021-11563-y.
A. Ramires, D. Cocharro, and M. E. P. Davies, “An audio-only method for advertisement detection in broadcast television content,” Nov. 06, 2018, arXiv: arXiv:1811.02411. doi: 10.48550/arXiv.1811.02411.
N. Özay and B. Sankur, “Automatic TV logo detection and classification in broadcast videos,” in 2009 17th European Signal Processing Conference, Aug. 2009, pp. 839–843. Accessed: Nov. 19, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/7077387
P. Carvalho, A. Pereira, and P. Viana, “Automatic TV Logo Identification for Advertisement Detection without Prior Data,” Applied Sciences, vol. 11, no. 16, Art. no. 16, Jan. 2021, doi: 10.3390/app11167494.
A. Tüzkö, C. Herrmann, D. Manger, and J. Beyerer, “Open Set Logo Detection and Retrieval,” Oct. 30, 2017, arXiv: arXiv:1710.10891. doi: 10.48550/arXiv.1710.10891.
“Deep learning for logo recognition - ScienceDirect.” Accessed: Jan. 09, 2025. [Online]. Available: https://www-sciencedirect-com.proxy.timbo.org.uy/science/article/pii/S0925231217305660
N. Spolaôr, H. D. Lee, W. S. R. Takaki, L. A. Ensina, C. S. R. Coy, and F. C. Wu, “A systematic review on content-based video retrieval,” Engineering Applications of Artificial Intelligence, vol. 90, p. 103557, Apr. 2020, doi: 10.1016/j.engappai.2020.103557.
S. Minaee, I. Bouazizi, P. Kolan, and H. Najafzadeh, “Ad-Net: Audio-Visual Convolutional Neural Network for Advertisement Detection In Videos,” Jun. 22, 2018, arXiv: arXiv:1806.08612. doi: 10.48550/arXiv.1806.08612.
Y. Li, D. Wang, and L. Tang, “Robust and Secure Image Fingerprinting Learned by Neural Network,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 2, pp. 362–375, Feb. 2020, doi: 10.1109/TCSVT.2019.2890966.
Z. Liu, “A Deep Neural Framework to Detect Individual Advertisement (Ad) from Videos,” in 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Jan. 2023, pp. 3567–3576. doi: 10.1109/WACV56688.2023.00357.
M. Li, Y. Guo, and Y. Chen, “CNN-based Commercial Detection in TV Broadcasting,” in Proceedings of the 2017 VI International Conference on Network, Communication and Computing, Kunming China: ACM, Dec. 2017, pp. 48–53. doi: 10.1145/3171592.3171619.
M. Z. P. Wardana and M. E. Wibowo, “Audio-Visual CNN using Transfer Learning for TV Commercial Break Detection,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 17, no. 3, Art. no. 3, Jul. 2023, doi: 10.22146/ijccs.76058.
Waseemullah, M. F. Hyder, M. A. Siddiqui, and M. Mukarram, “TV Ad Detection Using the Base64 Encoding Technique,” Engineering, Technology & Applied Science Research, vol. 11, no. 5, Art. no. 5, Oct. 2021, doi: 10.48084/etasr.4337.
F. Vega, J. Medina, D. Mendoza, V. Saquicela, and M. Espinoza, “A robust video identification framework using perceptual image hashing,” in 2017 XLIII Latin American Computer Conference (CLEI), Sep. 2017, pp. 1–10. doi: 10.1109/CLEI.2017.8226396.
K. Somandepalli, V. Martinez, N. Kumar, and S. Narayanan, “Multimodal Representation of Advertisements Using Segment-level Autoencoders,” in Proceedings of the 20th ACM International Conference on Multimodal Interaction, in ICMI ’18. New York, NY, USA: Association for Computing Machinery, Oct. 2018, pp. 418–422. doi: 10.1145/3242969.3243026.
“Kind of Like That - The Hacker Factor Blog.” Accessed: Nov. 19, 2024. [Online]. Available: https://www.hackerfactor.com/blog/?/archives/529-Kind-of-Like-That.html
Y. Baek, B. Lee, D. Han, S. Yun, and H. Lee, “Character Region Awareness for Text Detection,” Apr. 03, 2019, arXiv: arXiv:1904.01941. doi: 10.48550/arXiv.1904.01941.
B. Shi, X. Bai, and C. Yao, “An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition,” Jul. 21, 2015, arXiv: arXiv:1507.05717. doi: 10.48550/arXiv.1507.05717.
I. S. Gruzman and A. S. Kostenkova, “Algorithm of scene change detection in a video sequence based on the threedimensional histogram of color images,” in 2014 12th International Conference on Actual Problems of Electronics Instrument Engineering (APEIE), Oct. 2014, pp. 1–1. doi: 10.1109/APEIE.2014.7040826.
M. Covell, S. Baluja, and M. Fink, “Advertisement Detection and Replacement using Acoustic and Visual Repetition,” in 2006 IEEE Workshop on Multimedia Signal Processing, Oct. 2006, pp. 461–466. doi: 10.1109/MMSP.2006.285351.
