In Press                   Back to the articles list | Back to browse issues page

XML Print

Enhancing privacy by large mask inpainting and fusion-based segmentation in street view imagery
Mahdi Khourishandiz , Abdollah Amirkhani
Abstract:   (313 Views)
Protecting privacy in street view imagery is a critical challenge in urban analytics, requiring comprehensive and scalable solutions beyond localized obfuscation techniques such as face or license plate blurring. To address this, we propose a novel framework that automatically detects and removes sensitive objects, such as pedestrians and vehicles, ensuring robust privacy preservation while maintaining the visual integrity of the images. Our approach integrates semantic segmentation with 2D priors and multimodal data from cameras and LiDAR to achieve precise object detection in complex urban scenes. Detected regions are seamlessly filled using a large-mask inpainting technique based on fast Fourier convolutions (FFC), enabling efficient generalization to high-resolution imagery. Evaluated on the SemanticKITTI dataset, our method achieves a mean Intersection over Union (mIoU) of 64.9%, surpassing state-of-the-art benchmarks. Despite its reliance on accurate sensor calibration and multimodal data availability, the proposed framework offers a scalable solution for privacy-sensitive applications such as urban mapping, and virtual tourism, delivering high-quality anonymized imagery with minimal artifacts.
Keywords: Privacy Protection, Street View Imagery, Large Mask Inpainting, Semantic Segmentation, Multi-modality, Lidar.
Full-Text [PDF 2338 kb]   (32 Downloads)    
Type of Study: Research Paper | Subject: Automotive and Consumer Electronics
Received: 2024/05/27 | Revised: 2025/03/20 | Accepted: 2025/02/15
Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Creative Commons License
© 2022 by the authors. Licensee IUST, Tehran, Iran. This is an open access journal distributed under the terms and conditions of the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.