论文标题
图像分割语义通信通过车辆互联网
Image Segmentation Semantic Communication over Internet of Vehicles
论文作者
论文摘要
在本文中,通过汽车互联网(IOV)研究了基于语义的有效图像传输问题。在考虑的模型中,一辆车辆共享其视觉传感器所感知的大量视觉数据,以帮助其他车辆做出决策。但是,由于频谱资源有限,很难保持高可靠的视觉数据传输。为了解决这个问题,引入了语义通信方法,以减少传输数据量,同时确保语义级别的准确性。特别是,提出了图像分割语义通信(ISSC)系统,该系统可以从感知的图像中提取语义特征,并将功能传输到重建图像分割的接收车辆。 ISSC系统分别由发射器和接收器的编码器和解码器组成。为了准确提取图像语义特征,ISSC系统编码器采用了基于Swin Transformer的多尺度语义特征提取器。然后,为了抵制无线噪声并重建图像分割,在接收器上设计了语义特征解码器和重建器。仿真结果表明,所提出的ISSC系统可以以高压缩比准确地重建图像分割,并可以针对通道噪声实现稳健的传输性能,尤其是在低信噪比(SNR)时。在联合(MIOU)的平均交叉点方面,与基线相比,使用传统的编码方法,ISSC系统可以提高75%
In this paper, the problem of semantic-based efficient image transmission is studied over the Internet of Vehicles (IoV). In the considered model, a vehicle shares massive amount of visual data perceived by its visual sensors to assist other vehicles in making driving decisions. However, it is hard to maintain a high reliable visual data transmission due to the limited spectrum resources. To tackle this problem, a semantic communication approach is introduced to reduce the transmission data amount while ensuring the semantic-level accuracy. Particularly, an image segmentation semantic communication (ISSC) system is proposed, which can extract the semantic features from the perceived images and transmit the features to the receiving vehicle that reconstructs the image segmentations. The ISSC system consists of an encoder and a decoder at the transmitter and the receiver, respectively. To accurately extract the image semantic features, the ISSC system encoder employs a Swin Transformer based multi-scale semantic feature extractor. Then, to resist the wireless noise and reconstruct the image segmentation, a semantic feature decoder and a reconstructor are designed at the receiver. Simulation results show that the proposed ISSC system can reconstruct the image segmentation accurately with a high compression ratio, and can achieve robust transmission performance against channel noise, especially at the low signal-to-noise ratio (SNR). In terms of mean Intersection over Union (mIoU), the ISSC system can achieve an increase by 75%, compared to the baselines using traditional coding method