The booming haptic data significantly improves the users'immersion during multimedia interaction. As a result, the study of Haptic,Audio-Visual Environment(HAVE)has attracted attentions of multimedia community. To realize such a system, a challenging tack is the synchronization of multiple sensorial signals that is critical to user experience. Despite of audio-visual synchronization efforts, there is still a lack of haptic-aware multimedia synchronization model. In this work, we propose a timestamp-independent synchronization for haptic-visual signal transmission. First, we exploit the sequential correlations during delivery and playback of a haptic-visual communication system. Second, we develop a key sample extraction of haptic signals based on the force feedback characteristics, and a key frame extraction of visual signals based on deep object detection. Third, we combine the key samples and frames to synchronize the corresponding haptic-visual signals. Without timestamps in signal flow, the proposed method is still effective and more robust to complicated network conditions. Subjective evaluation also shows a significant improvement of user experience with the proposed method.

翻译：突飞猛进的机能数据大大改善了用户在多媒体互动期间的沉浸状态。 因此,对Haptic、Audio-Vivial Environment(HAVE)的研究吸引了多媒体界的注意力。为了实现这样一个系统,一个具有挑战性的塔克就是对用户体验至关重要的多种感官信号的同步。尽管进行了视听同步努力,但仍然缺乏偶然觉悟的多媒体同步模式。在这项工作中,我们提议对机能-视觉信号传输进行一个时间标识独立同步。首先,我们在发送和播放机能-视觉通信系统时利用相继的相继关联性。第二,我们根据力量反馈特性开发了手动信号的关键样本提取方法,并根据深层物体探测对视觉信号进行关键框架提取。第三,我们结合了关键样本和框架,以同步相应的机能-视觉信号。在信号流中不设时,拟议方法仍然有效,而且对复杂的网络条件更为健全。主观评价还表明,用户在拟议方法方面的经验有了显著改进。