论文标题
视觉显着区域的结构相似性分析和分层聚类的应用在相似的无线胶囊内窥镜图像中的应用
Application of Structural Similarity Analysis of Visually Salient Areas and Hierarchical Clustering in the Screening of Similar Wireless Capsule Endoscopic Images
论文作者
论文摘要
小肠胶囊内窥镜检查是检查小肠道病变的主流方法,但是单个小肠胶囊内窥镜检查将产生60,000-120,000张图像,其中大多数图像相似,没有诊断值。医生需要2-3个小时才能从这些图像中识别病变。 This is time-consuming and increase the probability of misdiagnosis and missed diagnosis since doctors are likely to experience visual fatigue while focusing on a large number of similar images for an extended period of time.In order to solve these problems, we proposed a similar wireless capsule endoscope (WCE) image screening method based on structural similarity analysis and the hierarchical clustering of visually salient sub-image blocks.图像的相似性聚类自动通过基于图像的色调,饱和度,值(HSV)的空间颜色特征来自动识别,并根据视觉显着的子图像的结构相似性提取了键框,以准确地识别和筛选出类似的小型肠内镜图像。随后,将提出的方法应用于胶囊内窥镜成像工作站。在筛选出由I型IMOM小肠胶囊内窥镜收集的完整数据中,从52例涵盖17种常见类型的小肠病变的情况下,我们获得了100%的病变召回,平均相似的图像还原比为76%。随着相似图像的筛选,OMOM图像工作站的平均游戏时间为18分钟,这大大减少了查看图像的医生所花费的时间。
Small intestinal capsule endoscopy is the mainstream method for inspecting small intestinal lesions,but a single small intestinal capsule endoscopy will produce 60,000 - 120,000 images, the majority of which are similar and have no diagnostic value. It takes 2 - 3 hours for doctors to identify lesions from these images. This is time-consuming and increase the probability of misdiagnosis and missed diagnosis since doctors are likely to experience visual fatigue while focusing on a large number of similar images for an extended period of time.In order to solve these problems, we proposed a similar wireless capsule endoscope (WCE) image screening method based on structural similarity analysis and the hierarchical clustering of visually salient sub-image blocks. The similarity clustering of images was automatically identified by hierarchical clustering based on the hue,saturation,value (HSV) spatial color characteristics of the images,and the keyframe images were extracted based on the structural similarity of the visually salient sub-image blocks, in order to accurately identify and screen out similar small intestinal capsule endoscopic images. Subsequently, the proposed method was applied to the capsule endoscope imaging workstation. After screening out similar images in the complete data gathered by the Type I OMOM Small Intestinal Capsule Endoscope from 52 cases covering 17 common types of small intestinal lesions, we obtained a lesion recall of 100% and an average similar image reduction ratio of 76%. With similar images screened out, the average play time of the OMOM image workstation was 18 minutes, which greatly reduced the time spent by doctors viewing the images.