论文标题
通过网络修剪设计轻量重量对象跟踪器:使用CNN或变压器?
On Designing Light-Weight Object Trackers through Network Pruning: Use CNNs or Transformers?
论文作者
论文摘要
部署在低功率设备上的对象跟踪器需要轻量重量,但是,大多数当前最新方法(SOTA)方法都依赖于使用使用CNNS或Transformers构建的计算重型骨架。大量此类模型不允许在低功率条件下部署其部署,并且设计大型跟踪模型的压缩变体非常重要。本文展示了如何使用大型CNN和基于变压器的跟踪器的神经架构修剪来设计高度压缩的轻质对象跟踪器。此外,还提供了最适合设计轻质跟踪器的建筑选择的比较研究。提出了使用CNN,变压器以及两者组合的SOTA跟踪器之间的比较,以研究其在各种压缩比下的稳定性。最终,在某些情况下,在某些情况下,极端修剪方案的结果低至1%,可以研究对象跟踪中网络修剪的限制。这项工作为设计现有SOTA方法设计高效的跟踪器提供了更深入的见解。
Object trackers deployed on low-power devices need to be light-weight, however, most of the current state-of-the-art (SOTA) methods rely on using compute-heavy backbones built using CNNs or transformers. Large sizes of such models do not allow their deployment in low-power conditions and designing compressed variants of large tracking models is of great importance. This paper demonstrates how highly compressed light-weight object trackers can be designed using neural architectural pruning of large CNN and transformer based trackers. Further, a comparative study on architectural choices best suited to design light-weight trackers is provided. A comparison between SOTA trackers using CNNs, transformers as well as the combination of the two is presented to study their stability at various compression ratios. Finally results for extreme pruning scenarios going as low as 1% in some cases are shown to study the limits of network pruning in object tracking. This work provides deeper insights into designing highly efficient trackers from existing SOTA methods.