1. ShuffleTrans: Patch-wise weight shuffle for transparent object segmentation.
- Author
-
Zhang, Boxiang, Wang, Zunran, Ling, Yonggen, Guan, Yuanyuan, Zhang, Shenghao, Li, Wenhui, Wei, Lei, and Zhang, Chunxu
- Subjects
- *
PROBLEM solving - Abstract
Transparent objects widely exist in the world. The task of transparent object segmentation is challenging as the object lacks its own texture. The cue of shape information therefore gets more critical. Most existing methods, however, rely on the mechanism of simple convolution, which is good at local cues and performs weakly on global cues like shape. To solve this problem, an operation named Patch-wise Weight Shuffle is proposed to bring in the global context cue by being combined with the dynamic convolution. A network ShuffleTrans that recognizes shape better is then designed based on this operation. Besides, fitter for this task, two auxiliary modules are presented in ShuffleTrans: a Boundary and Direction Refinement Module which collects two additional information, and a Channel Attention Enhancement Module that assists the above operation. Experiments on four texture-less object segmentation datasets and two normal datasets verify the effectiveness and generality of the method. Especially, the ShuffleTrans achieved 74.93% mIoU on the Trans10k v2 test set, which is more accurate than existing methods. • An operation Patch-wise Weight Shuffle combined with the dynamic convolution is proposed, which could bring in global context cues. • A transparent object segmentation network ShuffleTrans is designed. This method has better shape extraction compared with past methods. • ShuffleTrans performs well on accuracy compared with state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF