Convolutional Token Embedding With Grouped Convolutions

* ⭐ 07/2022: [Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors... (Swin UNETR)](https://link.springer.com/chapter/10.1007/978-3-031-08999-2_22)

Unique: Implements CTE blocks using stacked grouped convolutions where each layer increases the receptive field while maintaining spatial structure, creating hierarchical token representations. Unlike ViT's single linear projection, CTE uses multiple convolutional layers (typically 2-3) with increasing dilation to capture multi-scale patterns within patches before flattening to tokens.