Self-supervised Learning Model Zoo¶
Pretrained models¶
MAE¶
Pretrained on ImageNet dataset.
| Config | Epochs | Download |
|---|---|---|
| mae_vit_base_patch16_8xb64_400e | 400 | model |
| mae_vit_base_patch16_8xb64_1600e | 1600 | model |
| mae_vit_large_patch16_8xb32_1600e | 1600 | model |
DINO¶
Pretrained on ImageNet dataset.
| Config | Epochs | Download |
|---|---|---|
| dino_deit_small_p16_8xb32_100e | 100 | model - log |
MoBY¶
Pretrained on ImageNet dataset.
| Config | Epochs | Download |
|---|---|---|
| moby_deit_small_p16_4xb128_300e | 300 | model - log |
MoCo V2¶
Pretrained on ImageNet dataset.
| Config | Epochs | Download |
|---|---|---|
| mocov2_resnet50_8xb32_200e | 200 | model - log |
SwAV¶
Pretrained on ImageNet dataset.
| Config | Epochs | Download |
|---|---|---|
| swav_resnet50_8xb32_200e | 200 | model - log |
Benchmarks¶
For detailed usage of benchmark tools, please refer to benchmark README.md.
ImageNet Linear Evaluation¶
| Algorithm | Linear Eval Config | Pretrained Config | Top-1 (%) | Download |
|---|---|---|---|---|
| SwAV | swav_resnet50_8xb2048_20e_feature | swav_resnet50_8xb32_200e | 73.618 | log |
| DINO | dino_deit_small_p16_8xb2048_20e_feature | dino_deit_small_p16_8xb32_100e | 71.248 | log |
| MoBY | moby_deit_small_p16_8xb2048_30e_feature | moby_deit_small_p16_4xb128_300e | 72.214 | log |
| MoCo-v2 | mocov2_resnet50_8xb2048_40e_feature | mocov2_resnet50_8xb32_200e | 66.8 | log |
ImageNet Finetuning¶
| Algorithm | Fintune Config | Pretrained Config | Top-1 (%) | Download |
|---|---|---|---|---|
| MAE | mae_vit_base_patch16_8xb64_100e_lrdecay075_fintune | mae_vit_base_patch16_8xb64_400e | 83.13 | fintune model - log |
| mae_vit_base_patch16_8xb64_100e_lrdecay065_fintune | mae_vit_base_patch16_8xb64_1600e | 83.49 | fintune model - log | |
| mae_vit_large_patch16_8xb16_50e_lrdecay075_fintune | mae_vit_large_patch16_8xb32_1600e | 85.49 | fintune model - log |