Changelog

MMSelfSup

v1.0.0rc6 (10/02/2023)

The master branch is still 0.x version and we will checkout a new 1.x branch to release 1.x version. The two versions will be maintained simultaneously in the future.

We briefly list the major breaking changes here. Please refer to the migration guide for details and migration instructions.

Highlight

• Support MaskFeat with video dataset in projects/maskfeat_video/

• Translate documentation to Chinese.

New Features

• Support MaskFeat with video dataset in projects/maskfeat_video/ (#678)

Bug Fixes

• Fix distributed setting for shape bias (#689)

• Update link of beitv2 (#676)

• Pass param by explicitly setting location (#654)

• Update default_runtime.py (#681)

• Rename metafile.yaml to metafile.yml (#680)

• Fix bugs in configs/selfsup/eva/metafile.yaml (#669)

Improvements

• Switch default branch to 1.x (#686)

• Update pre-commit (#685)

• Deprecate the support of python 3.6 (#657)

Docs

• Translate add_transforms.md and conventions.md (#674)

• Translate classification.md, detection.md, segmentation.md (#665)

• Update link of knn script (#661)

• Translate two docs (#653)

• Translate three docs (#651)

v1.0.0rc5 (30/12/2022)

The master branch is still 0.x version and we will checkout a new 1.x branch to release 1.x version. The two versions will be maintained simultaneously in the future.

We briefly list the major breaking changes here. Please refer to the migration guide for details and migration instructions.

Highlight

• Support BEiT v2, MixMIM, EVA

• Support ShapeBias for model analysis

• Add Solution of FGIA ACCV 2022 (1st Place)

• Refactor t-SNE

New Features

• Support BEiT v2 (#627)

• Support MixMIM (#626)

• Support EVA (#632)

• Support ShapeBias metric (#635)

• Add convert scripts and instructions on seg and det (#621)

• Add pretraining for FGIA (#607)

Bug Fixes

• Change pseudo_collect to default_collect (#616)

• Fix the link of SimMIM 800pt 100ft (#622)

• Change map_location to cpu (#623)

• Fix import error (#631)

• Fix key error in configs (#630)

• Change np.int to int (#636)

• Fix knn multi-gpu bug (#634)

Improvements

• Refactor projects/ folder (#620)

• Refactor t-SNE (#629)

• Refactor CAE (#645)

• Refactor benchmark script and update files (#637)

Docs

• Update data_flow.md (#612)

• Update datasets.md (#633)

v1.0.0rc4 (07/12/2022)

The master branch is still 0.x version and we will checkout a new 1.x branch to release 1.x version. The two versions will be maintained simultaneously in the future.

We briefly list the major breaking changes here. Please refer to the migration guide for details and migration instructions.

Highlight

• Support BEiT and MILAN

• Support low-level reconstruction visualization

New Features

• Support BEiT (#425)

• Support MILAN (#600)

• Support low-level reconstruction visualization (#570)

Bug Fixes

• Fix registry of data preprocessor (#603)

• Fix dependence and key bug (#611)

Improvements

• Refactor file io (#582))

• Add ‘./projects’ folder and an example (#586))

• Update CI and UT (#601))

Docs

• Update readthedocs rst and menu button (#572)

• Add readthedocs algorithm pages and fix some displaying error (#599)

v1.0.0rc3 (01/11/2022)

The master branch is still 0.x version and we will checkout a new 1.x branch to release 1.x version. The two versions will be maintained simultaneously in the future.

We briefly list the major breaking changes here. Please refer to the migration guide for details and migration instructions.

Highlight

• Support MaskFeat

New Features

• Support MaskFeat (#494)

• Add Hog generator (#518)

Bug Fixes

• Fix fine-tuning config of MAE-H-448 (#509)

Improvements

• Refactor evaluation folder and related configs (#538))

• Refine configs (#547))

Docs

• Add custom dataset tutorial (#522)

• Refactor add_modules.md (#524)

• Translate some documentation to Chinese

v1.0.0rc2 (12/10/2022)

The master branch is still 0.x version and we will checkout a new 1.x branch to release 1.x version. The two versions will be maintained simultaneously in the future.

We briefly list the major breaking changes here. Please refer to the migration guide for details and migration instructions.

Highlight

• Full support of MAE, SimMIM, MoCoV3.

New Features

• Full support of MAE (#483)

• Full support of SimMIM (#487)

• Full support of MoCoV3 (#496)

Bug Fixes

• Fix classification configs (#488)

• Fix MAE config name error (#498)

Improvements

• Refactor colab tutorial (#470))

• Update readthedocs requirements (#472)

• Update CI (#476)

• Refine mim_slurm_test.sh and mim_dist_test.sh for benchmarks (#477)

• Update Metafile format and content (#478)

Docs

• Add advanced_guides/engine.md (#454)

• Add advanced_guides/evaluation.md (#456)

• add advanced_guides/transforms.md (#463)

• Add dataset docs (#437)

• Refine contribution guide (#492)

• update convention (#475)

v1.0.0rc1 (01/09/2022)

We are excited to announce the release of MMSelfSup v1.0.0rc1. MMSelfSup v1.0.0rc1 is the first version of MMSelfSup 1.x, a part of the OpenMMLab 2.0 projects. The master branch is still 0.x version and we will checkout a new 1.x branch to release 1.x version. The two versions will be maintained simultaneously in the future.

We briefly list the major breaking changes here. Please refer to the migration guide for details and migration instructions.

Highlight

• Based on MMEngine and MMCV.

• Released with refactor.

  • Datasets

  • Models

  • Config

  • …

• Refine all documents.

New Features

• Add SelfSupDataSample to unify the components’ interface.

• Add SelfSupVisualizer for visualization.

• Add SelfSupDataPreprocessor for data preprocess in model.

Improvements

• Most algorithms now support non-distributed training.

• Change the interface of different data augmentation transforms to dict.

• Run classification downstream task with MMClassification.

Docs

• Refine all documents and reorganize the directory.

• Add concepts for different components.

v0.9.1 (31/05/2022)

Highlight

• Update BYOL model and results (#319)

• Refine some documentation

New Features

• Update BYOL models and results (#319)

Bug Fixes

• Set qkv bias to False for cae and True for mae (#303)

• Fix spelling errors in MAE config (#307)

Improvements

• Change the file name of cosine annealing hook (#304)

• Replace markdownlint with mdformat (#311)

Docs

• Fix typo in tutotial (#308)

• Configure Myst-parser to parse anchor tag (#309)

• Update readthedocs algorithm README (#310)

• Rewrite install.md (#317)

• refine README.md file (#318)

v0.9.0 (29/04/2022)

Highlight

• Support CAE (#284)

• Support Barlow Twins (#207)

New Features

• Support CAE (#284)

• Support Barlow twins (#207)

• Add SimMIM 192 pretrain and 224 fine-tuning results (#280)

• Add MAE pretrain with fp16 (#271)

Bug Fixes

• Fix args error (#290)

• Change imgs_per_gpu to samples_per_gpu in MAE config (#278)

• Avoid GPU memory leak with prefetch dataloader (#277)

• Fix key error bug when registering custom hooks (#273)

Improvements

• Update SimCLR models and results (#295)

• Reduce memory usage while running unit test (#291)

• Remove pytorch1.5 test (#288)

• Rename linear probing config file names (#281)

• add unit test for apis (#276)

Docs

• Fix SimMIM config link, and add SimMIM to model_zoo (#272)

v0.8.0 (31/03/2022)

Highlight

• Support SimMIM (#239)

• Add KNN benchmark, support KNN test with checkpoint and extracted backbone weights (#243)

• Support ImageNet-21k dataset (#225)

New Features

• Support SimMIM (#239)

• Add KNN benchmark, support KNN test with checkpoint and extracted backbone weights (#243)

• Support ImageNet-21k dataset (#225)

• Resume latest checkpoint automatically (#245)

Bug Fixes

• Add seed to distributed sampler (#250)

• Fix positional parameter error in dist_test_svm_epoch.sh (#260)

• Fix ‘mkdir’ error in prepare_voc07_cls.sh (#261)

Improvements

• Update args format from command line (#253)

Docs

• Fix command errors in 6_benchmarks.md (#263)

• Translate 6_benchmarks.md to Chinese (#262)

v0.7.0 (03/03/2022)

Highlight

• Support MAE (#221)

• Add Places205 benchmarks (#210)

• Add test Windows in workflows (#215)

New Features

• Support MAE (#221)

• Add Places205 benchmarks (#210)

Bug Fixes

• Fix config typos for rotation prediction and deepcluster (#200)

• Fix image channel bgr/rgb bug and update benchmarks (#210)

• Fix the bug when using prefetch under multi-view methods (#218)

• Fix tsne ‘no init_cfg’ error (#222)

Improvements

• Deprecate imgs_per_gpu and use samples_per_gpu (#204)

• Update the installation of MMCV (#208)

• Add pre-commit hook for algo-readme and copyright (#213)

• Add test Windows in workflows (#215)

Docs

• Translate 0_config.md into Chinese (#216)

• Reorganizing OpenMMLab projects and update algorithms in readme (#219)

v0.6.0 (02/02/2022)

Highlight

• Support vision transformer based MoCo v3 (#194)

• Speed up training and start time (#181)

• Support cpu training (#188)

New Features

• Support vision transformer based MoCo v3 (#194)

• Support cpu training (#188)

Bug Fixes

• Fix issue (#159, #160) related bugs (#161)

• Fix missing prob assignment in RandomAppliedTrans (#173)

• Fix bug of showing k-means losses (#182)

• Fix bug in non-distributed multi-gpu training/testing (#189)

• Fix bug when loading cifar dataset (#191)

• Fix dataset.evaluate args bug (#192)

Improvements

• Cancel previous runs that are not completed in CI (#145)

• Enhance MIM function (#152)

• Skip CI when some specific files were changed (#154)

• Add drop_last when building eval optimizer (#158)

• Deprecate the support for “python setup.py test” (#174)

• Speed up training and start time (#181)

• Upgrade isort to 5.10.1 (#184)

Docs

• Refactor the directory structure of docs (#146)

• Fix readthedocs (#148, #149, #153)

• Fix typos and dead links in some docs (#155, #180, #195)

• Update training logs and benchmark results in model zoo (#157, #165, #195)

• Update and translate some docs into Chinese (#163, #164, #165, #166, #167, #168, #169, #172, #176, #178, #179)

• Update algorithm README with the new format (#177)

v0.5.0 (16/12/2021)

Highlight

• Released with code refactor.

• Add 3 new self-supervised learning algorithms.

• Support benchmarks with MMDet and MMSeg.

• Add comprehensive documents.

Refactor

• Merge redundant dataset files.

• Adapt to new version of MMCV and remove old version related codes.

• Inherit MMCV BaseModule.

• Optimize directory.

• Rename all config files.

New Features

• Add SwAV, SimSiam, DenseCL algorithms.

• Add t-SNE visualization tools.

• Support MMCV version fp16.

Benchmarks

• More benchmarking results, including classification, detection and segmentation.

• Support some new datasets in downstream tasks.

• Launch MMDet and MMSeg training with MIM.

Docs

• Refactor README, getting_started, install, model_zoo files.

• Add data_prepare file.

• Add comprehensive tutorials.

OpenSelfSup (History)

v0.3.0 (14/10/2020)

Highlight

• Support Mixed Precision Training

• Improvement of GaussianBlur doubles the training speed

• More benchmarking results

Bug Fixes

• Fix bugs in moco v2, now the results are reproducible.

• Fix bugs in byol.

New Features

• Mixed Precision Training

• Improvement of GaussianBlur doubles the training speed of MoCo V2, SimCLR, BYOL

• More benchmarking results, including Places, VOC, COCO

v0.2.0 (26/6/2020)

Highlights

• Support BYOL

• Support semi-supervised benchmarks

Bug Fixes

• Fix hash id in publish_model.py

New Features

• Support BYOL.

• Separate train and test scripts in linear/semi evaluation.

• Support semi-supevised benchmarks: benchmarks/dist_train_semi.sh.

• Move benchmarks related configs into configs/benchmarks/.

• Provide benchmarking results and model download links.

• Support updating network every several iterations.

• Support LARS optimizer with nesterov.

• Support excluding specific parameters from LARS adaptation and weight decay required in SimCLR and BYOL.