Skip to content

Commit 4a13c40

Browse files
authored
[TinyCLIP] Update PRETRAINING.md
1 parent b4c66ae commit 4a13c40

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

TinyCLIP/docs/PRETRAINING.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@ In this document, we introduce ***auto weight inheritance*** and ***manual weigh
44

55
:star: **[Notice]** Please replace the training data loader with the one loading LAION-400M or YFCC-15M.
66

7+
Reference: [OpenCLIP Data](https://github.com/mlfoundations/open_clip?tab=readme-ov-file#data)
8+
79
### Auto weight inheritance training
810
In this part, we compress OpenCLIP ViT-B/32 to 25% of origin size using three stages, where the model is compressed from 100% to 75%, from 75% to 50% and from 50% to 25% in the three stages, respectively.
911

0 commit comments

Comments
 (0)