Why should we even use adapter in image vit? #36
Description
The average running time for each epoch in full-tuning is 2 minutes and for adaptformer 2:30 on a single gpu device with RTX 3090 and the results (as we can see in your paper tables isn't that significantly better and even most of the times full-tuning is working better). This rises the question of why even care about using adapter and "small" number of tunable parameters in image vit? (even the ram difference isn't that significant (10GB adapter and 15GB full-tuning ))