Question about the TPS method

[King4819]

Awesome work that thoroughly considers the effect of pruned tokens. I have an interesting question: since most token pruning methods actually prune layer 4 to layer 12 of vit model, have you tried pruning the early layers of vit model (layer 1 ~ layer3) ? And how is the performance ? Hopes to get your reply, thanks !!!