OTAS: An Elastic Transformer Serving System via Token Adaptation

Publication
IEEE International Conference on Computer Communications (INFOCOM) (CCF-A)
Jinyu Chen
Jinyu Chen
PhD Student
Wenchao Xu
Wenchao Xu
Research Assistant Professor
Zicong Hong
Zicong Hong
Graduated PhD Student
Song Guo
Song Guo
Chair Professor
Jie Zhang
Jie Zhang
Research Assistant Professor