SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale
signmusketeers.pals.ttic.edu
Informed by the nature and linguistics of signed languages, our proposed method focuses on just the most relevant parts in a signing video: the face, hands and body posture of the signer.
关键词：ASL, American Sign Language, self-supervised learning, transformer, DINO, sign language