Vision-Language Models Create Cross-Modal Task Representations
vlm-cross-modal-reps.github.io
Task representations in VLMs are consistent across modality (text, image) and specification (example, instruction).
关键词：vision-language models, multimodal models, task vectors, function vectors, in-context learning, interpretability