Multimodal Contextualized Support for Enhancing Video Retrieval System

arXiv:2412.07584v2 Announce Type: replace-cross Abstract: Current video retrieval systems, especially those used in competitions, primarily focus on querying individual keyframes or images rather than encoding an entire clip or video segment. However, queries often describe an action or event over a series of frames, not a specific image. This results in insufficient information when analyzing a single frame, leading to less accurate query results. Moreover, extracting embeddings solely from ima