Vast: A vision-audio-subtitle-text omni-modality foundation model and dataset S Chen, H Li, Q Wang, Z Zhao, M Sun, X Zhu, J Liu Advances in Neural Information Processing Systems 36, 72842-72866, 2023 | 96 | 2023 |
Chatbridge: Bridging modalities with large language model as a language catalyst Z Zhao, L Guo, T Yue, S Chen, S Shao, X Zhu, Z Yuan, J Liu arXiv preprint arXiv:2305.16103, 2023 | 53 | 2023 |
OPT: Omni-perception pre-trainer for cross-modal understanding and generation J Liu, X Zhu, F Liu, L Guo, Z Zhao, M Sun, W Wang, H Lu, S Zhou, J Zhang, ... arXiv preprint arXiv:2107.00249, 2021 | 49 | 2021 |
Vl-mamba: Exploring state space models for multimodal learning Y Qiao, Z Yu, L Guo, S Chen, Z Zhao, M Sun, Q Wu, J Liu arXiv preprint arXiv:2403.13600, 2024 | 46 | 2024 |
Mamo: Fine-grained vision-language representations learning with masked multimodal modeling Z Zhao, L Guo, X He, S Shao, Z Yuan, J Liu Proceedings of the 46th International ACM SIGIR Conference on Research and ¡¦, 2023 | 12* | 2023 |
SC-Tune: Unleashing Self-Consistent Referential Comprehension in Large Vision Language Models T Yue, J Cheng, L Guo, X Dai, Z Zhao, X He, G Xiong, Y Lv, J Liu Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern ¡¦, 2024 | 8 | 2024 |
Mm21 pre-training for video understanding challenge: Video captioning with pretraining techniques S Chen, X Zhu, D Hao, W Liu, J Liu, Z Zhao, L Guo, J Liu Proceedings of the 29th ACM International Conference on Multimedia, 4853-4857, 2021 | 8 | 2021 |
Needle In A Video Haystack: A Scalable Synthetic Framework for Benchmarking Video MLLMs Z Zhao, H Lu, Y Huo, Y Du, T Yue, L Guo, B Wang, W Chen, J Liu arXiv preprint arXiv:2406.09367, 2024 | 7 | 2024 |
Towards Event-oriented Long Video Understanding Y Du, K Zhou, Y Huo, Y Li, WX Zhao, H Lu, Z Zhao, B Wang, W Chen, ... arXiv preprint arXiv:2406.14129, 2024 | 6 | 2024 |
Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentions W Wang, Y Zhang, X He, Y Yan, Z Zhao, X Wang, J Liu arXiv preprint arXiv:2402.11265, 2024 | 2 | 2024 |
ChatSearch: a Dataset and a Generative Retrieval Model for General Conversational Image Retrieval Z Zhao, L Guo, T Yue, E Hu, S Shao, Z Yuan, H Huang, J Liu arXiv preprint arXiv:2410.18715, 2024 | 1 | 2024 |
OneDiff: A Generalist Model for Image Difference Captioning E Hu, L Guo, T Yue, Z Zhao, S Xue, J Liu Proceedings of the Asian Conference on Computer Vision, 2439-2455, 2024 | 1 | 2024 |
Collaborative Training of Tiny-Large Vision Language Models S Lu, L Guo, W Wang, Z Zhao, T Yue, J Liu, S Liu Proceedings of the 32nd ACM International Conference on Multimedia, 4928-4937, 2024 | | 2024 |