MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions

Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang

ICML'24 Paper Website

# TravelPlanner: A Benchmark for Real-World Planning with Language Agents

Jian Xie*, Kai Zhang*, Jiangjie Chen, Tinghui Zhu, Renze Lou, Yuandong Tian, Yanghua Xiao, Yu Su

ICML'24 Paper Website Code

MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI

Xiang Yue*, Yuansheng Ni*, Kai Zhang*, Tianyu Zheng*, Ruoqi Liu, Ge Zhang, Samuel Stevens, Dongfu Jiang, Weiming Ren, Yuxuan Sun, Cong Wei, Botao Yu, Ruibin Yuan, Renliang Sun, Ming Yin, Boyuan Zheng, Zhenzhu Yang, Yibo Liu, Wenhao Huang, Huan Sun, Yu Su, Wenhu Chen (*: Core Contribution)

CVPR'24 Oral (0.78%) Paper Website Code Data

# Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts

Jian Xie*, Kai Zhang*, Jiangjie Chen, Renze Lou, Yu Su

ICLR'24 Spotlight (5%) Paper Code

MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following

Renze Lou, Kai Zhang, Jian Xie, Yuxuan Sun, Janice Ahn, Hanzi Xu, Yu Su, Wenpeng Yin

ICLR'24 Paper Website Code

ImagenHub: Standardizing the Evaluation of Conditional Image Generation Models

Max Ku, Tianle Li, Kai Zhang, Yujie Lu, Xingyu Fu, Wenwen Zhuang, Wenhu Chen

ICLR'24 Paper Website Code

# UMIE: Unified Multimodal Information Extraction with Instruction Tuning

Lin Sun*, Kai Zhang*, Qingyuan Li*, Renze Lou

AAAI'24 Oral Paper Code

PathAsst: Redefining Pathology through Generative Foundation AI Assistant for Pathology

Yuxuan Sun, Chenglu Zhu, Sunyi Zheng, Kai Zhang, Lin Sun, Zhongyi Shui, Yunlong Zhang, Honglin Li, Lin Yang

AAAI'24 Oral Paper Code

Automatic Evaluation of Attribution by Large Language Models

Xiang Yue, Boshi Wang, Ziru Chen, Kai Zhang, Yu Su, Huan Sun

EMNLP'23 Findings Paper Code

MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing

Kai Zhang*, Lingbo Mo*, Wenhu Chen, Huan Sun, Yu Su

NeurIPS'23 Datasets and Benchmarks Paper Website Code Data

UnifieR: A Unified Retriever for Large-Scale Retrieval

Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Kai Zhang, Daxin Jiang

KDD'23 Paper Code

ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge

Yunxiang Li, Zihan Li, Kai Zhang, Ruilong Dan, You Zhang

Cureus Paper Code

Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors

Kai Zhang, Bernal Jiménez Gutiérrez, Yu Su

ACL'23 Findings Paper Code Slides

LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval

Kai Zhang, Chongyang Tao, Tao Shen, Can Xu, Xiubo Geng, Binxing Jiao, Daxin Jiang

WWW'23 Oral Paper Code Slides

GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks

Weicheng Ma, Renze Lou, Kai Zhang, Lili Wang, Soroush Vosoughi

EMNLP'21 Paper Code

Unified and Incremental SimRank: Index-free Approximation with Scheduled Principle

Fanwei Zhu, Yuan Fang, Kai Zhang†, Kevin Chen-Chuan Chang, Hongtai Cao, Zhen Jiang, Minghui Wu

TKDE Paper Code

Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks

Weicheng Ma*, Kai Zhang*, Renze Lou, Lili Wang, Soroush Vosoughi

ACL'21 Oral Paper Code

RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER

Lin Sun*, Jiquan Wang*, Kai Zhang, Fangsheng Weng, Yindu Su

AAAI'21 Paper Code

Adversarial Language Games for Advanced Natural Language Intelligence

Yuan Yao, Haoxi Zhong, Zhengyan Zhang, Xu Han, Xiaozhi Wang, Kai Zhang, Chaojun Xiao, Guoyang Zeng, Zhiyuan Liu, Maosong Sun

AAAI'21 Paper Code

Open Hierarchical Relation Extraction

Kai Zhang*, Yuan Yao*, Ruobing Xie, Xu Han, Zhiyuan Liu, Fen Lin, Leyu Lin, Maosong Sun

NAACL-HLT'21 Paper Code Slides

TOI-CNN: A Solution of Information Extraction on Chinese Insurance Policy

Lin Sun*, Kai Zhang*†, Fule Ji, Zhenhua Yang

NAACL-HLT'19 Paper Code

A TOI based CNN with Location Regression for Insurance Contract Analysis

Kai Zhang, Lin Sun, Fule Ji

IJCNN'19 Oral Paper Code