Junfei Xiao

I am a Computer Science Ph.D. student in CCVL research group at Johns Hopkins University, advised by Bloomberg Distinguished Professor Dr. Alan Yuille.

I received my M.S.E. degree in Computer Science from Johns Hopkins University. Before this, I got B.E. in Mechanical Engineering and Double Degree in Mathematics from Beihang University.

My current research interests are transfer learning with a focus on multi-domain/modal learning, and weakly/semi/self-supervised learning in vision tasks.

CV  /  Google Scholar /  Github

profile photo
Recent News
  • [Feb 2024] Please check out my latest work in Google - PaLM2-VAdapter at here!
  • [Dec 2023] ProLab is now released. Check out the paper and code!
  • [July 2023] Joining Google Research as a student researcher!
  • [June 2023] One paper is accepted to ICCV 2023.
  • [March 2023] Two papers are accepted to CVPR 2023.
  • [October 2022] I won 1st place in the Robust Vision Challenge (semantic segmentation track) at ECCV 2022.
  • [October 2022] A first-authored paper on masked autoencoders for medical images is accepted to WACV 2023.
  • [September 2022] CateNorm receives the best paper honorable mention award at DART 2022.
  • [March 2022] A first-authored paper on semi-supervised action recognition is accepted to CVPR 2022.

Publications

PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adapter
Junfei Xiao, Zheng Xu, Alan Yuille, Shen Yan, Boyu Wang
arXiv preprint, 2024

arXiv / bibtex
                    @article{palm2vadapter2024,
                      title={PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adapter},
                      author={Xiao, Junfei and Xu, Zheng and Yuille, Alan and Yan, Shen and Wang, Boyu},
                      journal={arXiv preprint arXiv:2402.10896},
                      year={2024},
                    }

A Semantic Space is Worth 256 Language Descriptions: Make Stronger Segmentation Models with Descriptive Properties
Junfei Xiao, Ziqi Zhou, Wenxuan Li, Shiyi Lan, Jieru Mei, Zhiding Yu,
Bingchen Zhao, Alan Yuille, Yuyin Zhou, Cihang Xie
arXiv preprint, 2023

arXiv / code / bibtex
                    @article{xiao2023semantic,
                      author    = {Xiao, Junfei and Zhou, Ziqi and Li, Wenxuan and Lan, Shiyi and Mei, Jieru and Yu, Zhiding and Yuille, Alan and Zhou, Yuyin and Xie, Cihang},
                      title     = {A Semantic Space is Worth 256 Language Descriptions: Make Stronger Segmentation Models with Descriptive Properties},
                      journal   = {arXiv preprint arXiv:2312.13764},
                      year      = {2023},
                    }

CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection
Jie Liu, Yixiao Zhang, Jieneng Chen, Junfei Xiao, Yongyi Lu, Bennett A. Landman, Yixuan Yuan, Alan Yuille, Yucheng Tang, Zongwei Zhou
ICCV, 2023

arXiv / code / bibtex
                  @inproceedings{liu2023clip,
                    title={Clip-driven universal model for organ segmentation and tumor detection},
                    author={Liu, Jie and Zhang, Yixiao and Chen, Jie-Neng and Xiao, Junfei and Lu, Yongyi and A Landman, Bennett and Yuan, Yixuan and Yuille, Alan and Tang, Yucheng and Zhou, Zongwei},
                    booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
                    pages={21152--21164},
                    year={2023}
                  }

Label-Free Liver Tumor Segmentation
Qixin Hu, Yixiong Chen, Junfei Xiao, Shuwen Sun, Jie-Neng Chen, Alan Yuille, Zongwei Zhou
CVPR, 2023

arXiv / code / bibtex
                  @article{hu2023labelfree,
                    title={Label-Free Liver Tumor Segmentation},
                    author={Hu, Qixin and Chen, Yixiong and Xiao, Junfei  and Sun, Shuwen and Chen, Jie-Neng and Yuille, Alan and Zhou, Zongwei},
                    journal={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
                    year={2022}
                  }

Masked Autoencoders Enable Efficient Knowledge Distillers
Yutong Bai, Zeyu Wang, Junfei Xiao, Chen Wei, Huiyu Wang, Alan Yuille, Yuyin Zhou, Cihang Xie
CVPR, 2023

arXiv / code / bibtex
                  @article{bai2022masked,
                    title={Masked autoencoders enable efficient knowledge distillers},
                    author={Bai, Yutong and Wang, Zeyu and Xiao, Junfei and Wei, Chen and Wang, Huiyu and Yuille, Alan and Zhou, Yuyin and Xie, Cihang},
                    journal={arXiv preprint arXiv:2208.12256},
                    year={2022}
                  }

Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification
Junfei Xiao, Yutong Bai, Alan Yuille, Zongwei Zhou
WACV, 2023

arXiv / code / bibtex
@article{xiao2022delving,
  title={Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification},
  author={Xiao, Junfei and Bai, Yutong and Yuille, Alan and Zhou, Zongwei},
  journal={arXiv preprint arXiv:2210.12843},
  year={2022}
}

Learning from Temporal Gradient for Semi-supervised Action Recognition
Junfei Xiao, Longlong Jing, Lin Zhang, Ju He, Qi She, Zongwei Zhou, Alan Yuille, Yingwei Li
CVPR, 2022

arXiv / code / bibtex
@inproceedings{xiao2022learning,
  title={Learning from temporal gradient for semi-supervised action recognition},
  author={Xiao, Junfei and Jing, Longlong and Zhang, Lin and He, Ju and She, Qi and Zhou, Zongwei and Yuille, Alan and Li, Yingwei},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={3252--3262},
  year={2022}
}

CateNorm: Categorical Normalization for Robust Medical Image Segmentation
Junfei Xiao, Lequan Yu, Zongwei Zhou, Yutong Bai, Lei Xing, Alan Yuille, Yuyin Zhou
MICCAI Workshop - Domain Adaptation and Representation Transfer , 2022
Best Paper Honorable Mention

arXiv / code / bibtex
@inproceedings{xiao2022catenorm,
  title={CateNorm: Categorical Normalization for Robust Medical Image Segmentation},
  author={Xiao, Junfei and Yu, Lequan and Zhou, Zongwei and Bai, Yutong and Xing, Lei and Yuille, Alan and Zhou, Yuyin},
  booktitle={MICCAI Workshop on Domain Adaptation and Representation Transfer},
  pages={129--146},
  year={2022},
  organization={Springer}
}

A bio-robotic remora disc with attachment and detachment capabilities for reversible underwater hitchhiking
Siqi Wang, Lei Li, Yufeng Chen, Yueping Wang, Wenguang Sun, Junfei Xiao, Dylan Wainwright, Tianmiao Wang, Robert J. Wood, Li Wen
ICRA, 2019

arXiv / bibtex
@inproceedings{wang2019bio,
  title={A bio-robotic remora disc with attachment and detachment capabilities for reversible underwater hitchhiking},
  author={Wang, Siqi and Li, Lei and Chen, Yufeng and Wang, Yueping and Sun, Wenguang and Xiao, Junfei and Wainwright, Dylan and Wang, Tianmiao and Wood, Robert J and Wen, Li},
  booktitle={2019 International Conference on Robotics and Automation (ICRA)},
  pages={4653--4659},
  year={2019},
  organization={IEEE}
}


Honors and Awards

1st Place in the Robust Vision Challenge - Semantic Segmentation Track



Webpage template borrowed from Jon Barron