I am an Applied Scientist at Amazon AGI Foundations, working on multi-modal and reasoning foundational models (Amazon Nova). I received my PhD in Computer Science from Columbia University, advised by Shih-Fu Chang. Prior to that, I obtained my B.S. in Electrical Engineering and B.S. in Applied Mathematics at UC San Diego.

Selected Publications (Full List)

  1. Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting
    Guangxing Han, Long Chen, Jiawei Ma, Shiyuan Huang, Rama Chellappa, and Shih-Fu Chang
    International Journal of Computer Vision (IJCV) 2026
  2. Personalized Video Comment Generation
    Xudong Lin, Ali Zare, Shiyuan Huang, Ming-Hsuan Yang, Shih-Fu Chang, and Li Zhang
    In Findings of the Association for Computational Linguistics: EMNLP 2024
  3. Characterizing Video Question Answering with Sparsified Inputs
    Shiyuan Huang, Robinson Piramuthu, Vicente Ordonez, Shih-Fu Chang, and Gunnar A. Sigurdsson
    arXiv preprint arXiv:2311.16311 2023
  4. Video in 10 Bits: Few-Bit VideoQA for Efficiency and Privacy
    Shiyuan Huang, Robinson Piramuthu, Shih-Fu Chang, and Gunnar A. Sigurdsson
    In Computer Vision – ECCV 2022 Workshops 2023
  5. DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot Object Detection
    Jiawei Ma, Yulei Niu, Jincheng Xu, Shiyuan Huang, Guangxing Han, and Shih-Fu Chang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023
  6. Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
    Xudong Lin, Simran Tiwari, Shiyuan Huang, Manling Li, Mike Zheng Shou, Heng Ji, and Shih-Fu Chang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023
  7. Supervised Masked Knowledge Distillation for Few-Shot Transformers
    Han Lin, Guangxing Han, Jiawei Ma, Shiyuan Huang, Xudong Lin, and Shih-Fu Chang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023
  8. TempCLR: Temporal Alignment Representation with Contrastive Learning
    Yuncong Yang, Jiawei Ma, Shiyuan Huang, Long Chen, Xudong Lin, Guangxing Han, and Shih-Fu Chang
    In The Eleventh International Conference on Learning Representations (ICLR) 2023
  9. Task-Adaptive Negative Envision for Few-Shot Open-Set Recognition
    Shiyuan Huang*, Jiawei Ma*, Guangxing Han, and Shih-Fu Chang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022
  10. Few-Shot Object Detection With Fully Cross-Transformer
    Guangxing Han, Jiawei Ma, Shiyuan Huang, Long Chen, and Shih-Fu Chang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022