Picture of me.

Haocong Rao

PhD Candidate, AISG PhD Fellow

CCDS, NTU

About me

I am Haocong Rao (饶浩聪), a final-year PhD candidate supported by AI Singapore (AISG) PhD Fellowship and supervised by Prof. Chunyan Miao (FIEEE, Fellow of the Academy of Engineering Singapore) and Prof. Cyril Leung (Fellow of the Engineering Institute of Canada), at the LILY Research Centre and College of Computing and Data Science (CCDS), Nanyang Technological University (NTU), Singapore. My broad research interests include Skeleton-Based Person Re-Identification (SRID), 3D Signal Processing, Self-Supervised/Unsupervised learning, Interdisciplinary AI (e.g., LLMs Application, AI for Healthcare).

Prior to joining NTU, I was a research assistant at the Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Science, where my supervisors and academic mentors were Prof. Xiping Hu, Prof. Jun Cheng, Prof. Bin Hu, and Prof. Victor C.M. Leung (FIEEE, FRSC, FEIC, FCAE). I obtained my B.Eng. degree with Outstanding Thesis Award from South China University of Technology (SCUT).

News

  • [2024/12]   One paper is accepted by AAAI 2025!
  • [2024/05]   One survey paper "A Survey of Artificial Intelligence in Gait-Based Neurodegenerative Disease Diagnosis" is released!
  • [2024/03]   We are organizing the The 4th AI for Ageless Aging Workshop (AIAA) workshop, conjunction with IJCAI 2024, now calling for papers!
  • [2024/01]   One survey paper "A Survey on 3D Skeleton Based Person Re-Identification: Approaches, Designs, Challenges, and Future Directions" is released!
  • [2023/10]   One paper (LLMs for Psychology) is accepted by Findings of EMNLP 2023!
  • [2023/10]   Awarded Outstanding Contribution Award of European Alliance for Innovation (EAI), International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness.
  • [2023/07]   One paper is accepted by International Journal of Computer Vision (IJCV) [IF: 19.5]!
  • [2023/03]   Our TPAMI [IF: 24.3] article "A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification" is recognized as ESI Highly Cited Paper!
  • [2023/02]   One paper is accepted by CVPR 2023!
  • [2022/10]   One paper is accepted by IEEE Signal Processing Letters [IF: 3.9]!
  • [2022/09]   Our TPAMI article "A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification" is selected as Featured Article (2022 October Issue) of TPAMI!
  • [2022/09]   Recognized as Top Reviewer (3%) and Distinguished Program Committee (PC) Member of IJCAI!
  • [2022/04]   One paper is accepted by IJCAI 2022 (Oral)!
  • [2021/11]   Awarded AI Singapore (AISG) PhD Fellowship (Top PhD Scholarship in Singapore)!
  • [2021/11]   One paper is accepted by IEEE Transactions on Multimedia (TMM) [IF: 8.2]!
  • [2021/07]   One paper is accepted by ACMMM 2021!
  • [2021/06]   One paper is accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) [IF: 24.3]!
  • [2021/04]   One paper is accepted by IJCAI 2021 (Oral)!
  • [2021/03]   One paper is accepted by IEEE Internet of Things Journal (IoTJ) [IF: 10.2]!
  • [2021/03]   One paper is accepted by Information Sciences [IF: 8.5]!
  • [2020/12]   Our paper "Multi-level Co-Occurrence Graph Convolutional LSTM for Skeleton-Based Action Recognition" received 2020 IEEE Healthcom Best Paper Award at IEEE International Conference on E-health Networking, Application & Service!
  • [2020/12]   One paper is accepted by IEEE Internet of Things Journal (IoTJ) [IF: 9.5]!
  • [2020/10]   Awarded Dean's Research Excellence Scholarship (Special Award) at Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences (SIAT)!
  • [2020/04]   One paper is accepted by IJCAI 2020 (Oral)!
  • Selective Articles [Google Scholar] [ResearchGate]

    A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification
    By Haocong Rao*, Siqi Wang*, Xiping Hu, Mingkui Tan, Yi Guo, Jun Cheng, Xinwang Liu, Bin Hu (* Co-First Author)
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021 [IF: 24.3] (Extension of IJCAI 2020 Paper) [First SRID Article in TPAMI] (TPAMI Featured Article, ESI Highly Cited Paper)
    [Link] [PDF] [Code] [Data]

    Motif Guided Graph Transformer with Combinatorial Skeleton Prototype Learning for Skeleton-Based Person Re-Identification
    By Haocong Rao, Chunyan Miao
    39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025 [First SRID Paper in AAAI]
    [Link] [PDF] [Code] [Data]

    A Survey of Artificial Intelligence in Gait-Based Neurodegenerative Disease Diagnosis
    By Haocong Rao, Minlin Zeng, Xuejiao Zhao, Chunyan Miao
    Arxiv Preprint, 2024
    [Link] [PDF] [Resources]

    A Survey on 3D Skeleton Based Person Re-Identification: Approaches, Designs, Challenges, and Future Directions
    By Haocong Rao, Chunyan Miao
    Arxiv Preprint, 2024 [First SRID Survey]
    [Link] [PDF] [Resources]

    Hierarchical Skeleton Meta-Prototype Contrastive Learning with Hard Skeleton Mining for Unsupervised Person Re-Identification
    By Haocong Rao, Cyril Leung, Chunyan Miao
    International Journal of Computer Vision (IJCV) 2023 [IF: 19.5] [First SRID Article in IJCV]
    [Link] [PDF] [Code] [Data]

    Can ChatGPT Assess Human Personalities? A General Evaluation Framework
    By Haocong Rao, Cyril Leung, Chunyan Miao
    2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023 (Findings)
    [Link] [PDF] [Code]

    TranSG: Transformer-Based Skeleton Graph Prototype Contrastive Learning with Structure-Trajectory Prompted Reconstruction for Person Re-Identification
    By Haocong Rao, Chunyan Miao
    IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023 [First SRID Paper in CVPR]
    [Link] [PDF] [Code] [Data]

    Revisiting k-Reciprocal Distance Re-ranking for Skeleton-Based Person Re-Identification
    By Haocong Rao, Yuan Li, Chunyan Miao
    IEEE Signal Processing Letters 2022 [IF: 3.9]
    [Link] [PDF]

    SimMC: Simple Masked Contrastive Learning of Skeleton Representations for Unsupervised Person Re-Identification
    By Haocong Rao, Chunyan Miao
    31st International Joint Conference on Artificial Intelligence, IJCAI 2022 (Oral, Acceptance Rate: 14.9%)
    [Link] [PDF] [Code] [Data]

    Skeleton Prototype Contrastive Learning with Multi-Level Graph Relation Modeling for Unsupervised Person Re-Identification
    By Haocong Rao, Chunyan Miao
    Arxiv Preprint (Extension of IJCAI 2021 Paper)
    [Link] [PDF] [Code] [Data]

    SM-SGE: A Self-Supervised Multi-Scale Skeleton Graph Encoding Framework for Person Re-Identification
    By Haocong Rao, Xiping Hu, Jun Cheng, Bin Hu
    29th ACM International Conference on Multimedia, ACMMM 2021 [First SRID Paper in ACMMM]
    [Link] [PDF] [Code] [Data]

    Multi-level Graph Encoding with Structural-Collaborative Relation Learning for Skeleton-Based Person Re-Identification
    By Haocong Rao, Shihao Xu, Xiping Hu, Jun Cheng, Bin Hu
    30th International Joint Conference on Artificial Intelligence, IJCAI 2021 (Oral, Acceptance Rate: 13.9%)
    [Link] [PDF] [Code] [Data]

    Augmented Skeleton Based Contrastive Action Learning with Momentum LSTM for Unsupervised Action Recognition
    By Haocong Rao*, Shihao Xu*, Xiping Hu, Jun Cheng, Bin Hu (* Co-First Author)
    Information Sciences 2021 [IF: 8.5]
    [Link] [PDF] [Code] [Data]

    Internet of Things Enabled Data Fusion Method for Sleep Healthcare Applications
    By Fan Yang, Qilu Wu, Xiping Hu, Jiancong Ye, Yuting Yang, Haocong Rao, Rong Ma, Bin Hu
    IEEE Internet of Things Journal (IoTJ) 2021 [IF: 10.2]
    [Link] [PDF]

    Prototypical Contrast and Reverse Prediction: Unsupervised Skeleton Based Action Recognition
    By Shihao Xu, Haocong Rao, Xiping Hu, Jun Cheng, Bin Hu
    IEEE Transactions on Multimedia (TMM) 2021 [IF: 8.2]
    [Link] [PDF] [Code] [Data]

    Attention based Multi-level Co-occurrence Graph Convolutional LSTM for 3D Action Recognition
    By Shihao Xu*, Haocong Rao*, Xiping Hu, Jun Cheng, Bin Hu (* Co-First Author)
    IEEE Internet of Things Journal (IoTJ) 2020 [IF: 9.5]
    [Link] [PDF] [Code]

    Self-Supervised Gait Encoding with Locality-Aware Attention for Person Re-Identification
    By Haocong Rao*, Siqi Wang*, Xiping Hu, Mingkui Tan, Huang Da, Jun Cheng, Bin Hu. (* Co-First Author)
    29th International Joint Conference on Artificial Intelligence, IJCAI 2020 (Oral, Acceptance Rate: 12.6%) [First SRID Paper in IJCAI]
    [Link] [PDF] [Code] [Data]

    Professional Services & Teaching

  • Editorial Board Member of Frontiers in Computational Neurosciencer
  • Program Committee (PC) Member of IJCAI 2022, 2023, 2024
  • Co-Organizer and PC Member of the 4th AI for Ageless Aging Workshop @IJCAI 2024
  • Co-Organizer and PC Member of the 3rd AI for Ageless Aging Workshop @IJCAI 2023
  • Organizing Team Member of the 6th International Conference on Crowd Science and Engineering @ICCSE 2023
  • Co-Host, Co-Organizer, and PC Member of the 2nd AI for Cognitive and Physical Frailty Seminar @IJCAI 2022

  • Nature Communications, Reviewer
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Reviewer
  • International Journal of Computer Vision (IJCV), Reviewer
  • IEEE Transactions on Image Processing (TIP), Reviewer
  • IEEE Transactions on Industrial Informatics (TII), Reviewer
  • IEEE Transactions on Affective Computing (TAC), Reviewer
  • IEEE Journal of Biomedical and Health Informatics (JBHI), Reviewer
  • IEEE Transactions on Multimedia (TMM), Reviewer
  • Artificial Intelligence Review, Reviewer
  • Expert Systems with Applications, Reviewer

  • CZ3004 Multi-disciplinary Design Project, Teaching Assistant, NTU, 2022 Fall
  • SC1003 Introduction to Computational Thinking and Programming, Teaching Assistant, NTU, 2023 Fall
  • Selective Projects & Awards & Honors

  • Participator of 1 National Key Research and Development Program of China, and 4 general programs of National Natural Science Foundation of China. (2018 to 2021)
  • Project Lead of AI Singapore PhD Research Project (of National Research Foundation, Singapore) (2022 to 2025): “Research and Application of AI for Skeleton-Based Person Re-Identification”
  • Participator of the National Science and Technology Innovation Project (2018 to 2020): “Research and Development of Non-Invasive Gait * System”.
  • Participator of Shenzhen Sustainable Development of Science and Technology Project (2021): “Clinical Application and Research on Gait and Multi-Modal Analysis Based Elderly Fall and Protection System”.
  • Participator of Alibaba-NTU Joint Research Institute Project (2022 to 2025)

  • The developed 4D Depth Video Based Gait Recognition & Emotion Prediction System and the Swarm Intelligence Computing and Multi-Sensor Based Sleep Monitoring System have been applied to various universities and hospitals with more than 10,000 clinical experiments, including: State Key Laboratory of Cognitive Neuroscience and Learning of Beijing Normal University, Peking University Sixth Hospital, the Second Xiangya Hospital, Shenzhen People’s Hospital, etc.

  • Outstanding Contribution Award, European Alliance for Innovation (EAI), International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, 2023
  • Outstanding Reviewer of IJCAI (Top 3% Reviewer), 2022
  • Distinguished PC Member of IJCAI, 2022
  • One ESI Highly Cited Paper & TPAMI Featured Article (2022 October Issue)
  • AI Singapore (AISG) PhD Fellowship (Top PhD Scholarship in SG), 2022-2025
  • Dean's Research Excellence Scholarship (Special Award) of SIAT, 2020
  • IEEE Healthcom Best Paper Award, 2020
  • Outstanding Undergraduate Thesis Award of SCUT, 2019
  • National Scholarship, Ministry of Education of China, 2018
  • 2nd Place (Leader) in South China Hackathon of Microsoft, 2018
  • 1st Place (Leader) in Wenshi Software Design Contest of SCUT, 2018
  • Outstanding Student Association (Leader) of SCUT SSE, 2017
  • 1st Prize (Leader) in Creative Programming Design Contest of SCUT SSE, 2016
  • Invited Talks

  • "Advancing Skeleton-Based AI Innovations in Person Re-Identification and Beyond", Invited by Information Hub - Artificial Intelligence, the Hong Kong University of Science and Technology (Guangzhou) , China, 2024
  • "Pioneering AI Innovations in Skeleton-Based Person Re-Identification", Invited by Institute of Artificial Intelligence, Xiamen University, China, 2024
  • "Discussion and Advice on the National AI Stragtegy 2.0", Invited by AI Singapore Committee (of Singapore National Research Foundation), NUS, Singapore, 2024
  • "Skeleton Prototype Contrastive Learning with Multi-Level Graph Relation Modeling for Unsupervised Person Re-Identification", Invited by International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, 2023
  • "Insights from Top-Conference Research", Invited by the Department of Computer Science and Engineering, Southern University of Science and Technology, China, 2021
  • Leadership Experiences

    NTU CCDS (SCSE) Graduate Student Club (2021 - 2024)
    Director of Publicity Committee & Member of Academic Committee

  • Organize talks, seminars, and gatherings more than 10 times (e.g., PhD Student Lecture Series), which have gained over 6,300 video views on Youtube.
  • Connect and invite various scholars for academic talks:
         PhD Student Lecture Series (SLS): CCDS (SCSE) PhD Students, AI Singapore (AISG) PhD Fellows
         Graduate Chat Series: NTU CCDS (SCSE) Outstanding PhD Thesis Awardees
          Invited Talk Series: NTU Predidential Postdoctoral Fellows, NTU Nanyang Assistant Professors, etc.
  • Manage and promote CCDS (SCSE) social media publicity (Youtube (@SCSE-GSC), Instagram (@ntu.scse.gsc), Twitter (@SCSE_GSC), Wechat (@NTU SCSE PhD), etc.), which has linked and served more than 320 NTU CCDS (SCSE) PhDs.
  • SCUT SSE Student Union (2015 - 2018)
    Director of Information & News Committee

  • Managed and promoted SCUT SSE social media publicity (e.g., SCUT iSoftware), which had connected and served over 500 SCUT SSE students.
  • Organized technical training and provided professional IT supports for SCUT SSE activities.
  • Co-organized more than three programming/software competitions.
  • Personal Interests

    Running and Working Out: I enjoy running and often participate in 10km+ level races including Singapore Marathon 2023. I regularly work out in the gym.
    Military Chess (A Chinese cooperative and tactical game):My most playing chess game during my high school.
    Billiards, Archery, Rock Climbing, Texas Hold'em