Spatiotemporal & Multimodal Learning

Siru Zhong 钟嗣儒

Ph.D. Candidate HKUST (GZ) Visiting @ Tsinghua · HPGC Group

Hi there, I'm a Ph.D. Candidate at The Hong Kong University of Science and Technology, Guangzhou, advised by Prof. Yuxuan Liang. I am currently visiting Tsinghua University and the National Supercomputing Center in Shenzhen, hosted by Prof. Haohuan Fu. I am also fortunate to receive guidance from Prof. James T. Kwok at HKUST. My research focuses on Spatiotemporal and Multimodal Learning, exploring how intelligent models learn transferable representations, adapt to uncertain and changing environments, and retain useful information over time.

I am honored to be a consecutive recipient of the HKUST (GZ) DSA Excellent Research Award, a Tutorial Speaker for MM4ST @ MM 2025 & ICME 2026 and MM4TS @ AAAI 2026, and a reviewer/PC member for venues including NeurIPS, ICLR, KDD, ACM MM, AAAI, PAKDD, IEEE TPAMI, FARS, MILETS, IJITDM, and Neurocomputing. Beyond academia, I have worked on temporal data infrastructure at Tencent, multimodal perception at XPENG, foundation models at Huawei, and video memory at Beta Infinity.

Selected Publications

(* equal contribution) All publications

Representation & Generalization

Learning transferable structures and representations across dynamic data and domains.

Overview
Cover image for Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Models

Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Models

Siru Zhong, Junjie Qiu, Yangyu Wu, Yiqiu Liu, Yuanpeng He, Zhongwen Rao, Bin Yang, Chenjuan Guo, Hao Xu, Yuxuan Liang

Preprint 2026

Cover image for UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation

UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation

Siru Zhong, Xixuan Hao, Yibo Yan, Ying Zhang, Yangqiu Song, Yuxuan Liang

ACM MM 2024

Cover image for Breaking the Regional Barrier: Inductive Semantic Topology Learning for Worldwide Air Quality Forecasting

Breaking the Regional Barrier: Inductive Semantic Topology Learning for Worldwide Air Quality Forecasting

Zhiqing Cui*, Siru Zhong*, Ming Jin, Shirui Pan, Qingsong Wen, Yuxuan Liang

Preprint 2026

Robust Learning & Adaptation

Robust learning and efficient adaptation under uncertainty and distribution shifts.

Overview
Cover image for Towards Robust Time Series Learning via Capacity-Centric Modulation

Towards Robust Time Series Learning via Capacity-Centric Modulation

Siru Zhong, Senzhang Wang, James T. Kwok, Yuxuan Liang

Preprint 2026

Cover image for TS-Memory: Plug-and-Play Memory for Time Series Foundation Models

TS-Memory: Plug-and-Play Memory for Time Series Foundation Models

Sisuo Lyu*, Siru Zhong*, Tiegang Chen, Weilin Ruan, Qingxiang Liu, Taiqiang Lv, Qingsong Wen, Raymond Chi-Wing Wong, Yuxuan Liang

KDD 2026 Oral

Cover image for Perceive, Route and Modulate: Dynamic Pattern Recalibration for Time Series Forecasting

Perceive, Route and Modulate: Dynamic Pattern Recalibration for Time Series Forecasting

Siru Zhong, Meng Zhao, Haohuan Fu, Haoyang Li, Qingsong Wen, Yuxuan Liang

Preprint 2026

Memory & Dynamic Evidence

Efficient memory and evidence-based reasoning in evolving environments.

Overview
Cover image for PREM: Prefix-Steered Recurrent Memory for Long-Video Understanding

PREM: Prefix-Steered Recurrent Memory for Long-Video Understanding

Siru Zhong, Qiongyan Wang, Xiaohui Lv, Yuzheng Zhuang, Shuai Tao, Wulong Liu, Haohuan Fu, Yuxuan Liang

Preprint 2026

Cover image for STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence

STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence

Siru Zhong, Shenghan Tan, Rihong Yan, Xiaohui Lv, Yuzheng Zhuang, Shuai Tao, Wulong Liu, Haohuan Fu, Yuxuan Liang

Preprint 2026

Cover image for Ground, Cover, and Refine: Evidence-Centric Frame Selection for Long-Video Question Answering

Ground, Cover, and Refine: Evidence-Centric Frame Selection for Long-Video Question Answering

Fan Wei, Siru Zhong, Runmin Dong, Miao Yang, Zhaoyang Luo, Haohuan Fu

Preprint 2026

News

2026
One paper on Multimodal Spatio-Temporal forecasting was accepted to ACM MM 2026.
Jul 10
I passed my Ph.D. PQE and officially became a Ph.D. Candidate at HKUST (GZ).
May 21
One paper about time series memory was accepted by KDD 2026 research track.
May 16
One paper on sample-adaptive dropout for robust time series forecasting was accepted to ICML 2026.
May 01
I am glad to become a visiting student at Tsinghua University and National Supercomputing Center.
Mar 04
2025
One tutorial on Multimodal Learning for Spatio-Temporal Data Mining Era of Foundation Models was accepted to ICME 2026.
Dec 24
One paper on vision for time series forecasting was accepted to AAAI 2026.
Nov 08
One paper on Spatio-Temporal Foundation Model was accepted to NeurIPS 2025 (spotlight).
Sep 18
One paper on Traffic Flow Forecasting was accepted to TITS 2025.
Aug 20
One paper on Multimodal Building Electricity Loads Forecasting was accepted to MM 2025.
Jul 05
One paper on Urban Heat Island Effect Forecasting was accepted to KDD 2025.
May 15
One paper on Multimodal Time Series Forecasting was accepted to ICML 2025.
May 01
One tutorial on Multimodal Learning for Spatio-Temporal Data Mining was accepted to MM 2025.
Feb 28
I joined Huawei as a Research Intern working on spatio-temporal foundation models.
Feb 06
I started my PhD studies at the Hong Kong University of Science and Technology (Guangzhou).
Feb 05
I received the Runner-Up Prize in the 2024 HKUST (GZ) DSA Excellent Research Award.
Jan 27
2024
Two papers on Urban Indicator Prediction and Air Quality Inference were accepted to AAAI 2025.
Dec 10
I successfully defended my MPhil thesis in Data Science and Analytics at HKUST (GZ).
Nov 25
One paper on Urban Multimodal Image-Text Retrieval was accepted to MM 2024.
Jul 18
Two papers on Spatio-Temporal Prediction and Neural Networks were accepted to IJCAI 2024.
May 14
I joined XPeng Motors as a Research Intern working on spatio-temporal perception for autonomous driving.
May 14
One paper on LLM-Enhanced Urban Region Profiling was accepted to WWW 2024.
Jan 23
2023
I started my MPhil studies at the Hong Kong University of Science and Technology (Guangzhou).
Aug 24
2022
I officially joined Tencent as a Software Engineer!
Jul 04
I graduated from Hefei University of Technology with Outstanding Thesis Award.
Jun 05
2021
I completed my three-month internship at Tencent and received a SP return offer.
Sep 14

Education

Industry Experience

  • Beta Infinity · Foundation Model Lab

    Research Intern · Video Understanding & Memory

    2026.06 - Present
  • NSCS · HPC Department

    Visiting Researcher · Temporal Sequence Modeling

    2026.02 - Present
  • Huawei · 2012 Laboratories

    Research Intern · Temporal Foundation Model

    2025.02 - 2025.12
  • XPENG · Autonomous Driving Center

    Research Intern · Video Understanding

    2024.05 - 2024.11
  • Tencent · PCG Tech Center

    Software Engineer · Temporal Data Infrastructure

    2022.06 - 2023.05
  • Tencent · PCG Tech Center

    Software Intern · Temporal Workflow Engine

    2021.06 - 2021.09

Service

  • Reviewer: NeurIPS 2026; FMTS 2026 @ NeurIPS 2026; ICLR 2025, 2026, 2027; KDD 2026, 2027; AAAI 2027; ACML 2026; MM 2025; FARS (Fully Automated Research System); IEEE TPAMI; Neurocomputing; IJITDM
  • PC Member: WSDM 2027; ACM MM 2026; AAAI 2026, 2027; PAKDD 2026; MILETS 2026 @ KDD 2026
  • Tutorial Speaker: MM4ST @ MM 2025, MM4ST @ ICME 2026, MM4TS @ AAAI 2026
  • Web Chair: WebST 2026, WebST 2025, UrbComp 2025

Teaching All teaching

  • DSAA60000 Table Representation LearningSpring 2026
  • PLED5001 Communicating Research in EnglishSpring 2025
  • PDEV6800 Introduction to Teaching and Learning in Higher EducationFall 2024

Awards

  • Junior Student Track Award, DSA Excellent Research Award, HKUST (GZ)2026
  • Runner-Up Prize for DSA Excellent Research Award, HKUST (GZ)2025
  • Best Project Award (1st/15) in Data Science Computing, HKUST (GZ)2023
  • Outstanding Student (Top 10%) in Red Bird Summer Camp, HKUST (GZ)2023
  • iCode Certification of R&D Engineering Competency Evaluation, Tencent2022
  • Silver Award (2nd/12) in Code World Program, Tencent2022
  • Outstanding Student Award (8th/100) in New Employee Training, Tencent2022
  • Outstanding Graduation Thesis Award (Top 2%), HFUT2022
  • First Prize (Top 10) in CSDN Technology Blogger Competition2020

Talks All talks

  • 跨时空学习:多模态感知、跨域泛化与鲁棒适应 ↗
    中南大学计算机学院第六届青年学者论坛, 长沙
  • Multimodal Learning for Spatio-Temporal Data Mining in the Era of Foundation Models
    ICME 2026 Tutorial, Bangkok
  • DropoutTS: Sample-Adaptive Dropout for Robust Time Series Forecasting ↗
    AI TIME × ICML 2026, Online