Human–Computer Interaction
Hi, I'm Ziyi Zhang
I build interactive systems where humans and AI co-plan, visualize, and interact. My work brings together human–AI collaboration, LLM agents, and AR/VR interfaces, grounded in interaction design and empirical research.
About
The person behind the prototypes
I'm currently pursuing an MS in Information Management at the University of Illinois Urbana-Champaign, where I explore the intersection of human experience and intelligent systems.
My background includes a BS in Software Engineering from Southeast University and an exchange semester in Computer Science at the University of California, Santa Barbara.
My work spans multi-agent planning, counterfactual learning, and wearable systems. I combine interaction design and system building with quantitative and qualitative research to understand how people collaborate with AI. I’m interested in interactions that make intelligent systems understandable and steerable.
Location
Champaign, IL
Open to collaboration
Focus
HCI / Human–AI / LLM Agents / AR & VR
Keywords
Human agencyEmbodied interactionMixed methodsPrototyping
Outside research
AnimeOpen-source tinkeringVisual storytelling
Projects
Flagship work
Research and working systems for human–AI collaboration, immersive learning, and wearable interaction.
ChronoFork
Counterfactual history through learner-authored interventions, multi-actor responses, and reflection against the record.
Halo Ring
A programmable ring input layer that preserves familiar navigation across AR glasses and apps.
Virtual Minds, Real Work
A VR workspace where embodied AI experts join in stages to uncover preferences, negotiate trade-offs, and build plans with you.
ARena of Privacy
Spatial privacy representations connecting sensor coverage, data flows, and operating modes to the devices they govern.
Constellation
Wearable access to remote AI agents, guided by an evolving digital twin of your context, preferences, and way of working.
Vision-Based UAV Gimbal Tracking
Onboard vision and motion estimation coupled with embedded gimbal control for moving-target tracking.
Research
What I investigate
I’m interested in how intelligent and spatial systems shape human agency: how we connect with others, develop ideas, and steer increasingly capable AI.
Next-Generation AI Co-Creation
How vibe coding could better support evolving ideas, embodied feedback, and creative control as people build, experience, and refine interactive media.
Immersive & Embodied Interaction
How spatial interfaces and bodily participation shape what people notice, express, and understand across virtual and everyday environments.
Social XR & Privacy
How everyday XR could reshape social discovery, self-presentation, and information sharing, and how people negotiate visibility, consent, and boundaries in these encounters.
Human–AI Collaboration
How people develop intent, negotiate goals, and retain agency as AI takes a more active role in collaborative work.
LLM Agents
Making agent roles, coordination, and evolving decisions legible so people can participate in and redirect complex workflows.
Visualization & Interaction Design
Interactive representations that help people explore alternatives, trace relationships, and reason about complex information and AI behavior.
Publications
Published work
ChronoFork: Supporting Counterfactual Reasoning for History Learning through LLM-Based Multi-Agent–Learner Co-Roleplay
Ziyi Zhang, Zitong Dai, Hantao Zhao, Xin Yi, Shuning Zhang, Xueyang Wang, Yun Huang, and Dominic Kao
CHI '27: Proceedings of the 2027 CHI Conference on Human Factors in Computing Systems
Virtual Minds, Real Work: LLM-Powered Preference-Based Planning through Spatial Multi-Agent-Human Collaboration
Ziyi Zhang, Xin Yi, Zitong Dai, Xuewen Yu, Shuning Zhang, Bo Liu, Jiuxin Cao, Hantao Zhao
CHI '26: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
The Pervasive Blind Spot: Benchmarking VLM Inference Risks on Everyday Personal Videos
Shuning Zhang, Zhaoxin Li, Changxi Wen, Ying Ma, Simin Li, Gengrui Zhang, Ziyi Zhang, Yibo Meng, Hantao Zhao, Xin Yi, Hewu Li
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 10(2), Article 73
Enhancing Privacy Awareness in Buildings through Augmented Reality Technology
Liru Chen, Ziyi Zhang, Hantao Zhao
CHI '24 Workshop: Proceedings of the HabiTech Workshop at the 2024 CHI Conference on Human Factors in Computing Systems
ARena of Privacy: Exploring Augmented Reality in Enhancing Smart Home Privacy Awareness and Control
Hantao Zhao, Xin Yi, Liru Chen, Ziyi Zhang, Wenze Ren, Xiaomeng Shi, Bo Liu, Jiuxin Cao
International Journal of Human-Computer Interaction (IJHCI)
Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Models
Shuning Zhang, Gengrui Zhang, Yibo Meng, Ziyi Zhang, Hantao Zhao, Xin Yi, Hewu Li
HAIPS '25 @ CCS: Workshop on Human Aspects of Information Privacy & Security
Cooperative and Autonomous Mapping for Heterogeneous NAVs
Ruiwen Xu, Yongtao Ou, Hanjie Yu, Ziyi Zhang, Feng Shan, Weiwei Wu, Junzhou Luo
2023 IEEE 20th International Conference on Mobile Ad Hoc and Smart Systems (MASS)
Enhancing multi-modal perception and interaction: An augmented reality visualization system for complex decision making
Liru Chen, Hantao Zhao, Chenhui Shi, Youbo Wu, Xuewen Yu, Wenze Ren, Ziyi Zhang, Xiaomeng Shi
Systems, 12(1), Article 7
[Patent] Vision-Based Gimbal Control Method for Target Striking UAVs
Ziyi Zhang, Haoyang Liu, Feng Shan
Patent Application Acceptance Number: 2023115920458
Awards
Recognition
President's Scholarship
Top 0.5% of students in the school
Outstanding Student International Exchange Scholarship
Top 1% of students in the school
RoboMaster 2024 National First Prize
23rd National University Robot Competition, sponsored by DJI
RoboMaster 2023 National Second Prize
22nd National University Robot Competition, sponsored by DJI
Software Innovation Scholarship
Top 5% of students in the school
Zhishan Scholar
Top 5% of students in the school
Innovation & Entrepreneurship Silver Award
Southeast University Innovation and Entrepreneurship Competition
Outstanding Student
Academic Excellence Award, Southeast University
Outstanding Volunteer Service Award
Service and Leadership Award
Skills
Technical toolkit
Methods and tools I use in research and working prototypes.
Research & Writing
AI & Agent Development
XR & Wearable Interaction
Web & Embedded Systems
Contact
Let's build something interesting together.
Open to research collaborations and internships.
Currently available
Open to research collaborations and internship opportunities.
Find me online