ZZZiyi ZhangHCI Researcher

Human–Computer Interaction

Hi, I'm Ziyi Zhang

An MS student at UIUC, I design and study interactive systems that help people form and express intentions and retain agency as they work with AI.My research combines LLM agents, visualization, and immersive interaction.

Ziyi Zhang portrait

Projects

Flagship work

Research and working systems for human–AI collaboration, immersive learning, and wearable interaction.

7 projects
Starting with ChronoFork, project 1 of 7
ChronoFork

ChronoFork

Flagship
CHI '27
MAJOR REVISION

Counterfactual history role-play that helps learners test decisions and understand their consequences.

Counterfactual inquiry
Multi-actor co-roleplay
24-learner study
View Paper
Virtual Minds, Real Work

Virtual Minds, Real Work

Flagship
CHI '26

A VR workspace where embodied AI experts join in stages to clarify evolving preferences, negotiate trade-offs, and build plans with you.

VR collaboration
Embodied agents
Preference elicitation
View Paper
Halo Ring

Halo Ring

Open source

A programmable ring input layer that preserves familiar navigation across AR glasses and apps.

BLE reverse engineering
Composable gestures
Cross-device input
GitHub
ARena of Privacy

ARena of Privacy

CHI '24 Workshop
IJHCI

AR visualizations linking sensor coverage, data flows, and privacy controls for informed choices.

Situated privacy
Sensor & data-flow cues
Comparative user studies
View Paper
Constellation

Constellation

Open source

Wearable access to remote AI agents, guided by an evolving digital twin of your context, preferences, and way of working.

Remote agents
Evolving digital twin
Wearable control
GitHub
Session Grove sample workspace with five conversation branches, original transcripts, and Sankey ribbons linking each context segment to its graph node. Approved Results continues into Discussion outline and Study limitations.

Session Grove

Open source

A visual workspace for choosing the context you carry forward across coding agents and computers.

Context curation
Visual branching
Cross-agent continuity
Vision-Based UAV Gimbal Tracking

Vision-Based UAV Gimbal Tracking

IEEE MASS '23
Patent
National 1st Prize

Onboard vision and motion estimation coupled with embedded gimbal control for moving-target tracking.

Onboard perception
Motion-state estimation
Embedded control

Publications

Published work

Full Conference & Journal Papers

7

ChronoFork: Supporting Counterfactual Reasoning for History Learning through LLM-Based Multi-Agent–Learner Co-Roleplay

Ziyi Zhang, Zitong Dai, Hantao Zhao, Xin Yi, Shuning Zhang, Xueyang Wang, Yun Huang, and Dominic Kao

CHI '27: Proceedings of the 2027 CHI Conference on Human Factors in Computing Systems

2027
CHI
MAJOR REVISION

Rehearsim: LLM-Simulated Participants as Inspectable Material for Early Interview-Protocol Design

Hangyue Zhang, Qiran Hu, Ziyi Zhang, Hyanghee Park, and Yun Huang

CHI '27: Proceedings of the 2027 CHI Conference on Human Factors in Computing Systems

2027
CHI
MAJOR REVISION
PDFarXiv

Virtual Minds, Real Work: LLM-Powered Preference-Based Planning through Spatial Multi-Agent-Human Collaboration

Ziyi Zhang, Xin Yi, Zitong Dai, Xuewen Yu, Shuning Zhang, Bo Liu, Jiuxin Cao, Hantao Zhao

CHI '26: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems

2026
CHI
Human–AI Collaboration
PDFDOI

The Pervasive Blind Spot: Benchmarking VLM Inference Risks on Everyday Personal Videos

Shuning Zhang, Zhaoxin Li, Changxi Wen, Ying Ma, Simin Li, Gengrui Zhang, Ziyi Zhang, Yibo Meng, Hantao Zhao, Xin Yi, Hewu Li

IMWUT: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 10(2), Article 73

2026
Journal
Privacy
PDFDOI

ARena of Privacy: Exploring Augmented Reality in Enhancing Smart Home Privacy Awareness and Control

Hantao Zhao, Xin Yi, Liru Chen, Ziyi Zhang, Wenze Ren, Xiaomeng Shi, Bo Liu, Jiuxin Cao

IJHCI: International Journal of Human-Computer Interaction, 42(10), 6891–6920

2026
Journal
Privacy
PDFDOI

Enhancing multi-modal perception and interaction: An augmented reality visualization system for complex decision making

Liru Chen, Hantao Zhao, Chenhui Shi, Youbo Wu, Xuewen Yu, Wenze Ren, Ziyi Zhang, Xiaomeng Shi

Systems, 12(1), Article 7

2024
Journal
XR Interaction
PDFDOI

Cooperative and Autonomous Mapping for Heterogeneous NAVs

Ruiwen Xu, Yongtao Ou, Hanjie Yu, Ziyi Zhang, Feng Shan, Weiwei Wu, Junzhou Luo

IEEE MASS '23: 20th International Conference on Mobile Ad Hoc and Smart Systems

2023
Conference
Robotics
PDFDOI

Workshop Papers

2

Through Their Eyes: User Perceptions on Sensitive Attribute Inference of Social Media Videos by Visual Language Models

Shuning Zhang, Gengrui Zhang, Yibo Meng, Ziyi Zhang, Hantao Zhao, Xin Yi, Hewu Li

HAIPS '25 @ CCS: Workshop on Human-Centered AI Privacy and Security

2025
Workshop
Privacy
PDFDOI

Enhancing Privacy Awareness in Buildings through Augmented Reality Technology

Liru Chen, Ziyi Zhang, Xin Yi, Xiaomeng Shi, Hantao Zhao

CHI '24 Workshop: HabiTech: Inhabiting Buildings, Data & Technology

2024
Workshop
Privacy
PDF

Patents

2

Vision-Based Gimbal Control Method for Target Striking UAVs

Ziyi Zhang, Haoyang Liu, Yulian Pan, Feng Shan

Chinese Invention Patent · No. 202311592045.8 · CN117826873B

2023
Patent
Robotics
Patent

Memory-Constrained Micro-UAV Swarm Cooperative Autonomous Navigation System and Method

Ruiwen Xu, Ziyi Zhang, Zhidong Wang, Wenbo Wu, Chenrui Liu, Feng Shan

Chinese Invention Patent · No. 202310418759.0 · CN116499464B

2023
Patent
Robotics
Patent

Research interests

Future directions

My research centers on human intention and agency in AI collaboration. I explore how people develop and express what they want, and how interfaces help them judge, revise, and direct AI's contributions as their ideas evolve.

Creative Agency with AI

How people form, express, and revise intentions, retain creative judgment, and negotiate AI's initiative as their work develops.

Immersive & Embodied Interaction

How spatial interfaces and bodily participation shape what people notice, express, and understand across virtual and everyday environments.

Social XR & Privacy

How AI and everyday XR shape social connection and self-presentation, while letting people negotiate visibility, consent, and boundaries with others.

Visualization & Interaction Design

How interactive representations make context, reasoning, and agent coordination visible, helping people compare alternatives and steer evolving work.

About

The person behind the prototypes

I'm currently pursuing an MS in Information Management at the University of Illinois Urbana-Champaign. My path into HCI began with making privacy visible in everyday environments.

My background includes a BS in Software Engineering from Southeast University and an exchange semester in Computer Science at the University of California, Santa Barbara.

Today, I work across interaction design, system building, and empirical research. From early prototypes to formative interviews and comparative user studies, I examine how an interface helps people understand a system, make choices, and discover new possibilities through exploration and reflection.

Location

Open to collaboration

Champaign, IL

Focus

HCICreative agencyImmersive interaction

Keywords

Human intentionHuman agencyEmbodied interactionMixed methodsPrototyping

Outside research

AnimeOpen-source tinkeringVisual storytelling

Awards

Selected Awards

Skills

Methods & Tools

Methods and tools I use in research and working prototypes.

Research & Writing

User study designQuantitative & qualitative methodsThematic analysisAcademic writing

AI & Agent Development

Multi-agent orchestrationPrompt & context designCodex & Claude CodeLangChain & Agent SDK

XR & Wearable Interaction

Unity & C#Kotlin & Jetpack ComposeMultimodal interactionBLE reverse engineering

Web & Embedded Systems

React / Next.js / TypeScriptPython / FastAPI / WebSocketsC / C++ & STM32

Contact

Let's build something interesting together.

Open to research collaborations and internships.

Your message

Phone

217-530-7176

Location

Champaign, IL, USA

Currently available

Open to research collaborations and internship opportunities.