Yunxiang Zhang

Welcome! I am a Computer Science Ph.D. student at NYU, advised by Prof. Qi Sun in the Immersive Computing Lab. My current research revolves around virtual/augmented/mixed reality, human-computer interaction, perceptual computer graphics, and machine learning, with a particular focus on AI-powered multimodal interaction experiences and human-AI co-creation systems. More broadly, I enjoy combining knowledge and insights from human perception and human-computer interaction research with machine learning tools to solve challenging real-world problems.

Prior to NYU, I obtained my M.Phil in the Multimedia Laboratory at CUHK under the supervision of Prof. Dahua Lin. Before that, I did my undergraduate studies at SJTU and École Polytechnique.

During my graduate studies, I have had the fortune to work with and learn from great minds at Intel Corporation, Vector Institute, and Télécom Paris through internships.

Outside of work, I love hiking, traveling, and photography!

Email  /  CV  /  Google Scholar  /  LinkedIn  /  Twitter  /  GitHub

profile photo
Updates
  • Aug 2024: Our work on visual-attention-controllable image generation got accepted to TAP and won Best Paper Award, Best Presentation Award at SAP 2024!

  • Jul 2024: Two papers, one on force-aware VR interface and one on user-centric multimodal interative virtual agent got accepted to ISMAR 2024, see you in Seattle!

  • Jun 2024: Our work on human visual-auditory perception & performance got accepted to TVCG!

  • May 2024: Our work on accelerating human saccadic response got accepted to SIGGRAPH 2024, see you in Denver!

  • Apr 2024: I received the 2024 Deborah Rosenthal MD Award at NYU Tandon.

  • Publications

    fast-texture GazeFusion: Saliency-guided Image Generation
    Yunxiang Zhang, Nan Wu, Connor Lin, Gordon Wetzstein, Qi Sun
    ACM Transactions on Applied Perception (ACM SAP 2024)
    Best Paper Award   Best Presentation Award
    Paper / Project Page / Video / Code
    fast-texture Measuring and Predicting Multisensory Reaction Latency: A Probabilistic Model for Visual-Auditory Integration
    Xi Peng, Yunxiang Zhang, Daniel Jiménez Navarro, Ana Serrano, Karol Myszkowski, Qi Sun
    IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG 2024)
    Paper / Project Page / Video
    fast-texture May the Force Be with You: Dexterous Finger Force-Aware VR Interface
    Fengze Zhang*, Yunxiang Zhang*, Xi Peng, Sky Achitoff, Paul M. Torrens, Qi Sun
    IEEE International Symposium on Mixed and Augmented Reality (IEEE ISMAR 2024)
    Paper / Project Page / Code
    fast-texture Toward User-Aware Interactive Virtual Agents: Generative Multi-Modal Avatar Behaviors in VR
    Bhasura Gunawardhana, Yunxiang Zhang, Qi Sun, Zhigang Deng
    IEEE International Symposium on Mixed and Augmented Reality (IEEE ISMAR 2024)
    Paper / Project Page
    fast-texture Accelerating Saccadic Response through Spatial and Temporal Cross-Modal Misalignments
    Daniel Jiménez Navarro, Xi Peng, Yunxiang Zhang, Karol Myszkowski, Hans-Peter Seidel, Qi Sun, Ana Serrano
    ACM SIGGRAPH 2024
    Paper / Project Page
    fast-texture Toward Optimized VR/AR Ergonomics: Modeling and Predicting User Neck Muscle Contraction
    Yunxiang Zhang, Kenneth Chen, Qi Sun
    ACM SIGGRAPH 2023
    Paper / Project Page / Video / Code
    fast-texture Force-Aware Interface via Electromyography for Natural VR/AR Interaction
    Yunxiang Zhang, Benjamin Liang, Boyuan Chen, Paul M. Torrens, S. Farokh Atashzar, Dahua Lin, Qi Sun
    ACM Transactions on Graphics (ACM SIGGRAPH Asia 2022)
    Paper / Project Page / Video / Code
    fast-texture Exploiting Channel Similarity for Network Pruning
    Chenglong Zhao, Yunxiang Zhang, Bingbing Ni
    IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT 2023)
    Paper
    fast-texture CaPC Learning: Confidential and Private Collaborative Learning
    Christopher A. Choquette-Choo*, Natalie Dullerud*, Adam Dziedzic*, Yunxiang Zhang*, Somesh Jha, Nicolas Papernot, Xiao Wang
    International Conference on Learning Representations (ICLR 2021)
    Paper / Project Page / Video / Code
    fast-texture Max-plus Operators Applied to Filter Selection and Model Pruning in Neural Networks
    Yunxiang Zhang, Samy Blusseau, Santiago Velasco-Forero, Isabelle Bloch, Jesus Angulo
    International Symposium on Mathematical Morphology and Its Application to Signal and Image Processing (ISMM 2019)
    Paper / Code
    * Equal contributions, authors ordered alphabetically

    Work Experience
    Research Intern at Graphics Research, Intel Corporation May 2023 - Aug 2023

    Research Intern at Vector Institute Mar 2020 - Jun 2020

    Research Intern at Télécom Paris Apr 2018 - Aug 2018

    Academic Services
    Conference Reviewer: SIGGRAPH, SIGGRAPH Asia, TVCG, AAAI, IEEE VR, ISMAR, PG, JPI



    Template borrowed from Jon Barron