Main areas of research:
- Interactive and multimedia storytelling
- 3D graphics and animations, extended (virtual and augmented) reality
- Accessible media for low vision
- Study and modelling of attention and emotion in visual media
Projects
- ANR CREATTIVE3D ➚ (2022-2026) -- Coordinator
- ANR TRACTIVE ➚ (2022-2026) -- Partner leader (Inria), coordinated by Lucile Sassatelli, CNRS I3S Laboratory
- ANR DEVISE ➚ (2021-2025) -- Member, coordinated by Éric Castet, Aix-Marseille University
- XR2C2 (Multidisciplinary Center for Research and Creation on eXtended Reality) ➚ (2020 -) -- Member, regroups 13 laboratories of Université Côte d'Azur
Visitors and Students
PhD Students
- Julie Tores (2022-current) -- co-supervised with Lucile Sassatelli and Frédéric Précioso
- Franz Franco Gallo (2022-current) -- co-supervised with Lucile Sassatelli
- Johanna Delachambre (2022-current) -- co-supervised with Pierre Kornprobst
- Clément Quéré (2022-current) -- co-supervised with Marco Winckler and Aline Menin
- Florent Robert (2021-current) -- co-supervised with Marco Winckler and Lucile Sassatelli
Services
Event committees
- Associate chair, 2023 ACM Interactive Media Experiences (IMX), Nantes, France.
- Co-chair, 2023 ACM IMX Joint WICED x Cinemotions Workshop, Nantes, France.
- Co-chair, 2022 10th EG Workshop on Intelligent Cinematography and Editing, Reims, France.
- Co-organizer, 2020 9th Eurographics Workshop on Intelligent Cinematography and Editing, Norrköping, Sweden (virtual event)
- Co-chair, 2019 8th EG Workshop on Intelligent Cinematography and Editing, Genoa, Italy.
- Co-chair, AIIDE 2018 Joint INT/WICED Workshop. Edmonton, Canada.
- Poster chair, International Symposium on Smart Graphics, 2014, Taiwan
Reviewer
- [Journal] Transactions on Graphics (ACM), 2022
- [Journal] International Journal of Human Computer Interaction (Taylor and Francis), 2023
- [Journal] Computers & Graphics (Elsevier), 2020, 2021, 2022
- [Journal] Computers Animations and Virtual Worlds (Wiley), 2022, 2023
- [Journal] Multimedia Tools and Applications (Springer), 2016, 2019, 2020, 2021, 2023
- [Software] ACM Multimedia Open Source Software Competition, 2020
- [PC] ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 2024
- [PC] IFIP INTERACT conference, 2023
- [PC] International Conference on Interactive Digital Storytelling (ICIDS), 2020, 2021, 2022
- [PC] IEEE Conference on Games (CoG), 2019, 2020
- [Software] AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE 2018) — Artifacts evaluation, 2018
- [Subreviewer] SIGCHI Late-breaking papers, 2016
- [Subreviewer] Foundations in Digital Games, 2014
- [Subreviewer] 26th Int. Conf. Computer Animation and Social Agents (CASA), 2013
Publications
[NEW] F. Gallo, H.-Y. Wu, and L. Sassatelli. 2024.09, “DiVR: incorporating context from diverse VR scene for human trajectory prediction”. 2024 ECCV Workshop on Computer vision for metaverse (CV4Metaverse), Milan, Italy.[NEW] F. Gallo, H.-Y. Wu, and L. Sassatelli. 2024.09, “Cross-Modal Knowledge Distillation for Human Trajectory Prediction in Virtual Reality”. 2024 ECCV Workshop on Computer vision for metaverse (CV4Metaverse), Milan, Italy. (extended abstract)
[NEW] J. Delachambre, H.-Y. Wu, S. Vizcay, M. Di Meo, F. Lagniez, C. Morfin-Bourlat, S. Baillif, and P. Kornprobst. 2024.06, “ AMD Journee: A Patient Co-designed VR Experience to Raise Awareness Towards the Impact of AMD on Social Interactions”. ACM IMX 2024, Stockholm, Sweden. [HAL]
[NEW] F. Gallo, H.-Y. Wu, and L. Sassatelli. 2024.04, “Human Trajectory Forecasting in 3D Environments: Navigating Complexity under Low Vision”. 2024 MMSys Workshop on IMmersive Mixed and Virtual Environment Systems (MMVE), Bari, Italy. [HAL] [DOI]
[NEW] J. Tores, L. Sassatelli, H.-Y. Wu, C. Bergman, L. Andolfi, V. Ecrement, F. Precioso, T. Devars, M. Guaresi, V. Julliard, S. Lecossais. 2024.06, “Visual Objectification in Films: Towards a New AI Task for Video Interpretation”. CVPR 2024, Seattle, Washington. (accepted) [ARXIV]
[NEW] F. Robert, H.-Y. Wu, L. Sassatelli, and M. Winckler. 2024.03, “Task-based methodology to characterise immersive user experience with multivariate data”. IEEE VR 2024, Orlando, Florida. [HAL] [DOI]
[NEW] C. Quéré, A. Menin, R. Julien, H.-Y. Wu, and M. Winckler. 2024.03, “HandyNotes: using the hands to create semantic representations of contextually aware real-world objects”. IEEE VR 2024, Orlando, Florida. [HAL]
J. Delachambre, M. Di Meo, F. Lagniez, C. Morfin-Bourlat, S. Baillif, H.-Y. Wu, and P. Kornprobst. 2023.10, “À travers les yeux d'un patient malvoyant : une expérience de sensibilisation axée sur les interactions sociales en réalité virtuelle”. 2023 - Journée Scientifique de la Fedrha sur le thème “Handicap visuel et participation sociale : les apports de la recherche”. Lyon, France. (French, abstract only) [HAL]
K. Pirkovets, C. Merveille, F. Robert, V. Gagliano, S. Ramanoël, A. Gros, and H.-Y. Wu, 2023.06, “Analyzing Gaze Behaviors in Interactive VR Scenes”. 2023 Annual meeting of the Neuromod Institute, Antibes, France. (Poster) [HAL]
F. Robert, H.-Y. Wu, L. Sassatelli, S. Ramanoël, A. Gros, and M. Winckler, 2023.06, “An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality”. Proceedings of 2023 ACM Conference on Interactive Media Experiences (IMX), Nantes, France. (Best paper award) [HAL] [DOI] [CODE]
F. Robert, Q. Guimard, C. Bauce, A. Ducreux, L. Sassatelli, H.-Y. Wu, M. Winckler, and A. Gros, 2022.06, “PEM360: A dataset of 360° videos with continuous physiological measurements, subjective emotional ratings and motion traces”. Proceedings of 2023 ACM IMX Joint Workshop on "Intelligent Cinematography and Editing (WICED)" and "Emotions in Movies (Cinemotions)". [PDF] [CODE]
Q. Guimard, F. Robert, C. Bauce, A. Ducreux, L. Sassatelli, H.-Y. Wu, M. Winckler, and A. Gros, 2022.10, “On the Link between Emotion, Attention and Content in Virtual Immersive Environments”. 29th IEEE International Conference on Image Processing (ICIP). Bordeaux, France. [HAL] [DOI] [CODE]
H.-Y. Wu, A. Calabrèse, and P. Kornprobst, 2022.07, “An Open Virtual Reality Toolbox for Accessible News Reading”. ERCIM News, Issue 130, pp. 13-15, ERCIM. [HAL] [CODE]
É. Castet, J. Termoz-Masson, J. Delachambre, C. Hugon, H.-Y. Wu and P. Kornprobst, 2022.08, “PTVR : a user-friendly open-source script programming package to create Virtual Reality experiments”. European Conference on Visual Perception 2022. Nijmegen, Netherlands. [HAL]
Q. Guimard, F. Robert, C. Bauce, A. Ducreux, L. Sassatelli, H.-Y. Wu, M. Winckler, and A. Gros, 2022.06, “PEM360: A dataset of 360° videos with continuous physiological measurements, subjective emotional ratings and motion traces”. ACM International Conference on Multimedia Systems (MMSys), Open Dataset and Software track, Athlone, Ireland. [HAL] [DOI] [CODE]
F. Robert, H.-Y. Wu, L. Sassatelli, and M. Winckler, 2022.06, “Analyzing and understanding embodied interactions in virtual reality systems: research proposal”. ACM 13th International Conference on Multimedia Systems (MMSys), Doctoral Consortium track, pp. 362-366, Athlone, Ireland. [DOI]
H.-Y. Wu, L. Nguyen, Y. Tabei, and L. Sassatelli., 2022.04, “Evaluation of deep pose detectors for automatic analysis of film style”. 10th Eurographics Workshop on Intelligent Cinematography and Editing. Eurographics Digital Library. Reims, France. [HAL] [DOI]
H.-Y. Wu, F. Robert, T. Fafet, B. Graulier, B. Passin-Cauneau, L. Sassatelli, and M. Winckler, 2022, “Designing Guided User Tasks in VR Embodied Experiences”. Proceedings of ACM on Human-Computer Interactions. Vol.6, No. EICS, Article 158. [HAL] [DOI] [CODE]
H.-Y. Wu, J. Delachambre, M. Winckler, and L. Sassatelli, 2021.12, “Through the Eyes of Women in Engineering”. M. Reyes, J. Pope (Eds). Texts of Discomfort -- Interactive Storytelling Art. Carnegie Mellon University, ETC Press. Pittsburgh, PA. [HAL] [DOI]
F. Robert, H.-Y. Wu, L. Sassatelli, and M. Winckler, 2021.11, “Création de jeux sérieux à l’aide d’un langage dédié pour des expériences incarnées en réalité virtuelle”. Les journées Françaises de l’Informatique Graphique. Biot, France. [HAL]
H.-Y. Wu, A. Calabrèse, and P. Kornprobst, 2021, “Towards Accessible News Reading Design in Virtual Reality for Low Vision” Multimedia Tools and Applications, Springer. [HAL] [DOI] [SharedIt]
H.-Y. Wu, J. Delachambre, M. Winckler, and L. Sassatelli, 2020.11, “Through the Eyes of Women in Engineering”. International Conference on Interactive Digital Entertainment (ICIDS 2020), Bournemouth, UK (online virtual event). Art exhibit. [VIDEO]
H.-Y. Wu, T. Santarra, M. Leece, R. Vargas, and A. Jhala, 2020.06, “Joint Attention for Automated Video Editing”. ACM Interactive Media Experiences (IMX/TVX 2020), Barcelona, Spain (online virtual event). [HAL] [DOI]
Q.-J. Wu, C.-H. Kuo, H.-Y. Wu, and T.-Y. Li, 2020.05. “Designing an Adaptive Assistive Interface for Learning Virtual Filmmaking” In Proceedings of Eurographics/Eurovis Workshop on Intelligent Cinematography and Editing, Norrköping, Sweden (online virtual event). [HAL] [DOI]
H.-Y. Wu and P. Kornprobst, 2019.07, “Multilayered Analysis of Newspaper Structure and Design”. [Research Report] RR-9281, UCA, Inria. 2019. (hal-02177784) [HAL]
H.-Y. Wu and A. Jhala, 2018.11, “A Joint Attention Model for Automated Editing” AIIDE 2018 Joint INT/WICED Workshop, Edmonton, Canada. [CEUR-WS]
A. Althagafi, H.-Y. Wu, and A. Jhala, 2018.11 “MIDB: A Web-Based Film Annotation Tool” AIIDE 2018 Joint INT/WICED Workshop, Edmonton, Canada. [CEUR-WS]
H.-Y. Wu, F. Palù, R. Ranon, and M. Christie, 2018.10, “Thinking Like a Director : Film Editing Patterns for Virtual Cinematographic Storytelling” ACM Transactions on Multimedia Computing, Communications, and Applications. 14(4), New York, NY, USA. [HAL] [DOI]
I.-S. Lin, T.-Y. Li, H.-Y. Wu, and M. Christie, 2017.10, “A Virtual Film Set for Cinematography Practice” Proceedings of Pacific Graphics 2017, Taipei, Taiwan. (Poster)
I.-S. Liu, T.-Y. Li, M. Christie, and H.-Y. Wu, 2017.06, “Design of an Intelligent Navigation System for Participative Computer Animation” Proceedings of Computer Graphics Workshop 2017, Taichung, Taiwan.
I.-S. Lin, T.-Y. Li, M. Christie, and H.-Y. Wu, 2017.06, “Practicing Cinematography in a Virtual Film-Making Studio” Proceedings of Computer Graphics Workshop 2017, Taichung, Taiwan.
H.-Y. Wu, Tsai-Yen Li, and M. Christie, 2017.04, “Using ECPs for Interactive Applications in Virtual Cinematography” Proceedings of 6th Eurographics Workshop in Cinematography and Editing, Lyon, France.
H.-Y. Wu, Q. Galvane, C. Lino, and M. Christie, 2017.04, “Analyzing Elements of Style in Annotated Film Clips” Proceedings of 6th Eurographics Workshop in Cinematography and Editing, Lyon, France. [HAL] [DOI] [CODE]
H.-Y. Wu, R.M. Young, and M. Christie, 2016.10, “A Cognitive-Based Model of Flashbacks for Computational Narratives” Proceedings of Twelfth Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE2016), Berlingame, USA. [HAL] [AAAI]
H.-Y. Wu and M. Christie, 2016.07, “Using Montage Patterns for Smart Cinematographic Editing” Proceedings of TAICHI2016, Taipei, Taiwan. (poster)
J. Wang, H.-Y. Wu, Q. Galvane, T.-Y. Li, and M. Christie, 2016.07, “Design of an Intelligent Camera Editing System for Computer Animation” Proceedings of Computer Graphics Workshop 2016, Taipei, Taiwan.
H.-Y. Wu and M. Christie, 2016.06, “Detecting Cinematographic Patterns” Conference on Cognitive Science and Moving Images 2016 (SCSMI2016), Ithaca, USA. (abstract proceedings)
H.-Y. Wu and M. Christie, 2016.05, “Analysing Cinematography with Embedded Constrained Patterns” 5th Eurographics Workshop on Cinematography and Editing, Lisbon, Portugal.
H.-Y. Wu, T.-Y. Li, and M. Christie, 2015.08, “Logic Control for Story Graphs in 3D Game Narratives” Proceedings of 13th International Symposium on Smart Graphics, Springer LNCS, Chengdu, China. [HAL] [PDF]
H.-Y. Wu and M. Christie, 2015.06, “Placing Invisible Cameras: Conversation Between Cognitive Science and Automated Virtual Cinematography” Conference on Cognitive Science and Moving Images 2015 (SCSMI2015), London, UK. (abstract proceedings)
H.-Y. Wu and M. Christie, 2015.05, “Stylistic Patterns for Generating Cinematographic Sequences” Proceedings of 4th Eurographics Workshop on Cinematography and Editing, Zurich, Switzerland.
B. Merabti, H.-Y. Wu, C. Sanokho, Q. Galvane, and M. Christie, 2015.05, “Insight: An annotation tool and format targeted towards film analysis” Proceedings of 4th Eurographics Workshop on Cinematography and Editing, Zurich, Switzerland. (Poster)
H.-Y. Wu, P.-M. Chen, C.-H. Chen, W.-H. Liao, and T.-Y. Li, 2014.12, “Logging and Analyzing Long-Term Mobile User Behavior,” International Journal of Electronic Commerce Studies (IJECS), Vol 5(2), Taipei. [PDF]
P.-C. Lai, H.-Y. Wu, C. Sanokho, M. Christie, and T.-Y. Li, 2014.08, “A Pattern-based Tool for Creating Virtual Cinematography in Interactive Storytelling” Proceedings of 12th International Symposium on Smart Graphics, Springer LNCS, Taipei, Taiwan.
P.-C. Lai, H.-Y. Wu, C. Sanokho, M. Christie, and T.-Y. Li, 2014.07, “A Pattern-based Discourse Structure for Virtual Cinematography” Proceedings of Computer Graphics Forum 2014, Taipei, Taiwan. (Best Paper Award)
H.-Y. Wu, M. Christie, and T.-Y. Li, 2013.11, “Shaping Interactive Stories in 3D Environments” Proceedings of ACM SIGGRAPH conference on Motion in Games 2013, Dublin. (Poster)
H.-Y. Wu, M. Christie, and T.-Y. Li, 2013.05, “Stories Animated: A Framework for Personalized Interactive Narratives using Filtering of Story Characteristics,” The 26th International Conference on Computer Animation and Social Agents (CASA 2013), Istanbul. [PDF]
T.-R. Chuang and H.-Y. Wu, 2012.09, “Structure-Conforming XML Document Transformation Based on Graph Homomorphism,” Proceedings of the 2012 ACM Symposium on Document Engineering (DocEng 2012), Paris. [PDF]
P.-M. Chen, H.-Y. Wu, C.-H. Chen, W.-H. Liao, and T.-Y. Li, 2012.02, “Logging and Analyzing Mobile User Behavior,” Proceedings of International Symposium on Cyber Behavior 2012 (CB2012), Taipei.