Project Details Banner

Role

Lead Researcher

Full Stack Developer

UI/UX Designer

Tools

Vue.js

Vue.js - Front-end development for a user-friendly interface.

Firebase (Cloud Firestore)

Firebase (Cloud Firestore) - Persisting user presentations.

MediaPipe

MediaPipe - Real-time hand gesture recognition.

Fingerpose

Fingerpose - Gesture classification and mapping.

GreenSock (GSAP)

GreenSock (GSAP) - High-performance animations and transitions for visual aids.

VisConductor Project

VisConductor is a tool designed to enhance remote presentations with dynamic, gesture-controlled interactions for data storytelling. By combining gesture-based controls with animated charts and visualization foreshadowing, the tool provides an immersive way for presenters to engage audiences. VisConductor allows for the seamless integration of gestures and dynamic visual aids, resulting in more engaging and interactive presentations for remote settings.

Rap Marathon Site Before

Visconductor UI

Process

  • Research & Ideation
  • User-Centered Design
    Investigated presenter and audience needs in remote settings to develop intuitive gesture-based controls for animated data storytelling.
  • Audience Analysis
    Focused on improving engagement by utilizing expressive gestures and real-time animations to highlight dynamic data.
  • Development Phase
  • Gestural Recognition
    Integrated MediaPipe and Fingerpose to map hand gestures to various functionalities, enabling control over data animations and visualizations.
  • Chart Animation Design
    Developed real-time data visualizations with animated scatterplots and bar charts controlled via gestures.
  • Testing & Evaluation
  • Presenter & Audience Studies
    Conducted user studies to evaluate VisConductor's effectiveness in live presentations, gathering insights into usability and engagement.
Rap Marathon Site Before

Visconductor App Architecture