University of Southern California


Research

IMSC Research

3D Modeling

3D Hand and Fingers Reconstruction
Animation of Cloth-like Objects in Virtual Reality
Binocular and Multiple View Stereo Using Tensor Voting
Data-Driven Face Modeling and Animation
Digital Geometry Processing
ESP - Expression Synthesis Project
Facial Expression Analysis and Synthesis
Hair Modeling and Animation
Model-Based Face Computation


3D Stereoscopic

3D Stereoscopic Video Acquisition, Display, Transmission and Interaction


Audio

Immersive Audio Rendering Algorithms
Virtual Microphones


Augmented Reality/Virtual Reality

Augmented Virtual Environments: Virtual Campus


Data Management

Geospatial Data Integration
i4: Immersive, Interactive, Individualized Information
IMMERSIDATA Management (VIEW-AIMS)
Information Management for Multimedia Earthquake Science Data
Progressive OLAP (POLAP) (Changing Regions)
Semantic Information Representation and Ontologies
UDN: User Directed News


Haptics

Distributed Haptic Environments
Haptic Sculpting and Painting
Minimally Invasive Cyber Touch System
Recognizing User State from Haptic Data


Interactive Education

BioSIGHT Content and Interaction
BioSIGHT Interactive Streaming Storyboard
Financial Simulator
MediaBASE


Music Processing

Content-based Representations, Indexing and Retrieval of Music
Giving Ragas the Time of Day: Pitch Structures in North Indian Classical Music
MuSA: Music Information Processing
MuSA.RT
Palestrina Pal: A Grammar Checker for Music Compositions in the Style of Palestrina
PST - Pitch Spelling Technology
VoSA - Voice Separation Analyzer


Panoramic Video

Panoramic 360-Degree Video Application Design, Development and Evaluation


Software Architecture

SAI


Speech

Automatic Recognition of Emotions from the Acoustic Speech Signal
Compression for Speech Recognition and Music Classification
ChIMP
Expressive Speech Synthesis and Modeling
Hierarchical Speech Recognition
Implicit Pronunciation Modeling for Speech Recognition Using Syllable-Centric Models
On-Line Speaker Indexing


Streaming

Distributed Immersive Performance
High Speed Immersive Media Stream Recorder
Network Stream Reliability and Synchronization
New Compression Techniques for Content-based Retrieval
New Compression Techniques for Robust and Scalable Media Communications
Peer-to-Peer Streaming (Kerena)
Progressive Transmission of Textured Graphic Model Over IP Networks Remote Media Immersion
Video Streaming Over the Internet
Yima: A Second Generation of Continuous Media Servers


Tracking

Body Gesture Tracking, Representation and Analysis: Implications for HCI, Human Motor Functions & Virtual Human Action
Human Body Tracking with Shape Estimation and Auxiliary Measurements
Human Upper Body Pose Estimation in Static Images
Inference of Human Postures by Classification of 3D Human Body Shape
Perceptual Grouping from Motion Cues Using Tensor Voting
Real-time Face Detection from One Camera
Tracking and Visualization
Tracking for Augmented Reality
Video Surveillance and Activity Monitoring


User Centered Sciences

Virtual Classroom (Virtual Environments for Human Performance Testing and Training)


Video Processing

Error Resilience Analysis of Multi-Hypothesis Motion Compensated Prediction for Video Coding


Wireless

Chôjô
Ultra Wideband Wireless Systems
Collection 1 IMSC Collection 1 Quicktime
WinMedia
Collection 2 IMSC Collection 2 Quicktime
WinMedia


Demo Highlights

Language Translation
Language Translation
quicktime | winmedia
more info
Communication Tool of Tomorrow
Communication Tool of Tomorrow
quicktime | winmedia
dip
Distributed Immersive Performance
Video 1
quicktime | winmedia
Video 2
quicktime | winmedia

more info
Remote Media Immersion
quicktime
more info
Virtual Mike
Virtual Microphone
quicktime | winmedia
more info
Virtual Classroom
Virtual Classroom
quicktime | winmedia
more info
BioSight
BioSIGHT ISS
quicktime | winmedia
more info
Tracking
Human Posture Recognition
quicktime | winmedia
more info
MuSA
MuSA: Music Visualization Using the Spiral Array
quicktime | winmedia
more info
Gesture Control
Video Interaction Enhancement
Video 1
quicktime | winmedia
Video 2
quicktime | winmedia

more info
Gesture Control
The PANAquarium Project
quicktime
3d visualization of the project
quicktime

more info
Video Extraction System
Video Extraction System
quicktime | winmedia
more info
Augmented Virtual Environments
Augmented Virtual Environments:
Virtual Campus
quicktime | winmedia
more info
Immersive Audio
Immersive Audio
quicktime | winmedia
more info
Interactive Hair
Interactive Hair
quicktime | winmedia
more info
Mutual Touch
Haptic Collaboration Over the Internet
quicktime | winmedia
more info
Aerial Motion Tracking
Aerial Motion Tracking
mpg #1 | mpg #2
more info
Data Tag Learning
Data Tag Learning
quicktime
Virtual Mirror
Virtual Mirror
quicktime | winmedia
more info
Augmented Reality
Augmented Reality
real video
more info
GlobeAll Vision System
GlobeAll Vision System
quicktime | winmedia
more info
Java support is required for panoramic images. 
Panoramic Video
Overview
quicktime
Panoramic Driving
quicktime
Duran Duran
winmedia
more info
Facial Expression Animation
Facial Expression Animation
quicktime
more info
Animation of cloth
win media
more info