Depth map and 3D imaging applications: Algorithms and technologies

Malik, Aamir Saeed and Choi, Tae-Sun and Nisar, Humaira (2012) Depth map and 3D imaging applications: Algorithms and technologies. In: Depth Map and 3D Imaging Applications: Algorithms and Technologies. Information Science Reference (an imprint of IGI Global).

[thumbnail of depth_Map_and_3D_imaging_application_algorithms_and_technologies_book_chapter---.pdf] PDF
depth_Map_and_3D_imaging_application_algorithms_and_technologies_book_chapter---.pdf - Published Version
Restricted to Registered users only

Download (31kB)


We present an approach of how to recover 3D human body postures from depth maps captured by a stereo camera and an application of this approach to recognize human activities with the joint angles derived from the recovered body postures. With a pair of images captured with a stereo camera, first a depth map is computed to get the 3D information (i.e., 3D data) of a human subject. Separately the human body is modeled in 3D with a set of connected ellipsoids and their joints: the joint is parameterized
with the kinematic angles. Then the 3D body model and 3D data are co-registered with our devised algorithm that works in two steps: the first step assigns the labels of body parts to each point of the 3D data; the second step computes the kinematic angles to fit the 3D human model to the labeled 3D data. The co-registration algorithm is iterated until it converges to a stable 3D body model that matches the 3D human posture reflected in the 3D data. We present our demonstrative results of recovering body postures in full 3D from continuous video frames of various activities with an error of about 60-140 in the estimated kinematic angles. Our technique requires neither markers attached to the human subject nor multiple cameras: it only requires a single stereo camera. As an application of our body posture
recovery technique in 3D, we present how various human activities can be recognized with the body joint angles derived from the recovered body postures. The features of body joints angles are utilized over the conventional binary body silhouettes and Hidden Markov Models are utilized to model and recognize various human activities. Our experimental results show the presented techniques outperform the conventional human activity recognition techniques.

Item Type: Book Section
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering
Departments / MOR / COE: Centre of Excellence > Center for Intelligent Signal and Imaging Research
Departments > Electrical & Electronic Engineering
Research Institutes > Institute for Health Analytics
Depositing User: Dr Aamir Saeed Malik
Date Deposited: 22 Nov 2012 02:56
Last Modified: 19 Jan 2017 08:21

Actions (login required)

View Item
View Item