Difference between revisions of "Movement Capture"

From BlackBox
Jump to navigation Jump to search
(Motion capture in the BlackBox)
(Choosing the right system)
Line 2: Line 2:
 
There are currently two major systems for movement capture and recognition in the Blackbox: The Vicon system and the Kinect. There are also a set of accelerometers that you can use.
 
There are currently two major systems for movement capture and recognition in the Blackbox: The Vicon system and the Kinect. There are also a set of accelerometers that you can use.
  
== Choosing the right system ==
+
__NOTOC__
Before you begin capturing motion data, you should choose which motion capture system to use. Your choice will depend on several different factors.
 
===What kind of movement do you need to capture?===
 
What kind of movement do you need to capture? Consider the following:
 
* Are you capturing movements of the '''entire body''' or only '''some body parts''' (face, hand, arms, fingers, torso, legs)?
 
* Is the entire body going to be moving through a large volume of space (greater than about 5 feet by 5 feet)  (e.g., walking, running, many forms of dancing) or will the body stay more or less in one spot (within a space of about 5 feet by 5 feet)?
 
*
 
  
===What type of sensor is best?===
+
{| style="border-color: rgb(136, 136, 136); border-width: 1px; border-collapse: collapse" border="1"
what kinds of sensors best fit the motion phenomena you wish to capture. Motion capture systems use different kinds of sensors. To find out which type of sensor best suits your application, see the section on [[White_Paper:_Sensor_Selection|Sensor Selection]]. In general:  
+
| <br />
 +
| Kinect [Microsoft SDK]
 +
| Vicon
 +
| Effort Detect
 +
|
 +
|
 +
|
 +
|-
 +
| rowspan="1" colspan="7" |
 +
===What kind of movement do you need to capture?===
 +
What kind of movement do you need to capture? Consider the following.
 +
|-
 +
| Do you need to identify individual body parts or is it sufficient to treat the body as a blob?
 +
|
 +
| You could use the Vicon for this, but it's an impractical solution
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Are you capturing movements of the '''entire body''' or only '''some body parts''' (face, hand, arms, fingers, torso, legs)? <br />
 +
|
 +
| Yes
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Is the entire body going to be moving through a large volume of space (greater than about 5 feet by 5 feet) (e.g., walking, running, many forms of dancing) or will the body stay more or less in one spot (within a space of about 5 feet by 5 feet)? <br />
 +
|
 +
| Yes
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
Are you going to be tracking movement in the transverse plane of the body, such as<br />
 +
* supination and pronation of the legs or arms?
 +
* left or right rotation of the head?
 +
* twisting of the spine?
 +
|
 +
| Yes
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Do you need to track movements of the separate parts of the torso (the cervical, lumbar, thoracic, and sacral areas)? <br />
 +
| If you don't need to track precise movements of the parts of the torso, the Kinect is fine.
 +
| Yes
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Will the mover be changing their frontal orientation (e.g., by turning around or spinning) <br />
 +
|
 +
| Yes
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Do you need to track both large movements (e.g., lunging, jumping, turning around) <span>'''and'''</span> small gestures (e.g., foot tapping, fingers drumming, head slightly tilting)?
 +
|
 +
| Yes
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| rowspan="1" colspan="7" |
 +
=== <span>What type of sensor is best?</span> ===
 +
|-
 +
|
 +
What kinds of sensors best fit the motion phenomena you wish to capture. Motion capture systems use different kinds of sensors. To find out which type of sensor best suits your application, see the section on [http://wiki.iat.sfu.ca/BlackBox/index.php/White_Paper:_Sensor_Selection Sensor Selection]. In general:
 
* Low-frequency movement is best captured using measurements of position (the Vicon or the Kinect will be your best)
 
* Low-frequency movement is best captured using measurements of position (the Vicon or the Kinect will be your best)
* Intermediate-frequency movement is best captured using measurements of velocity  
+
* Intermediate-frequency movement is best captured using measurements of velocity
* High-frequency movement is best captured using measurements of acceleration (accelerometers will be appropriate)
+
* High-frequency movement is best captured using measurements of acceleration (accelerometers will be appropriate) Generally, human movement tends to be slow enougho that intermediate
 
+
|
===Do you need to p
+
|
 
+
|
There are several considerations that you'll have to ta
+
|
Capture volume. Full-body versus gestural versus face tracking.
+
|
 
+
|
===Do you need to process the movement data in real-time?===
+
|-
 +
| rowspan="1" colspan="6" |
 +
=== <span>Do you need to process the movement data in real-time?</span> ===
 +
|
 +
|-
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
=== How much time do you have? ===
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|}
  
 
== The systems ==
 
== The systems ==

Revision as of 02:35, 23 November 2011

Motion capture in the BlackBox

There are currently two major systems for movement capture and recognition in the Blackbox: The Vicon system and the Kinect. There are also a set of accelerometers that you can use.



Kinect [Microsoft SDK] Vicon Effort Detect

What kind of movement do you need to capture?

What kind of movement do you need to capture? Consider the following.

Do you need to identify individual body parts or is it sufficient to treat the body as a blob? You could use the Vicon for this, but it's an impractical solution
Are you capturing movements of the entire body or only some body parts (face, hand, arms, fingers, torso, legs)?
Yes
Is the entire body going to be moving through a large volume of space (greater than about 5 feet by 5 feet) (e.g., walking, running, many forms of dancing) or will the body stay more or less in one spot (within a space of about 5 feet by 5 feet)?
Yes

Are you going to be tracking movement in the transverse plane of the body, such as

  • supination and pronation of the legs or arms?
  • left or right rotation of the head?
  • twisting of the spine?
Yes
Do you need to track movements of the separate parts of the torso (the cervical, lumbar, thoracic, and sacral areas)?
If you don't need to track precise movements of the parts of the torso, the Kinect is fine. Yes
Will the mover be changing their frontal orientation (e.g., by turning around or spinning)
Yes
Do you need to track both large movements (e.g., lunging, jumping, turning around) and small gestures (e.g., foot tapping, fingers drumming, head slightly tilting)? Yes

What type of sensor is best?

What kinds of sensors best fit the motion phenomena you wish to capture. Motion capture systems use different kinds of sensors. To find out which type of sensor best suits your application, see the section on Sensor Selection. In general:

  • Low-frequency movement is best captured using measurements of position (the Vicon or the Kinect will be your best)
  • Intermediate-frequency movement is best captured using measurements of velocity
  • High-frequency movement is best captured using measurements of acceleration (accelerometers will be appropriate) Generally, human movement tends to be slow enougho that intermediate

Do you need to process the movement data in real-time?

How much time do you have?

The systems

Movement recognition in the Blackbox

TODO

  • a summary of what the section is about

EffortDetect

TODO

HuMoS: An integrated approach to sharing movement data

HuMoS