Difference between revisions of "EffortDetect"
(→LMA Recognition) |
(→LMA Recognition) |
||
Line 5: | Line 5: | ||
== Using acceleration-based sensors == | == Using acceleration-based sensors == | ||
Movement recognition using accelerometers is a research area among some of the partners of this research proposal. LMA recognition of has been applied to touch-based interfaces in interactive art (T. Schiphorst, Lovell, & Jaffe, 2002). A prototype for recognizing developed by the Institute for Advanced Computing Applications and Technologies at the University of Illinois and the University of Illinois Dance Department, with the expertise of movement analyst Sarah Hook from the Dance Department, and in collaboration with Dr. Thecla Schiphorst. | Movement recognition using accelerometers is a research area among some of the partners of this research proposal. LMA recognition of has been applied to touch-based interfaces in interactive art (T. Schiphorst, Lovell, & Jaffe, 2002). A prototype for recognizing developed by the Institute for Advanced Computing Applications and Technologies at the University of Illinois and the University of Illinois Dance Department, with the expertise of movement analyst Sarah Hook from the Dance Department, and in collaboration with Dr. Thecla Schiphorst. | ||
+ | |||
+ | == Summary (in table form) == | ||
+ | |||
+ | {| width="637" border="1" | ||
+ | | | ||
+ | <center>'''Type of sensor''''''</center> | ||
+ | | | ||
+ | <center>'''Example''''''</center> | ||
+ | | | ||
+ | <center>'''Commercially available products''''''</center> | ||
+ | | | ||
+ | <center>'''Fundamental movement phenomena sensed'''</center><center>'''(movement primitive)''''''</center> | ||
+ | | | ||
+ | <center>'''Mid-level movement feature (inferred from movement primitives)'''</center> | ||
+ | | | ||
+ | <center>'''Higher-level semantics based on LMA (inferred from mid-level features)''''''</center> | ||
+ | |- | ||
+ | | rowspan="2" | Acceleration | ||
+ | | Gyroscopes | ||
+ | | iPhone, IDG500 dual-axis gyroscope, Wiimote MotionPlus | ||
+ | | Rotational accleration | ||
+ | | rowspan="2" | Postural transitions; gait information (Yang and Hsu, 2010); linearity, planarity, periodicity (based on the work by Mary Pietrowicz at UIUC) | ||
+ | | rowspan="2" | A prototype for recognizing LMA Effort using accelerometers is being developed by the Institute for Advanced Computing Applications and Technologies at the University of Illinois and the University of Illinois Dance Department, with the expertise of movement analyst Sarah Hook from the Dance Department, and in collaboration with Dr. Thecla Schiphorst (Subyen, Maranan, Schiphorst, Pasquier, & Bartram, 2011). | ||
+ | |- | ||
+ | | Accelerometers | ||
+ | | Mobile phones (other than iPhone), Analog Devices triple axis ADXL335, Wiimote | ||
+ | | Linear acceleration | ||
+ | |- | ||
+ | | Touch | ||
+ | | Pressure sensors | ||
+ | | Tactex | ||
+ | | Pressure | ||
+ | | | ||
+ | | LMA recognition of has been applied to touch-based interfaces in interactive art (T. Schiphorst, Lovell, & Jaffe, 2002). | ||
+ | |- | ||
+ | | rowspan="3" | Position | ||
+ | | Vision | ||
+ | | Camera and webcams, icon, Kinect, Wiimote IR camera, IR-based motion capture systems | ||
+ | | rowspan="3" | Position of body segments | ||
+ | | rowspan="3" | Postural information; anything that can be inferred from acceleration sensors | ||
+ | | rowspan="3" | Recognition of some aspects of Space, Space, and Effort categories have been reported (J. Rett, J. Dias, & Ahuactzin, 2008; J. Rett, Santos, & J. Dias, 2008; Jorg Rett & Jorge Dias, 2007a, 2007b; Santos, Prado, & J. Dias, 2009; Santos et al., 2009; Swaminathan et al., 2009; L. Zhao, 2001; Liwei Zhao & Badler, 2005). | ||
+ | |- | ||
+ | | Magnetic | ||
+ | | | ||
+ | |- | ||
+ | | Infrared | ||
+ | | | ||
+ | |- | ||
+ | | rowspan="5" | Biometric | ||
+ | | Eye-tracking | ||
+ | | | ||
+ | | Gaze | ||
+ | | Visual attention; intent | ||
+ | | rowspan="5" | Muscular tension is related to Effort Weight. Attention and intent are key themes in Effort Space. We propose that arousal can be affined to the extent by which a mover uses �fighting� qualities over �indulging� qualities. | ||
+ | |- | ||
+ | | GSR | ||
+ | | | ||
+ | | Electrical conductance of the skin | ||
+ | | Arousal | ||
+ | |- | ||
+ | | Breath sensors | ||
+ | | | ||
+ | | Rate of breathing; volume of inspiration/expiration | ||
+ | | Arousal; energy expenditure | ||
+ | |- | ||
+ | | EMG | ||
+ | | | ||
+ | | Electrical activity produced by skeletal muscles | ||
+ | | Muscular tension | ||
+ | |- | ||
+ | | Heart rate sensors | ||
+ | | | ||
+ | | Heart rate | ||
+ | | Arousal; level of physical activity | ||
+ | |} | ||
=Wearable Accelerometers= | =Wearable Accelerometers= |
Revision as of 23:42, 14 November 2011
Contents
LMA Recognition
Using position-based sensors
LMA information such as Shape (Swaminathan et al., 2009), Space (J. Rett, J. Dias, et al., 2008; J. Rett, Santos, et al., 2008; Jorg Rett & Jorge Dias, 2007a, 2007b), and Effort (Nakata, Mori, & Sato, 2002; Santos et al., 2009; L. Zhao, 2001; Liwei Zhao & Badler, 2005) have been inferred from movement data sensed by magnetic tracking and computer vision.
Using acceleration-based sensors
Movement recognition using accelerometers is a research area among some of the partners of this research proposal. LMA recognition of has been applied to touch-based interfaces in interactive art (T. Schiphorst, Lovell, & Jaffe, 2002). A prototype for recognizing developed by the Institute for Advanced Computing Applications and Technologies at the University of Illinois and the University of Illinois Dance Department, with the expertise of movement analyst Sarah Hook from the Dance Department, and in collaboration with Dr. Thecla Schiphorst.
Summary (in table form)
|
|
|
|
|
|
Acceleration | Gyroscopes | iPhone, IDG500 dual-axis gyroscope, Wiimote MotionPlus | Rotational accleration | Postural transitions; gait information (Yang and Hsu, 2010); linearity, planarity, periodicity (based on the work by Mary Pietrowicz at UIUC) | A prototype for recognizing LMA Effort using accelerometers is being developed by the Institute for Advanced Computing Applications and Technologies at the University of Illinois and the University of Illinois Dance Department, with the expertise of movement analyst Sarah Hook from the Dance Department, and in collaboration with Dr. Thecla Schiphorst (Subyen, Maranan, Schiphorst, Pasquier, & Bartram, 2011). |
Accelerometers | Mobile phones (other than iPhone), Analog Devices triple axis ADXL335, Wiimote | Linear acceleration | |||
Touch | Pressure sensors | Tactex | Pressure | LMA recognition of has been applied to touch-based interfaces in interactive art (T. Schiphorst, Lovell, & Jaffe, 2002). | |
Position | Vision | Camera and webcams, icon, Kinect, Wiimote IR camera, IR-based motion capture systems | Position of body segments | Postural information; anything that can be inferred from acceleration sensors | Recognition of some aspects of Space, Space, and Effort categories have been reported (J. Rett, J. Dias, & Ahuactzin, 2008; J. Rett, Santos, & J. Dias, 2008; Jorg Rett & Jorge Dias, 2007a, 2007b; Santos, Prado, & J. Dias, 2009; Santos et al., 2009; Swaminathan et al., 2009; L. Zhao, 2001; Liwei Zhao & Badler, 2005). |
Magnetic | |||||
Infrared | |||||
Biometric | Eye-tracking | Gaze | Visual attention; intent | Muscular tension is related to Effort Weight. Attention and intent are key themes in Effort Space. We propose that arousal can be affined to the extent by which a mover uses �fighting� qualities over �indulging� qualities. | |
GSR | Electrical conductance of the skin | Arousal | |||
Breath sensors | Rate of breathing; volume of inspiration/expiration | Arousal; energy expenditure | |||
EMG | Electrical activity produced by skeletal muscles | Muscular tension | |||
Heart rate sensors | Heart rate | Arousal; level of physical activity |