| 787 | 16 | 148 |
| 下载次数 | 被引频次 | 阅读次数 |
对多种运动捕捉技术和柔性传感器在当前多种领域的广泛应用进行了简单阐述。重点从关节的运动类型出发,对人体运动进行了分析,介绍了光学监测系统、惯性传感系统、磁感应测量系统和柔性应力传感系统的原理,评估了它们在捕捉人体连续运动方面的适用性,并总结了国内外研究中涉及新系统搭建、算法提升和信息处理等研究成果,以及其在提高运动捕捉性能方面的研究进展,对所综述的运动捕捉技术的优缺点进行了评述。最后,对当前运动捕捉技术进行对比,说明了当前技术成熟发展完善,但提升空间有限;柔性传感器测量能力全面,具有较大的系统发展潜力,有望成为运动捕捉技术未来的发展方向。
Abstract:The current extensive applications in multiple domains of various motion capture technologies and flexible sensors are briefly described. Focusing on the analysis of human motion from the types of joint movement, the principles of optical monitoring systems, inertial sensing systems, magnetic induction measurement systems and flexible stress sensing systems are introduced, and their suitabilities in capturing continuous human movements are evaluated. The research results of novel system architectures, algorithmic enhancements and information processing at home and abroad, as well as the research progress in improving motion capture performances, are summarized. The advantages and disadvantages of the reviewed motion capture technologies are reviewed. Finally, the comparison of the current motion capture technologies shows that the current technologies are mature and perfect, but the space for improvement is limited. The flexible sensors have comprehensive measurement capabilities and great potential for system development, and are expected to become the future development direction of motion capture technology.
[1] ADESIDA Y, PAPI E, MCGREGOR A H. Exploring the role of wearable technology in sport kinematics and kinetics:a systematic review[J]. Sensors, 2019, 19(7):1597-1-1597-26.
[2] SHARMA S, VERMA S,KUMAR M, et al. Use of motion capture in 3D animation:motion capture systems, challenges, and recent trends[C]//Proceedings of International Conference on Machine Learning, Big Data, Cloud and Parallel Computing. Faridabad, India, 2019:289-294.
[3] van der KRUK E, REIJINE M M. Accuracy of human motion capture systems for sport applications:state-of-the-art review[J]. European Journal of Sport Science, 2018,18(6):806-819.
[4] GAO S,HE T Y Y, ZHANG Z X, et al. A motion capturing and energy harvesting hybridized lower-limb system for rehabilitation and sports applications[J]. Advanced Science,2021, 8(20):2101834-1-2101834-16.
[5] YANG W C, HSU W L, WU R M, et al. Motion analysis of axial rotation and gait stability during turning in people withparkinson's disease[J]. Gait&Posture, 2016, 44:83-88.
[6] SCHMITZ A, YE M, BOGGESS G, et al. The measurement of in vivo joint angles during a squat using a single camera markerless motion capture system as compared to a marker based system[J]. Gait&Posture, 2015, 41(2):694-698.
[7] RUM L, STEN O, VENDRAME E, et al. Wearable sensors in sports for persons with disability:a systematic review[J]. Sensors, 2021, 21(5):1858-1-1858-25.
[8]王锐.成为VR的利器之前运动捕捉技术是如何发展过来的?[EB/OL].(2015-11-18)[2023-05-09]. https://www.sohu.com/a/42648798_114877.
[9] MAXWELL D R. Graphical marionette:a modern-day Pinocchio[D]. Cambridge:Massachusetts Institute of Technology, 1983.
[10] di BIASE L, PECORARO P M, PECORARO G, et al.Markerless radio frequency indoor monitoring for telemedicine:gait analysis, indoor positioning, fall detection,tremor analysis, vital signs and sleep monitoring[J]. Sensors, 2022, 22(21):8486-1-8486-25.
[11] FAISAL A I, MAJUMDER S, MONDAL T, et al. Monitoring methods of human body joints:state-of-the-art and research challenges[J]. Sensors, 2019,19(11):2629-1-2629-39.
[12] HUI A Y, MCCARTY W J, MASUDA K, et al. A systems biology approach to synovial joint lubrication in health,injury, anddisease[J]. Wiley Interdisciplinary Reviews:Systems Biology and Medicine, 2012, 4(1):15-37.
[13] MOESLUND T B, GRANUM E. A survey of computer vision-based human motion capture[J]. Computer Vision and Image Understanding, 2001, 81(3):231-268.
[14] PFISTER A, WEST A M, BRONNER S, et al. Comparative abilities of microsoft kinect and vicon 3D motion capture for gait analysis[J]. Journal of Medical Engineering&Technology, 2014, 38(5/6):274-280.
[15] AUGHEY R, BALL K, ROBERTSON S J, et al. Comparison of a computer vision system against three-dimensional motion capture for tracking football movements in a stadium environment[J]. Sports Engineering, 2022, 25(1):1-7.
[16] CLARK R A, PUA Y H, FORTIN K, et al. Validity of the microsoft kinect for assessment of postural control[J].Gait and Posture, 2012, 36(3):372-377.
[17] NORRIS B S, OLSON S L. Concurrent validity and reliability of two-dimensional video analysis of hip and knee joint motion during mechanical lifting[J]. Physiotherapy Theory and Practice, 2011, 27(7):521-530.
[18] MERRIAUX P, DUPUIS Y, BOUTTEAU R, et al. A study ofvicon system positioning performance[J]. Sensors,2017, 17(7):1591-1-1591-18.
[19] PARKS M T, WANG Z, SIU K C. Current low-cost videobased motion analysis options for clinical rehabilitation:a systematic review[J]. Physical Therapy, 2019, 99(10):1405-1425.
[20] YU J,ZHANG S S,WANG A H,et al.Human gait analysis based on opensim[C]//Proceedings of International Conference on Advanced Mechatronic Systems. Hanoi,Vietnam, 2020:278-281.
[21] YUNARDI R T, WINARNO. Marker-based motion capture for measuring joint kinematics in leg swing simulator[C]//Proceedings of the 5th International Conference on Instrumentation, Control, and Automation. Yogyakarta,Indonesia,2017:13-17.
[22] ZHAO X M, CHEN W H, LI B, et al. An adaptive stairascending gait generation approach based on depth camera for lower limb exoskeleton[J]. Review of Scientific Instruments, 2019, 90(12):125112-1-125112-14.
[23] GE Y F, DAN Y P, WANG A H, et al. Lower limb rehabilitation robot control based on human gait data and plantar reaction force[C]//Proceedings of International Conference on Advanced Mechatronic Systems. Hanoi, Vietnam,2020:286-289.
[24] AKHTER I, BLACK M J. Pose-conditioned joint angle limits for 3D human pose reconstruction[C]//Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA, 2015:1446-1455.
[25] GHORBANI N, BLACK M J. SOMA:solving optical marker-based mocap automatically[C]//Proceedings of the 18th IEEE/CVF International Conference on Computer Vision. Montreal, Canada, 2021:11097-11106.
[26] CHATZITOFIS A, ZARPALAS D, DARAS P, et al. DeMo Cap:low-cost marker-based motion capture[J]. International Journal of Computer Vision, 2021, 129(12):3338-3366.
[27] JOO H, SIMON T, LI X L, et al. Panoptic studio:a massively multiview system for social interaction capture[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 41(99):190-204.
[28] KICIROGLU S, RHODIN H,SINHA S N, et al. Active mocap:optimized viewpoint selection for active human motion capture[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).Seattle, USA, 2020:100-109.
[29] LI K, JIAO N H, LIU Y B, et al. Shape and pose estimation for closely interacting persons using multi-view images[J]. Computer Graphics Forum, 2018, 37(7):361-371.
[30] CAO Z, SIMON T, WEI S E, et al. Realtime multi-person2D pose estimation using part affinity fields[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA, 2019:1302-1310.
[31] ZHANG Y X, AN L, YU T, et al. 4D association graph for realtime multi-person motion capture using multiple video cameras[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle,USA, 2020:1321-1330.
[32] DONG J T, FANG Q, JIANG W, et al. Fast and robust multi-person 3D pose estimation and tracking from multiple views[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022,44(10):6981-6992.
[33] SHAHABPOOR E, PAVIC A. Measurement of walking ground reactions in real-life environments:a systematic review of techniques andtechnologies[J]. Sensors, 2017, 17(9):2085-1-2085-38.
[34] SCOTT J, RAVICHANDRAN B, FUNK C, et al. From image to stability:learning dynamics from human pose[J].Computer Vision-ECCV, 2020,12368:536-554.
[35] JARCHI D, POPE J, LEE T K M, et al. A review on accelerometry-based gait analysis and emerging clinical applications[J]. IEEE Reviews in Biomedical Engineering,2018, 11:177-194.
[36] GREENE B R, O'DONOVAN A, ROMERO-ORTUNO R,et al. Quantitative falls risk assessment using the timed up and go test[J]. IEEE Transactions on Biomedical Engineering, 2010,57(12):2918-2926.
[37] MADGWICK S O H, HARRISON A J L, VAIDYANATHAN R. Estimation of IMU and MARG orientation using a gradient descent algorithm[C]//Proceedings of IEEE International Conference on Rehabilitation Robotics.Zurich, Switzerland,2011:5975346-1-5975346-7.
[38] BEER R F, DEWALD J P, RYMER W Z. Deficits in the coordination of multijoint arm movements in patients with hemiparesis:evidence for disturbed control of limb dynamics[J]. Experimental Brain Research, 2000, 131(3):305-319.
[39] LUINGE H J, VELTINK P H, BATEN C T M. Ambulatory measurement of arm orientation[J]. Journal of Biomechanics, 2007,40(1):78-85.
[40] HINGTGEN B, MCGUIRE J R, WANG M, et al. An upper extremity kinematic model for evaluation of hemiparetic stroke[J]. Journal of Biomechanics, 2006, 39(4):681-688.
[41] DORSCHKY E, NITSCHKE M, SEIFER A K, et al. Estimation of gait kinematics and kinetics from inertial sensor data using optimal control of musculoskeletal models[J].Journal of Biomechanics, 2019, 95:109278-1-109278-9.
[42] ROBERT-LACHAINE X, MECHERI H, MULLER A, et al. Validation of a low-cost inertial motion capture system for whole-body motion analysis[J]. Journal of Biomechanics, 2020, 99:109520-1-109520-5.
[43] SERS R, FORRESTER S, MOSS E, et al. Validity of the perception neuron inertial motion capture system for upper body motion analysis[J]. Measurement, 2020, 149:107024-1-107024-9.
[44] CIPPITELLI E, FIORANELLI F, GAMBI E, et al. Radar and RGB-depth sensors for fall detection:areview[J].IEEE Sensors Journal, 2017, 17(12):3585-3604.
[45] MASON R, PEARSON L T, BARRY G, et al. Wearables for running gait analysis:a systematic review[J]. Sports Medicine, 2023, 53(1):241-268.
[46] CHAMBERS R, GABBETT T J, COLE M H, et al. The use of wearable microsensors to quantify sport-specific movements[J]. Sports Medicine, 2015, 45(7):1065-1081.
[47] ZHOU H Y, HU H S. Human motion tracking for rehabilitation—a survey[J]. Biomedical Signal Processing and Control, 2008, 3(1):1-18.
[48] VARGAS A I C, MERCANT A G, WILLIAMS J M. The use of inertial sensors system for human motion analysis[J]. Physical Therapy Reviews,2010,15(6):462-473.
[49] LEE G X, LOW K S, TAHER T. Unrestrained measurement of arm motion based on a wearable wireless sensor network[J]. IEEE Transactions on Instrumentation and Measurement, 2010, 59(5):1309-1317.
[50] WILMES E,de RUITER C J, BASTIAANSEN B J C, et al. Inertial sensor-based motion tracking in football with movement intensity quantification[J]. Sensors, 2020, 20(9):2527-1-2527-16.
[51] WANG S L, CIVILLICO G, NISWANDER W, et al.Comparison of motion analysis systems in tracking upper body movement of myoelectric bypass prosthesis users[J].Sensors, 2022, 22(8):2953-1-2953-22.
[52] WIRTH M A, FISCHER G, VERDúJ, et al. Comparison of a new inertial sensor based system with an optoelectronic motion capture system for motion analysis of healthy human wrist joints[J]. Sensors, 2019, 19(23):5297-1-5297-16.
[53] ZHOU H Y, STONE T, HU H S, et al. Use of multiple wearable inertial sensors in upper limb motion tracking[J].Medical Engineering&Physics, 2008, 30(1):123-133.
[54] BAI L, PEPPER M G, YAN Y, et al. Quantitative assessment of upper limb motion in neurorehabilitation utilizing inertial sensors[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2015, 23(2):232-243.
[55] BRZOSTOWSKI K. Novel approach to human walking speed enhancement based on drift estimation[J]. Biomedical Signal Processing and Control, 2018, 42:18-29.
[56] QIU S, ZHAO H K, JIANG N, et al. Sensor network oriented human motion capture via wearable intelligent system[J]. International Journal of Intelligent Systems,2021, 37(2):1646-1673.
[57] ZHENG Z R, YU T, LI H, et al. Hybridfusion:real-time performance capture using a single depth sensor and sparse IMUs[C]//Proceedings of the 15th European Conference on Computer Vision. Munich, Germany, 2018:389-406.
[58] KAICHI T, MARUYAMA T, TADA M, et al. Resolving position ambiguity of IMU-based human pose with a single RGB camera[J]. Sensors, 2020, 20(19):5453-1-5453-12.
[59] GILBERT A, TRUMBLE M, MALLESON C, et al. Fusing visual and inertial sensors with semantics for 3D human pose estimation[J]. International Journal of Computer Vision, 2019, 127(4):381-397.
[60] ZHANG Z, WANG C Y, QIN W H, et al.Fusing wearable IMUs with multi-view images for human pose estimation:a geometric approach[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Seattle, USA, 2020:2197-2206.
[61] LIU S Q, ZHANG J C, ZHANG Y Z, et al. A wearable motion capture device able to detect dynamic motion of human limbs[J]. Nature Communications,2020,11(1):5615-1-5615-12.
[62] MASCRET Q, GAGNON-TURCOTTE G, BIELMANN M, et al. A wearable sensor network with embedded machine learning for real-time motion analysis and complex posture detection[J]. IEEE Sensors Journal, 2021,22(8):7868-7876.
[63] ALARCóN-ALDANA A C, CALLEJAS-CUERVO M,BASTOS-FILHO T, et al. A kinematic information acquisition model that uses digital signals from an inertial and magnetic motion capture system[J]. Sensors, 2022, 22(13):4898-1-4898-20.
[64] YI X Y, ZHOU Y X, HABERMANN M, et al. Physical inertial poser(PIP):physics-aware real-time human motion tracking from sparse inertial sensors[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans, USA, 2022:13157-13168.
[65] FANTOZZI S, GIOVANARDI A, MAGALHAES F A, et al. Assessment of three-dimensional joint kinematics of the upper limb during simulated swimming using wearable inertial-magnetic measurement units[J]. Journal of Sports Sciences, 2016, 34(7/8/9/10/11/12):1073-1080.
[66] GOLESTANI N, MOGHADDAM M. Human activity recognition using magnetic induction-based motion signals and deep recurrent neural networks[J]. Nature Communications, 2020,11(1):1551-1-1551-11.
[67] GOLESTANI N, MOGHADDAM M. Wearable magnetic induction-based approach toward 3D motion tracking[J].Scientific Reports, 2021,11(1):18905-1-18905-10.
[68] SCHULTEN H, WITTNEBEN A. Experimental study of posture detection using purely passive magneto-inductive tags[C]//Proceedings of IEEE Wireless Communications and Networking Conference. Austin, USA, 2022:2643-2648.
[69] CHEN Z H, FANG R, LI W, et al. Stretchable transparent conductors:from micro/macromechanics to applications[J]. Advanced Materials, 2019, 31(35):1900756-1-1900756-40.
[70] SOURI H, BANERJEE H, JUSUFI A, et al. Wearable and stretchable strain sensors:materials, sensing mechanisms, and applications[J]. Advanced Intelligent Systems, 2020, 2(8):2000039-1-2000039-27.
[71] DUAN L Y, D'HOOGE D R, CARDON L. Recent progress on flexible and stretchable piezoresistive strain sensors:from design to application[J]. Progress in Materials Science, 2020, 114:100617-1-100617-40.
[72] JEERAPAN I, POORAHONG S. Review-flexible and stretchable electrochemical sensing systems:materials,energy sources, and integrations[J]. Journal of the Electrochemical Society, 2020, 167(3):037573-1-037573-18.
[73] XU H H, LV Y, QIU D X, et al. An ultra-stretchable,highly sensitive and biocompatible capacitive strain sensor from an ionic nanocomposite for on-skin monitoring[J].Nanoscale, 2019, 11(4):1570-1578.
[74] CHEN G R, XIAO X, ZHAO X, et al. Electronic textiles for wearable point-of-care systems[J]. Chemical Reviews,2022,122(3):3259-3291.
[75] WANG Z H, CHANG Y, YAO T, et al. Investigating multifunctional flexible motion sensor of a bionic caterpillar[J]. IEEE Sensors Journal, 2022, 22(8):7619-7626.
[76] AMJADI M, YOON Y J, PARK I. Ultra-stretchable and skin-mountable strain sensors using carbon nanotubesecoflex nanocomposites[J]. Nanotechnology, 2015, 26(37):375501-1-375501-11.
[77] NUR R, MATSUHISA N, JIANG Z, et al. A highly sensitive capacitive-type strain sensor using wrinkled ultrathin gold films[J]. Nano Letters, 2018, 18(9):5610-5617.
[78] WANG H M, LI D, ZHONG W, et al. Self-powered inhomogeneous strain sensor enabled joint motion and threedimensional muscle sensing[J]. ACS Applied Materials Interfaces, 2019,11(37):34251-34257.
[79] ZHANG S D, LIU H, YANG S Y, et al. Ultrasensitive and highly compressible piezoresistive sensor based on polyurethane sponge coated with a cracked cellulose nanofibril/silver nanowire layer[J]. ACS Applied Materials&Interfaces, 2019, 11(11):10922-10932.
[80] KIM K K, HONG S, CHO H M, et al. Highly sensitive and stretchable multidimensional strain sensor with prestrained anisotropic metal nanowire percolation networks[J]. Nano Letters, 2015, 15(8):5240-5247.
[81] SUI C, YANG Y C, HEADRICK R J, et al. Directional sensing based on flexible aligned carbon nanotube film nanocomposites[J]. Nanoscale, 2018, 10(31):14938-14946.
[82] CHEN S, SONG Y J, DING D Y, et al. Flexible and anisotropic strain sensor based on carbonized crepe paper with aligned cellulose fibers[J]. Advanced Functional Materials, 2018, 28(42):1802547-1-1802547-9.
[83] CHENG Y, WANG R R, SUN J,et al. A stretchable and highly sensitive graphene-based fiber for sensing tensile strain, bending, and torsion[J]. Advanced Materials,2015, 27(45):7365-7371.
[84] KIM K H, JANG N S, HA S H, et al. Highly sensitive and stretchable resistive strain sensors based on microstructured metal nanowire/elastomer composite films[J].Small, 2018, 14(14):1704232-1-1704232-10.
[85] HUANG X W, XIANG W F, LI C H, et al. Triple-asymmetric flexible strain sensor based on high-aligned Ni nanowire arrays with opposite resistance responding for multidimensional motions detection[J]. Advanced Materials Technologies, 2023, 8(2):2201093-1-2201093-9.
[86] YAN C Y, WANG J X, KANG W B, et al. Highly stretchable piezoresistive graphene-nanocellulose nanopaper for strain sensors[J]. Advanced Materials, 2014, 26(13):2022-2027.
[87] ARAROMI O A, GRAULE M A, DORSEY K L, et al.Ultra-sensitive and resilient compliant strain gauges for soft machines[J]. Nature, 2020, 587(7833):219-224.
[88] BI P, ZHANG M C, LI S, et al. Ultra-sensitive and wide applicable strain sensor enabled by carbon nanofibers with dual alignment for human machine interfaces[J]. Nano Research, 2023, 16(3):4093-4099.
基本信息:
DOI:10.13250/j.cnki.wndz.2023.11.001
中图分类号:TP212
引用信息:
[1]李承翰,胡明皓,李航,等.运动捕捉技术及柔性传感器用于人体连续运动监测的研究进展[J].微纳电子技术,2023,60(11):1703-1714.DOI:10.13250/j.cnki.wndz.2023.11.001.
基金信息:
国家自然科学基金(62075245)
2023-11-15
2023-11-15