Name: capturing representative hand use at home using egocentric video in individuals with upper limb impairment
Uploaded: 2020-12-23T13:00:00.000+00:00
Duration: 6 min 25 s
Description: Watch this Scientific Journal Video about Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment at JoVE.com

使用此协议的研究由心脏和中风基金会（G-18-0020952）、克雷格·尼尔森基金会（542675）、加拿大自然科学和工程研究理事会（RGPIN-2014-05498）和安大略省研究、创新和科学部（ER16-12-013）资助。

这项研究得到了大学健康网络研究伦理委员会的批准。在注册研究之前，从每个参与者那里获得了知情同意。还从录像中出现的任何照顾者或家庭成员那里获得了知情同意书。
1. 验证协议对个人的适用性
注:本协议适用于手功能受损但并非完全缺失的个人（具体标准可适应人口和/或兴趣问题）。
<ol><li>询问参与者受影响的手是否影响他们执行 ADL 的能力。 注:建议参与者举出一些他们能够且不能用受影响的手独立执行的任务示例。</li>
	<li>验证蒙特利尔认知评估 （MoCA） 的总分是否高于 21，以避免在理解和遵循协议程序方面出现潜在困难。</li>
</ol>2. 确定参与者的日常生活
<ol><li>请参与者回忆过去两周的日常生活。记录执行哪些日常任务、执行时间以及大约在什么时间执行。</li>
	<li>与参与者合作，选择 3 个时隙，每个时段 1.5 小时，在此期间录制视频。选择分布在一周中不同天数的时隙，并且通常按顺序执行涉及手的 ADL 时段。 注:选定的 ADL 必须代表每个参与者的典型活动，并被他们视为有意义的。在不同日期安排记录时间旨在增加记录的 ADL 的多样性，并促进捕获有用和有意义的数据。 注:录制时隙计划用于记录效率，但参与者应了解他们完全控制何时开始和停止录制。</li>
</ol>3. 与参与者就录制时间表和目标视频内容达成协议
<ol><li>在讨论他们可能遇到的任何顾虑后，获得每个参与者对录制时间表的一致意见。</li>
	<li>在两周内设定 3 小时视频的目标。告知参与者视频不足可能导致延长录制时间。</li>
</ol>4. 强调自然执行 ADL 的重要性
<ol><li>指示参与者专注于捕捉逼真的程序，而不是指定要记录的特定活动。该说明的目的是劝阻参与者人为地记录比他们通常记录的更多的特定活动。</li>
</ol>5. 通知家中录音过程中可能存在隐私问题
<ol><li>确保参与者明白，所有录音都应在家中进行，而不是在公共场所进行，以避免隐私问题。</li>
	<li>举一些可能引发隐私问题的例子，例如洗澡、穿衣/脱衣服和检查机密信息。提醒参与者注意镜子，镜子可能会在录音中显示他们的脸。</li>
	<li>建议参与者尽量避免其他人（如家庭成员或护理人员）出现在视频中。 注:在研究方面，在不可避免的情况下，应获得这些人的知情同意。</li>
</ol>6. 相机和平板电脑指令
注:如果参与者在初始接触期间表示，他们需要护理人员协助满足其许多日常需求，则鼓励护理人员也参加考察访问，并接受设备使用方面的培训，以便他们以后能够协助参与者。
<ol><li>向参与者演示如何使用以自我为中心的相机（材料表）。<ol>
<li>演示如何打开和关闭相机。</li>
		<li>演示如何使用相机控制录音（开始、暂停、停止）。</li>
	</ol>
</li>
	<li>演示如何使用平板电脑（材料表）与预装相机应用程序来控制录音，如果适用的话。 注:演示包括控制来自相机应用程序的录制，以及重播和编辑（例如，修剪或删除）录制的视频。相机遥控器最初被认为是（补充文件），但在实践中没有使用，因为参与者是舒适的使用相机或平板电脑开始和停止录音。<ol>
<li>演示如何打开和关闭平板电脑。</li>
		<li>演示如何通过相机应用程序将平板电脑连接到相机。</li>
		<li>演示如何控制来自相机应用的录音。</li>
		<li>演示如何查看相机应用中录制的视频。</li>
		<li>演示如何修剪或删除相机应用程序中的视频。</li>
	</ol>
</li>
	<li>演示如何使用可调节到参与者头部的弹性头带来穿和擦相机。 注:见图1。 <img alt="Figure 1" class="xfigimg" src="/files/ftp_upload/61898/61898fig01.jpg"> 图1。可穿戴相机设置。 （A）以自我为中心的相机的定位。（B）从相机查看角度。<a href="https://www-jove-com.bdigitaluss.remotexs.co/files/ftp_upload/61898/61898fig01large.jpg" target="_blank">请单击此处查看此图的较大版本。</a>
	<ol>
<li>将相机放在参与者的额头上。调整头带，舒适而稳定地佩戴相机。</li>
		<li>确保相机与额头的最佳角度。</li>
		<li>要求参与者录制一小段视频，同时移动他们面前的手并操纵对象（例如平板电脑）。</li>
		<li>查看录制的视频，并确保在执行操作任务时，两只手在场景的中心区域清晰可见。</li>
		<li>与参与者及其护理人员一起练习使用相机和平板电脑，直到他们表现出熟练程度。</li>
	</ol>
</li>
</ol>7. 赠送设备
<ol><li>将所有设备的套件交给参与者，以便在家里记录其 ADL。除了相机和平板电脑，该套件还包括额外的相机电池、用于相机和平板电脑的电池充电器、充电电缆、相机头带以及一套用于使用相机的打印指南（参见 补充材料）。</li>
</ol>8. 实验故障排除和后续工作
<ol><li>提供研究人员的联系方式，以帮助解决家庭实际录音过程中的障碍。一周后，研究人员打电话给参与者记录记录进度并解决任何潜在的技术问题。</li>
</ol>9. 检索设备和视频
<ol><li>通过预先付费的邮包，将参与者的所有设备和视频进行反驳。</li>
	<li>确保参与者同意共享返回的所有视频。鼓励参与者在将所有收集的视频返回给研究团队之前进行审查，并删除他们不想分享的任何部分。</li>
	<li>对于研究，请查看返回的视频，并检查是否有人在未经其同意的情况下出现在视频中。如果是这样，发送同意书或致电视频中出现的个人，以获得他们的同意使用视频。如果无法联系到这些个体，研究人员将删除他们出现的视频部分。</li>
</ol>

<ol>
	<li>Nichols-Larsen, D. S., Clark, P., Zeringue, A., Greenspan, A., Blanton, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Factors+influencing+stroke+survivors'+quality+of+life+during+subacute+recovery.">Factors influencing stroke survivors' quality of life during subacute recovery.</a> Stroke. 36 (7), 1480-1484 (2005).</li><li>Anderson, K. D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Targeting+recovery:+priorities+of+the+spinal+cord-injured+population.">Targeting recovery: priorities of the spinal cord-injured population.</a> Journal of Neurotrauma. 21 (10), 1371-1383 (2004).</li><li>Gladstone, D. J., Danells, C. J., Black, S. E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+Fugl-Meyer+assessment+of+motor+recovery+after+stroke:+a+critical+review+of+its+measurement+properties.">The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties.</a> Neurorehabilitation and Neural Repair. 16 (3), 232-240 (2002).</li><li>Barreca, S. R., Stratford, P. W., Lambert, C. L., Masters, L. M., Streiner, D. L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Test-retest+reliability,+validity,+and+sensitivity+of+the+Chedoke+arm+and+hand+activity+inventory:+a+new+measure+of+upper-limb+function+for+survivors+of+stroke.">Test-retest reliability, validity, and sensitivity of the Chedoke arm and hand activity inventory: a new measure of upper-limb function for survivors of stroke.</a> Archives of Physical Medicine and Rehabilitation. 86 (8), 1616-1622 (2005).</li><li>Uswatte, G., Taub, E., Morris, D., Vignolo, M., McCulloch, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Reliability+and+validity+of+the+upper-extremity+Motor+Activity+Log-14+for+measuring+real-world+arm+use.">Reliability and validity of the upper-extremity Motor Activity Log-14 for measuring real-world arm use.</a> Stroke. 36 (11), 2493-2496 (2005).</li><li>Duncan, P. W., Bode, R. K., Lai, S. M., Perera, S., Antagonist, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Rasch+analysis+of+a+new+stroke-specific+outcome+scale:+the+Stroke+Impact+Scale.">Rasch analysis of a new stroke-specific outcome scale: the Stroke Impact Scale.</a> Archives of Physical Medicine and Rehabilitation. 84 (7), 950-963 (2003).</li><li>Marino, R. J., Shea, J. A., Stineman, M. G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+capabilities+of+upper+extremity+instrument:+reliability+and+validity+of+a+measure+of+functional+limitation+in+tetraplegia.">The capabilities of upper extremity instrument: reliability and validity of a measure of functional limitation in tetraplegia.</a> Archives of Physical Medicine and Rehabilitation. 79 (12), 1512-1521 (1998).</li><li>Hayward, K. S., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Exploring+the+role+of+accelerometers+in+the+measurement+of+real+world+upper-limb+use+after+stroke.">Exploring the role of accelerometers in the measurement of real world upper-limb use after stroke.</a> Brain Impairment. 17 (1), 16-33 (2016).</li><li>van der Pas, S. C., Verbunt, J. A., Breukelaar, D. E., van Woerden, R., Seelen, H. A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Assessment+of+arm+activity+using+triaxial+accelerometry+in+patients+with+a+stroke.">Assessment of arm activity using triaxial accelerometry in patients with a stroke.</a> Archives of Physical Medicine and Rehabilitation. 92 (9), 1437-1442 (2011).</li><li>Oess, N. P., Wanek, J., Curt, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Design+and+evaluation+of+a+low-cost+instrumented+glove+for+hand+function+assessment.">Design and evaluation of a low-cost instrumented glove for hand function assessment.</a> Journal of Neuroengineering and Rehabilitation. 9 (1), 2 (2012).</li><li>Friedman, N., Rowe, J. B., Reinkensmeyer, D. J., Bachman, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+manumeter:+a+wearable+device+for+monitoring+daily+use+of+the+wrist+and+fingers.">The manumeter: a wearable device for monitoring daily use of the wrist and fingers.</a> IEEE Journal of Biomedical Health Informatics. 18 (6), 1804-1812 (2014).</li><li>Liu, X., Rajan, S., Ramasarma, N., Bonato, P., Lee, S. I. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+use+of+a+finger-worn+accelerometer+for+monitoring+of+hand+use+in+ambulatory+settings.">The use of a finger-worn accelerometer for monitoring of hand use in ambulatory settings.</a> IEEE Journal of Biomedical Health Informatics. 23 (2), 599-606 (2018).</li><li>Lee, S. I., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+novel+upper-limb+function+measure+derived+from+finger-worn+sensor+data+collected+in+a+free-living+setting.">A novel upper-limb function measure derived from finger-worn sensor data collected in a free-living setting.</a> PloS One. 14 (3), (2019).</li><li>Rowe, J. B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=The+variable+relationship+between+arm+and+hand+use:+a+rationale+for+using+finger+magnetometry+to+complement+wrist+accelerometry+when+measuring+daily+use+of+the+upper+extremity.">The variable relationship between arm and hand use: a rationale for using finger magnetometry to complement wrist accelerometry when measuring daily use of the upper extremity.</a> 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. , 4087-4090 (2014).</li><li>Dousty, M., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Tenodesis+Grasp+Detection+in+Egocentric+Video.">Tenodesis Grasp Detection in Egocentric Video.</a> IEEE Journal of Biomedical and health. , (2020).</li><li>Likitlersuang, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Egocentric+video:+a+new+tool+for+capturing+hand+use+of+individuals+with+spinal+cord+injury+at+home.">Egocentric video: a new tool for capturing hand use of individuals with spinal cord injury at home.</a> Journal of Neuroengineering and Rehabilitation. 16 (1), 83 (2019).</li><li>Tsai, M. -. F., Wang, R. H., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Generalizability+of+Hand-Object+Interaction+Detection+in+Egocentric+Video+across+Populations+with+Hand+Impairment.">Generalizability of Hand-Object Interaction Detection in Egocentric Video across Populations with Hand Impairment.</a> 2020 42nd Annual International Conference of the IEEE Engineering in Medicine &amp; Biology Society (EMBC). , 3228-3231 (2020).</li><li>Bandini, A., Dousty, M., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+wearable+vision-based+system+for+detecting+hand-object+interactions+in+individuals+with+cervical+spinal+cord+injury:+First+results+in+the+home+environment.">A wearable vision-based system for detecting hand-object interactions in individuals with cervical spinal cord injury: First results in the home environment.</a> 2020 42nd Annual International Conference of the IEEE Engineering in Medicine &amp; Biology Society (EMBC). , 2159-2162 (2020).</li><li>Dousty, M., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Towards+Clustering+Hand+Grasps+of+Individuals+with+Spinal+Cord+Injury+in+Egocentric+Video.">Towards Clustering Hand Grasps of Individuals with Spinal Cord Injury in Egocentric Video.</a> 2020 42nd Annual International Conference of the IEEE Engineering in Medicine &amp; Biology Society (EMBC). , 2151-2154 (2020).</li><li>Bandini, A., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Analysis+of+the+hands+in+egocentric+vision:+A+survey.">Analysis of the hands in egocentric vision: A survey.</a> IEEE Transactions on Pattern Analysis and Machine Intelligence. , (2020).</li><li>Likitlersuang, J., Sumitro, E. R., Theventhiran, P., Kalsi-Ryan, S., Zariffa, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Views+of+individuals+with+spinal+cord+injury+on+the+use+of+wearable+cameras+to+monitor+upper+limb+function+in+the+home+and+community.">Views of individuals with spinal cord injury on the use of wearable cameras to monitor upper limb function in the home and community.</a> Journal of Spinal Cord Medicine. 40 (6), 706-714 (2017).</li></ol>

作者没有什么可透露的。

我们提出了一个协议，用于在家中使用可穿戴摄像头在上肢损伤（如 cSCI 和中风）中录制 ADL 视频。该协议是灵活的，可以以目标为导向，以捕获特定 ADL 中的手功能性能，或远程跟踪居住在家中的人的康复进度。以自我为中心的视力模式在远程监测社区居民的手部功能以及一旦人们出院后优化康复方面具有巨大潜力。尽管在扩展使用期间（例如超过 1 小时）的舒适性存在一些限制，但以自我为中心的摄像机在功能 ADL 期间具有相当大的潜力来捕捉手部使用的详细信息，并提供无法通过加速度计和动用图获得的上下文信息。这项技术的潜在应用包括作为新结果措施的基础，量化国内独立使用手，以及分析姿势信息，以确定掌握策略或补偿姿势，并为治疗规划提供信息。虽然可穿戴相机允许我们在家里捕捉自然手部使用，但由于电池续航时间、存储空间和舒适性的限制，摄像机无法连续记录几个小时，尽管可穿戴技术的快速演变可能会在不远的将来减少这些限制。为了捕捉参与者的代表性程序，尽管记录时间有限，这里提出的协议依赖于研究人员和参与者之间的协作过程来选择适当的记录时间表。
由于从有 cSCI 和中风幸存者的个人那里收集的数据，我们能够完善协议并找出陷阱和差距，这些陷阱和差距可以在未来的研究中得到改善。例如，录制时间通常比预期的两周更长，以获得 3 小时的视频数据。在我们的研究中，这些情况通常是由意外事件（如疾病、意外出城旅行等）引起的，这些事件使参与者无法按计划录制视频。在这些情况下，我们通过每周电话向参与者提供支持，不仅检查记录进度，还排除因不频繁使用该技术而引起的任何技术问题。共有15名参与者的护理人员参与帮助在家录制视频。除了技术问题外，在使用可穿戴摄像机在手部损伤者中录制视频数据时，还采用了两项一般性建议:1） 强调参与者 何时应记录，而不是应录制 什么 ，以避免人为地长时间录制单个活动，并增加 ADL 的多样性。2） 只要舒适，就让摄像机保持更长的连续录制时间，以提高录制效率并捕捉自然活动序列。
此协议可用于在各种活动中捕获自然手功能。在收集的视频中，一些参与者不仅包括日常生活必需品（即饮食），还包括休闲活动。给予参与者记录其日常活动的自由，而不是指定严格的 ADL 列表，使我们能够实现两个重要目标:第一，我们确保活动以类似自然条件的方式进行:第二，确保以类似自然条件的方式进行活动:第三，确保以类似自然条件的方式进行活动:第三，确保以类似自然条件的方式进行活动。第四第二，我们能够记录各种各样的活动。然而，参与者意识到他们头上的摄像头的存在，这种感觉可能促使他们中的一些人记录的活动比他们的正常程序多。
为了在自然生活条件中实现高效和有意义的视频数据收集，我们必须在录像录制前提供给参与者的指南和信息中找到一个平衡点。给最有趣的活动太多方向来记录可能导致参与者只记录这些活动，从而无法捕捉他们的日常程序和自然 ADL 的表现。另一方面，不提供足够的信息可能会导致参与者的困惑，他们可能没有录制足够的视频或对研究失去兴趣。为了解决这些问题，并为成功的数据收集找到最佳权衡，必须与参与者进行彻底的培训，以便了解他们的日常工作，并确保他们清楚地了解研究的目的，而此处的重点是记录他们的自然程序，而不是收集一套标准的活动。
可确定拟议协议的三个限制。首先，有认知问题的人可能难以回忆他们的日常生活或学习如何使用设备。其次，手部功能低下的个人可能需要护理人员帮助在家里设置录音。第三，由于参与者有机会修剪或删除记录，因此他们可能会删除 ADL 不成功的例子并偏向获得的数据。然而，由于记录的 ADL 由参与者定期执行，因此他们通常制定了成功执行任务的战略，因此不太可能实现这种可能性。仔细传达使用此协议的目标是捕获典型的 ADL 性能，并且预期功能的变化可能会降低参与者修剪不成功任务的欲望。
收集自然 ADL 的视频对于了解家中手部损伤个体的手部功能至关重要。从收集的视频中，研究人员和临床医生能够看到在家执行的典型任务、在这些任务中使用手，以及在对象操作过程中采用的手姿势和补偿策略。从视频中获得的信息在康复方面很有价值，并且能够开发创新和智能的工具，用于自动分析家庭手部功能。事实上，计算机视觉算法的开发旨在量化手的使用（例如，每只手的手物体相互作用的数量和持续时间）在个人与csCI和中风16，17，18。随着计算机视觉技术的不断完善，以自我为中心的手分析和更多的视频数据收集，其他细节的手操作的质量也可以获得20。最终，目前的协议和现有的技术将导致对生活在社区中的上肢损伤者使用手的全面描述，最终目标是优化他们的恢复和提高他们的生活质量。

手部功能是决定上肢损伤1、2的临床人群的独立性和生活质量。掌握家庭手部损伤者的手部功能对于评估他们在康复期间和康复后开展日常生活活动的能力的进展至关重要。大多数临床手部功能评估是在临床或实验室环境中进行的，而不是在家里进行的。现有的临床手部功能评估，试图捕捉对国内ADL的影响是问卷，并依靠主观自我报告的评分5，6，7。目前尚无法进行客观评估，以评估康复对家庭手部功能的最终影响。
近年来，许多可穿戴技术已经开发和实施，以捕捉上肢功能在现实世界中的环境。可穿戴传感器（如加速度计和惯性测量单元 （IMUs） 通常用于测量日常生活中的上肢运动。然而，这些设备通常不能区分检测到的年代是否属于功能上肢运动8，9，定义为有目的的运动，旨在完成所需的任务。例如，一些可穿戴传感器对行走过程中上肢摆动的存在很敏感，而上肢不是功能运动。此外，虽然手腕磨损的加速度计可以捕捉上肢运动，但在真实环境中，它们无法捕捉到手部功能的细节。感应手套可以捕获有关手部操作的更详细的信息，但是对于手部功能和感觉已经受损的人来说，它们可能很麻烦。此外，亦有人提出可穿戴方法，透过磁力测量仪或手指磨损加速度计11、12、13捕捉手指运动，但这些运动的功能解释仍具挑战性。因此，虽然以前提出的可穿戴设备体小且使用方便，但不足以描述手部使用的细节和功能背景。
已建议可穿戴相机，以填补这些空白，并捕捉手功能的细节，在家里的ADL神经恢复应用15，16，17，18，19。使用计算机视觉对以自我为中心的视频进行自动分析，通过提供有关手本身和实际 ADL20中执行的任务的信息，具有相当大的潜力，可以量化上下文中的手功能。另一方面，根据电池、存储和舒适性考虑，连续录制的持续时间通常限制在大约 1 到 1.5 小时。在这里，在这些限制下，我们提出了一个以自我为中心的视频收集协议，旨在获得既能代表个人日常生活的数据，又能提供手功能评估的信息。

<table><tbody><tr><td>Egocentric camera</td><td>GoPro Inc., CA, USA</td><td>GoPro Hero 4 and 5</td><td>A camera that records from a first-person angle.</td></tr><tr><td>Battery chager and batteries</td><td>GoPro Inc., CA, USA</td><td>MAX Dual Battery Charger + Battery</td><td>Extra batteries for the camera and battery charger</td></tr><tr><td>Camera charger</td><td>GoPro Inc., CA, USA</td><td>Supercharger</td><td>This charger is connected to the camera directly without disassembling the camera frame.</td></tr><tr><td>Camera frame</td><td>GoPro Inc., CA, USA</td><td>The Frame</td><td>The hinge of the camera frame can be used to adjust the angle of view of the camera.</td></tr><tr><td>Headband for the camera</td><td>GoPro Inc., CA, USA</td><td>Head Strap + QuickClip</td><td></td></tr><tr><td>SD card</td><td>SanDisk, CA, USA</td><td>32GB microSD</td><td></td></tr><tr><td>Tablet</td><td>ASUSTeK Computer Inc., Taiwan</td><td>ZenPad 8.0 Z380M</td><td>The tablet is installed with the GoPro App in order to connect with the camera.</td></tr></tbody></table>

capturing representative hand use at home using egocentric video in individuals with upper limb impairment

神经损伤后手部功能受损会对独立性和生活质量产生重大影响。大多数现有的上肢评估都是亲自进行的，这并不总是表明在社区中使用手。需要采用新的方法来捕捉日常生活中的手部功能，以衡量康复干预的真正影响。已建议将以Ego为中心的视频与计算机视觉相结合，用于自动分析，以评估家庭使用手部。但是，连续录音的持续时间有限。我们提出了一个协议，旨在确保获得的视频代表日常生活，同时尊重参与者的隐私。 
通过研究人员和参与者之间的协作过程选择具有代表性的录制时间表，以确保视频捕捉自然任务和性能，同时对手部评估有用。向与会者演示设备和程序的使用情况。总共安排了两周的3小时录像。为了减少隐私问题，参与者可以完全控制开始和停止录制，并有机会在将视频返回给研究团队之前编辑视频。提供提醒，如有必要，还提供帮助电话和家访。 
该方案对9名中风幸存者和14名颈椎损伤患者进行了测试。获得的录像包含各种活动，如准备膳食、洗碗和编织。平均获得3.11±0.98小时的视频。由于在某些情况下生病或意外事件，录制时间从 12-69 d 不等。从23名参与者中的22名成功获得数据，其中6名参与者在家庭录音期间需要调查人员的协助。该协议是有效的收集视频，包含宝贵的信息，手功能在家里后神经损伤。

参与者人口统计学和包容性标准 为这些研究招募了23名参与者的样本:9名中风幸存者（6名男性，3名女性）和14名患有csCI（12名男性，2名女性）。招聘样本的人口统计学和临床信息摘要报告在 表1中。
<table border="1" fo:keep-together.within-page="always"><tbody>
<tr>
<td rowspan="2"></td>
			<td rowspan="2">年龄（年）</td>
			<td rowspan="2">受伤后的持续时间（月）</td>
			<td rowspan="2">病因学</td>
			<td colspan="2">伤害程度</td>
			<td colspan="2">上肢功能评估（平均±SD）</td>
		</tr>
<tr>
<td>伤害程度</td>
			<td>艾斯</td>
			<td>UEMS:右手</td>
			<td>UEMS:左手</td>
		</tr>
<tr>
<td rowspan="2">cSCI （N=14）</td>
			<td rowspan="2">55.9 ± 7.1</td>
			<td rowspan="2">56.4 ± 58.9</td>
			<td>12 创伤</td>
			<td rowspan="2">C4 或 C8</td>
			<td rowspan="2">A 或 D</td>
			<td rowspan="2">18.1 ± 6.2</td>
			<td rowspan="2">18.6 ± 6.4</td>
		</tr>
<tr>
<td>2 非创伤性</td>
		</tr>
<tr>
<td rowspan="2">中风 （N=9）</td>
			<td rowspan="2">56.8 ± 19.3</td>
			<td rowspan="2">94.4 ± 134.4</td>
			<td>5 缺血</td>
			<td rowspan="2"></td>
			<td rowspan="2"></td>
			<td>FMA-UE:受影响的手</td>
			<td>阿拉特:受影响的手</td>
		</tr>
<tr>
<td>4 出血</td>
			<td>45.6 ± 17.3</td>
			<td>37.1 ± 19.1</td>
		</tr>
<tr>
<td colspan="8">AIS:亚洲减值规模;UEMS: 上肢电机得分</td>
		</tr>
<tr>
<td colspan="8">FMA-UE:富格尔-迈耶上肢评估;阿拉特:动作研究手臂测试</td>
		</tr>
</tbody></table>表1。被招募参与者的人口统计学和临床信息。
在这些研究中，两组人的相互包容标准是:1）18岁以上，2）手部功能受损但并非缺失:3）没有影响上肢运动的其他神经肌肉骨骼疾病:4）上肢关节无畸形:5）上肢运动时无疼痛。两组的附加包容标准如下。
对于患有 cSCI 的个人:1） 根据脊髓损伤神经分类国际标准 C4 和 C8 之间的神经损伤水平（ISNCSCI），2） 美国脊髓损伤协会损伤等级 （AIS） A-D 级。3） 创伤性或非创伤性损伤，4） 至少一个肢体在 10 到 23 岁之间的单边 ISNCSCI 上肢运动评分 （UEMS）。
对于中风患者:1） 中风后至少 6 个月，2） 行动研究手臂测试 （ARAT） 的总分大于 10， 3） 蒙特利尔认知评估 （MoCA） 得分超过 21，以避免理解和遵循学习程序的潜在困难。
录制视频的内容和长度 此处提供的分析视频来自 23 名参与者中的 22 名。其余参与者（cSCI 患者）在与研究团队失去联系近 6 个月后返回相机，但未包含在分析的其余部分中。因此，拟议议定书对95.7%的与会者来说是成功的。参与者平均记录了5项以上活动。录像中包括的活动包括准备膳食、吃饭、洗碗、身体活动和编织（图2）。在丢弃了其他未提供同意或根本不可用数据（例如，将摄像机留在桌子上录制）的片段后，每个参与者平均获得 3.11 ± 0.98 小时的视频。此外，每位参与者的每日平均视频录制时间为60±33分钟。三名参与者因病推迟了录音。大多数参与者按照商定的时间表录制视频，但他们报告说，由于相机的重量和额头上的热量，佩戴相机超过 1 小时会感到疲倦和不舒服。计划在必要时完成 3 小时视频持续时间目标的其他录制。获得3小时视频所需的平均录制时间为22.3±12.9d。录制时间从 12 到 69 d 不等，从参与者获得相机的那天到他们返回相机的那天算起。在 4 种情况下，由于健康状况或日程安排限制，获得的视频长度低于 3 h 目标。由于家庭责任，两名参与者花了2个多月时间录制了2小时的视频。另一位参与者在两周内录制了近 2 小时的视频，然后由于旅行计划而决定返回摄像机。另一位参与者意外地删除了所有录制的视频，在安排其他录制后，由于家庭责任，只能提供 1 小时的视频。
除了持续时间的变化，手的能见度也影响了视频的质量。一些记录的活动没有清楚地显示手，如体能训练和在头顶柜中伸手寻找物体。两名中风参与者的双手未在 3 个 ADL 中显示。在体能训练方面，一名参与者使用弹性带进行上肢练习，并在后院打网球。视频中的手并不总是可见的，因为手臂运动又大又快。除了需要上肢运动的活动外，大多数记录的 ADL 是在腰部和肩部之间的工作空间内进行的，手在录音中可见。
<img alt="Equation Figure 2" class="xfigimg" src="/files/ftp_upload/61898/61898fig02.jpg" style="font-size: 14px;"> 图2。从获得的视频中经常录制的两个 ADL 示例。 （A） 膳食准备。 （B）洗碗。<a href="https://www-jove-com.bdigitaluss.remotexs.co/files/ftp_upload/61898/61898fig02large.jpg" style="font-size: 14px;" target="_blank">请单击此处查看此图的较大版本。</a>
需要的援助 在22名参与者中，有6人（27%）需要研究小组在家中录音期间的帮助。平均每个帮助电话需要 5-10 分钟。无需家访。遇到的困难涉及更换电池、蓝牙连接、Wi-Fi 连接、查看和修剪平板电脑上的视频以及控制平板电脑上的录制。为了解决这些问题，采取了以下战略:
由于更换电池对于手部功能受损的个人来说可能很困难，研究人员建议使用充电电缆为相机充电。对于与相机平板电脑连接相关的技术问题（例如 Wi-Fi 和蓝牙问题），以及平板电脑上的视频审查，研究人员口头指导参与者逐步完成相关程序。对于与修剪视频相关的问题，当参与者亲自将视频返回给研究人员以避免无意中删除其他录制的视频时，提供了帮助。如果参与者无法使用平板电脑启动和停止录制，则被告知仅使用相机，单击录制按钮来控制视频录制的开始和停止。
隐私问题 与先前的调查结果21一致，大多数参与者及其家庭成员没有报告有关在家记录ADL的隐私问题。参与者的一名家庭成员不愿意被纳入视频，参与者能够避免这种情况。总共有一名参与者协助修剪返回的视频。将在其他地方报告对参与者对收集以自我为中心的视频的看法的定性分析，但是，隐私方面的考虑并没有给这些研究的数据收集带来任何障碍。在本协议中，为了避免公共场所的隐私问题，在家庭环境中记录了 ADL。除参与者外，15名旁观者（包括照顾者和家庭成员）也被列入返回的录像中，并同意将他们列入研究。在录像中包括的15名旁观者中，有6人由于没有露面而无法辨认。此外，来自2名中风参与者家庭成员的约20分钟视频被丢弃，因为部分视频在未经他们同意的情况下展示了他们的脸。
补充材料。 <a href="https://www-jove-com.bdigitaluss.remotexs.co/files/ftp_upload/61898/Supplemental%20Files%20-%20Final%20-%20Clean.docx" style="font-size: 14px;" target="_blank">请点击这里下载此文件。</a>

Watch this Scientific Journal Video about Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment at JoVE.com

Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment

建议使用以自我为中心的相机捕捉手部损伤个体在日常生活中的自然手部功能。该协议的目标是确保录音代表个人在日常生活中通常使用的手。

捕捉代表手在家里使用以自我为中心的视频在个人与上肢损伤

Impaired hand function after neurological injuries can have a major impact on independence and quality of life. Most existing upper limb assessments are ...

capturing-representative-hand-use-at-home-using-egocentric-video

Universidad San Sebastian

Research

JoVE Journal

Bioengineering

2.5K 次观看.  University of Toronto. 建议使用以自我为中心的相机捕捉手部损伤个体在日常生活中的自然手部功能。该协议的目标是确保录音代表个人在日常生活中通常使用的手。

视频: Capturing Representative Hand Use at Home Using Egocentric Video in Individuals with Upper Limb Impairment

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

As far as acquiring motor skills is concerned, training by voluntary physical movement is superior to all other forms of training (e.g. training by observation or passive movement of trainee&#39;s hands by a robotic device). This obviously presents a major challenge in the rehabilitation of a paretic limb since voluntary control of physical movement is limited. Here, we describe a novel training scheme we have developed that has the potential to circumvent this major challenge. We exploited the voluntary control of one hand and provided real-time movement-based manipulated sensory feedback as if the other hand is moving. Visual manipulation through virtual reality (VR) was combined with a device that yokes left-hand fingers to passively follow right-hand voluntary finger movements. In healthy subjects, we demonstrate enhanced within-session performance gains of a limb in the absence of voluntary physical training. Results in healthy subjects suggest that training with the unique VR setup might also be beneficial for patients with upper limb hemiparesis by exploiting the voluntary control of their healthy hand to improve rehabilitation of their affected hand.

We describe a novel virtual-reality based setup which exploits voluntary control of one hand to improve motor-skill performance in the other (non-trained) hand. This is achieved by providing real-time movement-based sensory feedback as if the non-trained hand is moving. This new approach may be used to enhance rehabilitation of patients with unilateral hemiparesis.

利用虚拟现实技术将运动技能知识从一只手转移到另一个

As far as acquiring motor skills is concerned, training by voluntary physical movement is superior to all other forms of training (e.g. training by ...

科研

行为学

Frame-by-Frame Video Analysis of Idiosyncratic Reach-to-Grasp Movements in Humans

Prehension, the act of reaching to grasp an object, is central to the human experience. We use it to feed ourselves, groom ourselves, and manipulate objects and tools in our environment. Such behaviors are impaired by many sensorimotor disorders, yet our current understanding of their neural control is far from complete. Current technologies for investigating human reach-to-grasp movements often utilize motion tracking systems that can be expensive, require the attachment of markers or sensors to the hands, impede natural movement and sensory feedback, and provide kinematic output that can be difficult to interpret. While generally effective for studying the stereotypical reach-to-grasp movements of healthy sighted adults, many of these technologies face additional limitations when attempting to study the unpredictable and idiosyncratic reach-to-grasp movements of young infants, unsighted adults, and patients with neurological disorders. Thus, we present a novel, inexpensive, and highly reliable yet flexible protocol for quantifying the temporal and kinematic structure of idiosyncratic reach-to-grasp movements in humans. High speed video cameras capture multiple views of the reach-to-grasp movement. Frame-by-frame video analysis is then used to document the timing and magnitude of pre-defined behavioral events such as movement start, collection, maximum height, peak aperture, first contact, and final grasp. The temporal structure of the movement is reconstructed by documenting the relative frame number of each event while the kinematic structure of the hand is quantified using the ruler or measure function in photo editing software to calibrate 2 dimensional linear distances between two body parts or between a body part and the target. Frame-by-frame video analysis can provide a quantitative and comprehensive description of idiosyncratic reach-to-grasp movements and will enable researchers to expand their area of investigation to include a greater range of naturalistic prehensile behaviors, guided by a wider variety of sensory modalities, in both healthy and clinical populations.

This protocol describes how to use frame-by-frame video analysis to quantify idiosyncratic reach-to-grasp movements in humans. A comparative analysis of reaching in sighted versus unsighted healthy adults is used to demonstrate the technique, but the method can also be applied to the study of developmental and clinical populations.

人体特异 Reach-to-Grasp 运动的帧-帧视频分析

Prehension, the act of reaching to grasp an object, is central to the human experience. We use it to feed ourselves, groom ourselves, and manipulate ...

Measuring the Kinematics of Daily Living Movements with Motion Capture Systems in Virtual Reality

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based assessments of IADL are easy to use but prone to subjective bias. Here, we describe a novel virtual reality (VR) test to assess two complex IADL tasks: handling financial transactions and using public transportation. While a participant performs the tasks in a VR setting, a motion capture system traces the position and orientation of the dominant hand and head in a three-dimensional Cartesian coordinate system. Kinematic raw data are collected and converted into &#39;kinematic performance measures,&#39; i.e., motion trajectory, moving distance, and time to completion. Motion trajectory is the path of a particular body part (e.g., dominant hand or head) in space. Moving distance refers to the total distance of the trajectory, and time to completion is how long it took to complete an IADL task. These kinematic measures could discriminate patients with cognitive impairment from healthy controls. The development of this kinematic measuring protocol allows detection of early IADL-related cognitive impairments.

We designed a virtual reality test to assess instrumental activities of daily living (IADL) with a motion capture system. We propose a detailed kinematic analysis to interpret the participant&#39;s various movements, including trajectory, moving distance, and time to completion to evaluate IADL capabilities.

虚拟现实中运动捕捉系统的日常生活运动运动学测量

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based ...

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

This work describes a methodological framework that can be used to explicitly and implicitly characterize the sense of agency developed over the neural-machine interface (NMI) control of sensate virtual or robotic prosthetic hands. The formation of agency is fundamental in distinguishing the actions that we perform with our limbs as being our own. By striving to incorporate advanced upper-limb prostheses into these same perceptual mechanisms, we can begin to integrate an artificial limb more closely into the user&#39;s existing cognitive framework for limb control. This has important implications in promoting user acceptance, use, and effective control of advanced upper-limb prostheses. In this protocol, participants control a virtual prosthetic hand and receive kinesthetic sensory feedback through their preexisting NMIs. A series of virtual grasping tasks are performed and perturbations are systematically introduced to the kinesthetic feedback and virtual hand movements. Two separate measures of agency are employed: established psychophysical questionnaires (to capture the explicit experience of agency) and a time interval estimate task to capture the implicit sense of agency (intentional binding). Results of this protocol (questionnaire scores and time interval estimates) can be analyzed to quantify the extent of agency formation.

Here we present a protocol which characterizes the sense of agency developed over the control of sensate virtual or robotic prosthetic hands. Psychophysical questionnaires are employed to capture the explicit experience of agency, and time interval estimates (intentional binding) are employed to implicitly measure the sense of agency.

神经机台面假体作用的代理感特征

This work describes a methodological framework that can be used to explicitly and implicitly characterize the sense of agency developed over the ...

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum

The objective analysis of eye movements has a significant history and has been long proven to be an important research tool in the setting of brain injury. Quantitative recordings have a strong capacity to screen diagnostically. Concurrent examinations of the eye and upper limb movements directed toward shared functional goals (e.g., eye-hand coordination) serve as an additional robust biomarker-laden path to capture and interrogate neural injury, including acquired brain injury (ABI). While quantitative dual-effector recordings in 3-D afford ample opportunities within ocular-manual motor investigations in the setting of ABI, the feasibility of such dual recordings for both eye and hand is challenging in pathological settings, particularly when approached with research-grade rigor. Here we describe the integration of an eye tracking system with a motion tracking system intended primarily for limb control research to study a natural behavior. The protocol enables the investigation of unrestricted, three-dimensional (3D) eye-hand coordination tasks. More specifically, we review a method to assess eye-hand coordination in visually guided saccade-to-reach tasks in subjects with chronic middle cerebral artery (MCA) stroke and compare them to healthy controls. Special attention is paid to the specific eye- and limb-tracking system properties in order to obtain high fidelity data from participants post-injury. Sampling rate, accuracy, permissible head movement range given anticipated tolerance and the feasibility of use were several of the critical properties considered when selecting an eye tracker and an approach. The limb tracker was selected based on a similar rubric but included the need for 3-D recording, dynamic interaction and a miniaturized physical footprint. The quantitative data provided by this method and the overall approach when executed correctly has tremendous potential to further refine our mechanistic understanding of eye-hand control and help inform feasible diagnostic and pragmatic interventions within the neurological and rehabilitative practice.&#160;

Cerebral injury can damage both ocular and somatic motor systems. Characterization of motor control post-injury affords biomarkers that assist in disease detection, monitoring, and prognosis. We review a method to measure eye-hand movement control in health and in pathologic incoordination, with look-and-reach paradigms to assess coordination between eye and hand.

有效地记录不协调谱的眼手协调

The objective analysis of eye movements has a significant history and has been long proven to be an important research tool in the setting of brain ...

Virtual Hand with Ambiguous Movement between the Self and Other Origin: Sense of Ownership and 'Other-Produced' Agency

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will and action (sense of agency; SoA) have been recognized as the basis of our bodily self-consciousness. Previously, the illusory SoO over a fake body part (e.g., rubber hand) was introduced as the rubber hand illusion (RHI). Furthermore, it was determined that one could also evoke a SoA over an object with movements linked to the one&#8217;s prior intention. On the other hand, the postdictivity of our spontaneity implies that it is essentially inseparable whether actions originate from self or others. In other words, our SoA or daily experiences are obtained in such as inseparable scenario. Previous research, however, has maintained the premise that self- and other-origin movements are perceptually distinguishable. Here, we implement a protocol to make these aspects ambiguous for the participants and to estimate whether they can feel SoO and/or SoA and how. To this end, we employ an experiment using virtual reality, under which participants observe virtual fingers moving very slowly (or quickly or not moving) while their own fingers do not move. For evaluation of the illusory SoO, measurements of skin conductance responses against a knife threat are adopted. Additionally, we introduce face-to-face interviews to determine whether the feelings regarding the slow movement match the conventional SoA definition. Our representative results suggest that the SoO is evoked over the hand, and various attitudes to accept its movement as the participant&#8217;s own with awareness that they did not originate it are reported by the majority. As the results show, the novelty of this protocol is discovering that in such a situation, the SoO cooperates with an externally produced SoA to establish one&#8217;s own bodily experience rather than the independence of the SoO and SoA.

While previous research on bodily self-consciousness assumed that self- and other-origin movements were perceptually distinguishable, this protocol allows them to be ambiguous on a virtual hand with unintentional slight movements. This enables us to observe one&#8217;s experience formed by SoO and other-produced SoA, rather than the absence of SoA.

自我与其他起源之间模棱两可的虚拟手:主人翁感和"其他生产"机构

The feeling that a body part is one&#8217;s own body (sense of ownership; SoO) and the feeling based on the causal relationship between one&#8217;s will ...

Kinematic Analysis Using 3D Motion Capture of Drinking Task in People With and Without Upper-extremity Impairments

Kinematic analysis is a powerful method for objective assessment of upper extremity movements in a three-dimensional (3D) space. Three-dimensional motion capture with an optoelectronic camera system is considered as golden standard for kinematic movement analysis and is increasingly used as outcome measure to evaluate the movement performance and quality after an injury or disease involving upper extremity movements. This article describes a standardized protocol for kinematic analysis of drinking task applied in individuals with upper extremity impairments after stroke. The drinking task incorporates reaching, grasping and lifting a cup from a table to take a drink, placing the cup back, and moving the hand back to the edge of the table. The sitting position is standardized to the individual&#39;s body size and the task is performed in a comfortable self-paced speed and compensatory movements are not constrained. The intention is to keep the task natural and close to a real-life situation to improve the ecological validity of the protocol. A 5-camera motion capture system is used to gather 3D coordinate positions from 9 retroreflective markers positioned on anatomical landmarks of the arm, trunk, and face. A simple single marker placement is used to ensure the feasibility of the protocol in clinical settings. Custom-made Matlab software provides automated and fast analyses of movement data. Temporal kinematics of movement time, velocity, peak velocity, time of peak velocity, and smoothness (number of movement units) along with spatial angular kinematics of shoulder and elbow joint as well as trunk movements are calculated. The drinking task is a valid assessment for individuals with moderate and mild upper extremity impairment. The construct, discriminative and concurrent validity along with responsiveness (sensitivity to change) of the kinematic variables obtained from the drinking task have been established.

This protocol describes an objective method to evaluate the movement performance and sensorimotor function of the upper extremity applied to individuals with stroke and healthy controls. A standardized test procedure, kinematic analysis and outcome variables for three-dimensional motion capture of drinking task are provided.

用3D 运动捕捉对无上肢损伤患者饮酒任务的运动学分析

Kinematic analysis is a powerful method for objective assessment of upper extremity movements in a three-dimensional (3D) space. Three-dimensional motion ...

神经科学

Development of a Novel Task-oriented Rehabilitation Program using a Bimanual Exoskeleton Robotic Hand

A robot-assisted hand is used for the rehabilitation of patients with impaired upper limb function, particularly for stroke patients with a loss of motor control. However, it is unclear how conventional occupational training strategies can be applied to the use of rehabilitation robots. Novel robotic technologies and occupational therapy concepts are used to develop a protocol that allows patients with impaired upper limb function to grasp objects using their affected hand through a variety of pinching and grasping functions. To conduct this appropriately, we used five types of objects: a peg, a rectangular cube, a cube, a ball, and a cylindrical bar. We also equipped the patients with a robotic hand, the Mirror Hand, an exoskeleton&#160;hand that is fitted to the subject&#8217;s affected hand and follows the movement of the sensor glove fitted to their unaffected hand (bimanual movement training (BMT)). This study had two stages. Three healthy subjects were first recruited to test the feasibility and acceptability of the training program. Three patients with hand dysfunction caused by stroke were then recruited to confirm the feasibility and acceptability of the training program, which was conducted on 3 consecutive days. On each day, the patient was monitored during 5 min of movement in a passive range of motion, 5 min of robot-assisted bimanual movement, and task-oriented training using the five objects. The results showed that both healthy subjects and subjects who had suffered a stroke in conjunction with the robotic hand could successfully grasp the objects. Both healthy subjects and those who had suffered a stroke performed well with the robot-assisted task-oriented training program in terms of feasibility and acceptability.

This study reports the development of a novel robot-assisted task-oriented program for hand rehabilitation. The developmental process consists of experiments using both healthy subjects and subjects who have had a stroke and suffered from subsequent motor control dysfunction.

使用双骨外骨骼机器人手开发面向任务的新康复计划

A robot-assisted hand is used for the rehabilitation of patients with impaired upper limb function, particularly for stroke patients with a loss of motor ...

医学

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Finger gestures are a critical element in human communication, and as such, finger gesture recognition is widely studied as a human-computer interface for state-of-the-art prosthetics and optimized rehabilitation. Surface electromyography (sEMG), in conjunction with deep learning methods, is considered a promising method in this domain. However, current methods often rely on cumbersome recording setups and the identification of static hand positions, limiting their effectiveness in real-world applications. The protocol we report here presents an advanced approach combining a wearable surface EMG and finger&#160;tracking system to capture comprehensive data during dynamic hand movements. The method records muscle activity from soft printed electrode arrays (16 electrodes) placed on the forearm as subjects perform gestures in different hand positions and during movement. Visual instructions prompt subjects to perform specific gestures while EMG and finger positions are recorded. The integration of synchronized EMG recordings and finger tracking data enables comprehensive analysis of muscle activity patterns and corresponding gestures. The reported approach demonstrates the potential of combining EMG and visual tracking technologies as an important resource for developing intuitive and responsive gesture recognition systems with applications in prosthetics, rehabilitation, and interactive technologies. This protocol aims to guide researchers and practitioners, fostering further innovation and application of gesture recognition in dynamic and real-world scenarios.

The paper presents a comprehensive protocol for simultaneously recording hand-electromyography (EMG) and visual finger tracking during natural finger gesturing. The visual data is designed to serve as the ground truth for the development of accurate EMG-based computational models for finger gesture recognition.

使用高分辨率表面肌电图和计算机视觉捕捉动态手指手势

Finger gestures are a critical element in human communication, and as such, finger gesture recognition is widely studied as a human-computer interface for ...

生物工程

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients

This study introduces a Brain-Computer Interface (BCI)-controlled upper limb assistive robot for post-stroke rehabilitation. The system utilizes electroencephalogram (EEG) and electrooculogram (EOG) signals to help users assist upper limb function in everyday tasks while interacting with a robotic hand. We evaluated the effectiveness of this BCI-robot system using the Berlin Bimanual Test for Stroke (BeBiTS), a set of 10 daily living tasks involving both hands. Eight stroke patients participated in this study, but only four participants could adapt to the BCI robot system training and perform the postBeBiTS. Notably, when the preBeBiTS score for each item was four or less, the BCI robot system showed greater assistive effectiveness in the postBeBiTS assessment. Furthermore, our current robotic hand does not assist with arm and wrist functions, limiting its use in tasks requiring complex hand movements. More participants are required to confirm the training effectiveness of the BCI-robot system, and future research should consider using robots that can assist with a broader range of upper limb functions. This study aimed to determine the BCI-robot system's ability to assist patients in performing daily living activities.

This study introduces a brain-computer interface (BCI) system for stroke patients, which combines electroencephalography and electrooculography signals to control an upper limb robotic hand, enhancing daily activities. The evaluation used the Berlin Bimanual Test for Stroke (BeBiTS).