Inquiring about work combining OpenSim with cognitive models

[Michel Audette]

Dear members of the OpenSim community,

I took part in a DARPA conference, and I have a project idea that would leverage OpenSim toward human performance simulation, in conjunction with motion capture of an operator interacting with a complex system, also simulated, such as an aircraft or drone controller. Moreover, I would like to also integrate a cognitive model of some kind, possibly coupled with the OpenSim-MoCap driven musculoskeletal (MS) operator simulation. Someone sleep-deprived or malevolent should interact with the system differently than someone well-rested and using the system as intended. The cognition model might be ACT-R or something comparable.

Is this community aware of coupled simulation of a human that encapsulates both the functional (MS) operator component used interoperably with a cognitive or behavior model of some kind? I would appreciate information on any such coupled model.

Thanks for your consideration.

Prof. Michel Audette
Old Dominion University

[Thomas Uchida]

There are a couple examples in the "Example 3: Neural control" section of this paper: Seth A, et al. OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement. PLOS Computational Biology, 14(7):e1006223, 2018. https://doi.org/10.1371/journal.pcbi.1006223