Goals

Tentative Timeline

April 2018

Planning; determine earmarked data and deliverables (group)

May-June 2018

Development of process documentation; write specifications (individual teams)

July 2018

Delivery of process documentation; specifications submitted to AE by individual teams; review for completeness (group)

August 2018 - March 2019

Execution of activities faithful to specifications (individual teams); process documentation of protocol deviations (individual teams)

April 2019

Delivery of M&S outputs and documentation (individual teams); delivery of protocol deviations (individual teams); all material submitted to AE; review for completeness (group); packaging for comparative analysis (group)

Earmarked Data

oks003 from Open Knee(s):

DU02 from Natural Knee Data:

Start with

Simulation Case

Passive flexion

Deliverables

Modeling & Simulation Process Outputs

Intermediate and Final M&S Outputs

Documentation of M&S Outputs

Process Documentation

Specifications

Protocol Deviations

Package for Comparative Analysis

Guidance

Where to get the Earmarked Data?

How to prepare and submit Specifications?

Specifications are concerned about documentation of processes to transform earmarked data to M&S outputs. This information is intended to be provided separately for processing of both data sets to capture nuances in response to variable data content and quality. This documentation will be provided before execution of Model Development activities to demonstrate the path each modeling team has chosen. It should be in a detail such that other modeling teams can follow the steps to reproduce M&S outputs. When possible, justifications to support modeling & simulation decisions should be provided.

Content

Each team will submit two sets of documents, one for Model Development using Open Knee(s) data and another for Model Development using Natural Knee data. Each set will include the source document, i.e., in preferred format that it is written, and as a PDF copy.

How to prepare and submit Protocol Deviations?

It is likely that initial specifications may need to be modified to accomplish Model Development activities. These modifications, i.e. Protocol Deviations, should be documented during Model Development activities. Each protocol deviation should include information to understand who did, what and when, and why. The documentation should be in a detail such that other modeling teams can utilize along with specifications to reproduce M&S outputs. Protocol Deviations will be collated in two sets of documents (one for using Open Knee(s) data and another for Natural Knee data). The documents will be provided before execution of Model Development activities in source form, i.e., in preferred format that it is written, and as a PDF copy.

How to curate, document and submit Modeling and Simulation Outputs?

All M&S outputs (intermediate and final) should be provided in their preferred format, i.e., accommodating individual teams workflow. Each team should provide two packages (one for Open Knee(s) data and another for Natural Knee data) as a compressed archive (e.g. zip). An accompanying document should describe M&S outputs. This information should focus on i) file descriptors and formats, and folder organization to help navigate the provided content and ii) what actually each M&S output is (NOT how they are obtained). The latter should be reflective of the description of target intermediate and final M&S products of Specifications. It should also be indicative of necessary information for other modeling teams to judge the nature and extent of the provided content.

Preparing a package for Comparative Analysis

All material may need to be reorganized and converted to response to third-party requirements for comparative analysis. Nonetheless, this should not prevent individual M&S teams to personalize their workflows and documentation style.

References

Erdemir, A., Mulugeta, L. and Lytton, W. W. Ten “not so” simple rules for credible practice of modeling and simulation in healthcare: a multidisciplinary committee perspective, 2015 Biomedical Engineering Society / Food and Drug Administration Frontiers in Medical Devices Conference: Innovations in Modeling and Simulation, May 18-20, 2015, Washington, DC. Available at: https://simtk.org/svn/cpms/doc/posters/fmd_2015.pdf.

Erdemir, A., Guess, T. M., Halloran, J. P., Tadepalli, S. C. and Morrison, T. M. (2012) Considerations for reporting finite element analysis studies in biomechanics, Journal of Biomechanics, 45, 625-633. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3278509/.

U.S. Food and Drug Administration. Reporting of Computational Modeling Studies in Medical Device Submissions. Available at: https://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/UCM381813.

NASA-STD-7009: Standard for Models and Simulations. Available at: https://standards.nasa.gov/standard/nasa/nasa-std-7009.

ASME V&V American Society of Mechanical Engineers - Committee Pages - V&V 40 Verification and Validation in Computational Modeling of Medical Devices. Available at: https://cstools.asme.org/csconnect/CommitteePages.cfm?Committee=100108782.