Collaborators Meeting
Date: February 17, 2020
Time: 3:00 PM US/Eastern
Means: Skype
Attendees:
- Jason Halloran (WSU)
- Will Zaylor (CSU)
- Ammar Hafez (CSU)
- Carl Imhauser (HSS)
- Shady Elmasry (HSS)
- Kevin Shelburne (DU)
- Peter Laz (DU)
- Donald Hume (DU)
- Thor Besier (ABI)
- Nynke Rooks (ABI)
- Ahmet Erdemir (CC)
- Ariel Schwartz (CC)
- Neda Abdollahi (CC)
Agenda:
- ORS 2020 - RIG recap.
- Abstract for IMAG/MSM.
- Update on manuscripts.
- Model Calibration progress.
- Review of previous action items.
- Other business.
Immediate Action Items:
- Ahmet
- Submit ORS 2020 IRG report.
- Jason
- Prepare and submit IMAG/MSM 2020 abstract.
- Carl
- Reach out to ORS Sections to learn about their experiences in crosstalk between sections.
Nynke & Thor
- Circulate outline and figures for manuscripts on Model Development phase.
- All
- Keep on working on Model Calibration.
Notes:
- The team organized a Research Interest Group (RIG) in the Orthopaedic Research Society (ORS) meeting in the past week.
- Ahmet summarized the outcomes. The theme was F.A.I.R.ness and credibility in computational biomechanics. Shady summarized the outcomes of workshop on reproducibility, that was organized in ORS 2019. Ahmet talked about topics related to F.A.I.R.ness and credibility. A lively panel discussion ensued. A survey was distributed to an estimated audience of ~70; 58 responses were collected. Participants has an interest in increased visibility of computational biomechanics in ORS and engaged with the panelists (across from all spectrum of academic career from our teams) to understand their experiences in adopting good practices.
- Carl noted that from sections perspective, a computational biomechanics section may be like the preclinical models (animals) section, i.e. being cross-platform. Carl noted that they work with the meniscus section. He can follow up how that crosstalk worked. He will reach out to Suzanne Maher in this regard. Jason noted that if RIG snowballs into a section, we should be ready to do it at that level. They also discussed how much ORS will support this and what the succession plan will be. Overall, the knee modeling teams noted that if there is support and the process is relatively convenient, they can see it happening. Carl mentioned that support for sections is mostly room and logistics. Thor indicated ORS as a challenging venue, on one hand, it has clinical value but it is not engaged with depth and detail of modeling. Thor asked for the main goal and purpose of a section. Carl summarized the rationale of how these sections evolved, i.e. they evolved because the sessions did not focus on topics and there was a dissatisfaction.
- Kevin also mentioned that in ORS we need to be mindful of reproducibility not only in modeling but also in experiments; to expand the conversation to people that are experimentalists.
- The team discussed what to submit to IMAG/MSM meeting coming up in March, 2020. One option is to have an abstract on model development experience. The other is one on review of knee modeling articles for reproducibility, a more meta science abstract. Jason provided preliminary analysis of the reviews indicating completeness of reporting at about 50-70% and the reviewer's belief to be able to use the report for reproducing the study at about 30-50%. Jason and Ahmet discussed these results at the ORS 2020 and they have hesitations on how to craft the story. The goal is to provide guidelines and recommendations and highlight this as an opportunity to move forward. IMAG/MSM may be a good group (non-biomechanics community) to present it and get initial feedback. All knee modeling teams were in favor of submitting an abstract on this review. Jason will write up, circulate, and submit. Thor noted that Peter Hunter's Physiome Journal may be a good venue to provide modeling data and content in a manner to make them reproducible.
- Attendees discussed the progress of manuscripts on the pipeline.
- Jason did some analysis on reporting quality and reproducibility potential of knee models, which was already summarized as part of IMAG/MSM abstract submission.
- Carl has a mature draft of manuscript on ORS 2019 workshop on reproducibility. Shady did a great job to summarize the workshop and survey results during RIG in ORS 2020.
- Thor noted that Auckland group has been working on two publications. One is an extension of JBME article on deciphering art of modeling; this time focusing on model development. This will compare each model at a higher level and describe what everybody did vs what they said. The second one is on comparison of meshes (bone and cartilage specifically) and coordinate systems. This will explore the differences in representation of cartilage thickness. Thor prefers to send the figures and outline before writing the manuscript; they will send both for the participating groups to evaluate. Nynke will send requests in regard to information she needs from the groups to compile the work. Ahmet recommended that she informs him as well so that any material submitted to her is also available to the community at large. Jason and Will had an abstract in ORS 2020 comparing ligament representations of three groups. They are happy to collaborate to incorporate this information in one of the papers or write a separate article.
- Ahmet asked each group about their Model Calibration progress. Per Don, Denver group's calibration is going well. It started with DU02 and he ran through an optimization 3-4 times. He identified some issue to fix but overall he is pretty close to be done with DU02. It will take some additional time with oks003. Will from CSU started running optimizations but they are not quick. Framework has been implemented both for DU02 and oks003. HSS, in general, is behind. They need to setup optimization schemes and dive into the workflow. Cleveland Clinic team divided the calibration phase in multiple stages and they are half way through for both knees. Auckland team looked at the data and figured out a strategy. They processed data and the framework is in place except models are not running. All teams want to keep the deadline as it is. In response to Car and Will, Ahmet reminded all to record protocol deviations and the reason for the deviation. These will document the art of modeling.
- Thor had one thing to add. Jeff Bischoff reached out to him at the start of the year about a possible workshop/mini-symposium at ISTA. It sounds like a good opportunity to make our work visible. Ahmet is not going to ISTA. Carl is not going either but but HSS has a lot of visibility. Shady may be there. There is always a group from Denver University. Pete asked about the deadline for call for abstracts. Jason is planning to submit some abstracts; he has been to ISTA meetings quite a bit.