Assessment of CFD Performance in Simulations of an Idealized Medical Device: Results of FDA's First Computational Interlaboratory Study

Sandy F C Stewart, Eric G. Paterson, Greg W. Burgreen, Prasanna Hariharan, Matthew Giarra, Varun Reddy, Steven W. Day, Keefe B. Manning, Steven Deutsch, Michael R. Berman, Matthew R. Myers, Richard A. Malinauskas

Research output: Contribution to journalArticle

56 Citations (Scopus)

Abstract

While computational fluid dynamics (CFD) is commonly used for medical device development, its usefulness for demonstrating device safety has not been proven. Reliable standardized methods for this specialized need are lacking and are inhibiting the use of computational methods in the regulatory review of medical devices. To meet this need, participants from academia, industry, and the U. S. Food and Drug Administration recently completed a computational interlaboratory study to determine the suitability and methodology for simulating fluid flow in an idealized medical device. A technical working committee designed the study, defined the model geometry and flow conditions, and identified comparison metrics. The model geometry was a 0. 012 m diameter cylindrical nozzle with a conical collector and sudden expansion on either side of a 0. 04 m long, 0. 004 m diameter throat, which is able to cause hemolysis under certain flow conditions. Open invitations to participate in the study were extended through professional societies and organizations. Twenty-eight groups from around the world submitted simulation results for five flow rates, spanning laminar, transitional, and turbulent flows. Concurrently, three laboratories generated experimental validation data on geometrically similar physical models using particle image velocimetry. The simulations showed considerable variation from each other and from experiment. One main source of error involved turbulence model underestimations of the centerline velocities in the inlet and throat regions, because the flow was laminar in these regions. Turbulence models were also unable to accurately predict velocities and shear stresses in the recirculation zones downstream of the sudden expansion. The wide variety in results suggest that CFD studies used to assess safety in medical device submissions to the FDA require careful experimental validation. Better transitional models are needed, as many medical devices operate in the transitional regime. It is imperative that the community undertake and publish quality validation cases of biofluid dynamics and blood damage that include complications such as pulsatility, secondary flows, and short and/or curved inlets and outlets. The results of this interlaboratory study will be available in a benchmark database to help develop improved modeling techniques, and consensus standards and guidelines for using CFD in the evaluation of medical devices.

Original languageEnglish (US)
Pages (from-to)139-160
Number of pages22
JournalCardiovascular Engineering and Technology
Volume3
Issue number2
DOIs
StatePublished - Jun 2012

Fingerprint

Hydrodynamics
Computational fluid dynamics
Equipment and Supplies
Equipment Safety
Turbulence models
Pharynx
Safety devices
Geometry
Secondary flow
Benchmarking
Computational methods
Laminar flow
Velocity measurement
Rheology
Turbulent flow
Shear stress
Flow of fluids
United States Food and Drug Administration
Nozzles
Hemolysis

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Cardiology and Cardiovascular Medicine

Cite this

Stewart, Sandy F C ; Paterson, Eric G. ; Burgreen, Greg W. ; Hariharan, Prasanna ; Giarra, Matthew ; Reddy, Varun ; Day, Steven W. ; Manning, Keefe B. ; Deutsch, Steven ; Berman, Michael R. ; Myers, Matthew R. ; Malinauskas, Richard A. / Assessment of CFD Performance in Simulations of an Idealized Medical Device : Results of FDA's First Computational Interlaboratory Study. In: Cardiovascular Engineering and Technology. 2012 ; Vol. 3, No. 2. pp. 139-160.
@article{4b9d00b4fda54956a3973b57868fc6dd,
title = "Assessment of CFD Performance in Simulations of an Idealized Medical Device: Results of FDA's First Computational Interlaboratory Study",
abstract = "While computational fluid dynamics (CFD) is commonly used for medical device development, its usefulness for demonstrating device safety has not been proven. Reliable standardized methods for this specialized need are lacking and are inhibiting the use of computational methods in the regulatory review of medical devices. To meet this need, participants from academia, industry, and the U. S. Food and Drug Administration recently completed a computational interlaboratory study to determine the suitability and methodology for simulating fluid flow in an idealized medical device. A technical working committee designed the study, defined the model geometry and flow conditions, and identified comparison metrics. The model geometry was a 0. 012 m diameter cylindrical nozzle with a conical collector and sudden expansion on either side of a 0. 04 m long, 0. 004 m diameter throat, which is able to cause hemolysis under certain flow conditions. Open invitations to participate in the study were extended through professional societies and organizations. Twenty-eight groups from around the world submitted simulation results for five flow rates, spanning laminar, transitional, and turbulent flows. Concurrently, three laboratories generated experimental validation data on geometrically similar physical models using particle image velocimetry. The simulations showed considerable variation from each other and from experiment. One main source of error involved turbulence model underestimations of the centerline velocities in the inlet and throat regions, because the flow was laminar in these regions. Turbulence models were also unable to accurately predict velocities and shear stresses in the recirculation zones downstream of the sudden expansion. The wide variety in results suggest that CFD studies used to assess safety in medical device submissions to the FDA require careful experimental validation. Better transitional models are needed, as many medical devices operate in the transitional regime. It is imperative that the community undertake and publish quality validation cases of biofluid dynamics and blood damage that include complications such as pulsatility, secondary flows, and short and/or curved inlets and outlets. The results of this interlaboratory study will be available in a benchmark database to help develop improved modeling techniques, and consensus standards and guidelines for using CFD in the evaluation of medical devices.",
author = "Stewart, {Sandy F C} and Paterson, {Eric G.} and Burgreen, {Greg W.} and Prasanna Hariharan and Matthew Giarra and Varun Reddy and Day, {Steven W.} and Manning, {Keefe B.} and Steven Deutsch and Berman, {Michael R.} and Myers, {Matthew R.} and Malinauskas, {Richard A.}",
year = "2012",
month = "6",
doi = "10.1007/s13239-012-0087-5",
language = "English (US)",
volume = "3",
pages = "139--160",
journal = "Cardiovascular Engineering and Technology",
issn = "1869-408X",
publisher = "Springer Publishing Company",
number = "2",

}

Stewart, SFC, Paterson, EG, Burgreen, GW, Hariharan, P, Giarra, M, Reddy, V, Day, SW, Manning, KB, Deutsch, S, Berman, MR, Myers, MR & Malinauskas, RA 2012, 'Assessment of CFD Performance in Simulations of an Idealized Medical Device: Results of FDA's First Computational Interlaboratory Study' Cardiovascular Engineering and Technology, vol. 3, no. 2, pp. 139-160. https://doi.org/10.1007/s13239-012-0087-5

Assessment of CFD Performance in Simulations of an Idealized Medical Device : Results of FDA's First Computational Interlaboratory Study. / Stewart, Sandy F C; Paterson, Eric G.; Burgreen, Greg W.; Hariharan, Prasanna; Giarra, Matthew; Reddy, Varun; Day, Steven W.; Manning, Keefe B.; Deutsch, Steven; Berman, Michael R.; Myers, Matthew R.; Malinauskas, Richard A.

In: Cardiovascular Engineering and Technology, Vol. 3, No. 2, 06.2012, p. 139-160.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Assessment of CFD Performance in Simulations of an Idealized Medical Device

T2 - Cardiovascular Engineering and Technology

AU - Stewart, Sandy F C

AU - Paterson, Eric G.

AU - Burgreen, Greg W.

AU - Hariharan, Prasanna

AU - Giarra, Matthew

AU - Reddy, Varun

AU - Day, Steven W.

AU - Manning, Keefe B.

AU - Deutsch, Steven

AU - Berman, Michael R.

AU - Myers, Matthew R.

AU - Malinauskas, Richard A.

PY - 2012/6

Y1 - 2012/6

N2 - While computational fluid dynamics (CFD) is commonly used for medical device development, its usefulness for demonstrating device safety has not been proven. Reliable standardized methods for this specialized need are lacking and are inhibiting the use of computational methods in the regulatory review of medical devices. To meet this need, participants from academia, industry, and the U. S. Food and Drug Administration recently completed a computational interlaboratory study to determine the suitability and methodology for simulating fluid flow in an idealized medical device. A technical working committee designed the study, defined the model geometry and flow conditions, and identified comparison metrics. The model geometry was a 0. 012 m diameter cylindrical nozzle with a conical collector and sudden expansion on either side of a 0. 04 m long, 0. 004 m diameter throat, which is able to cause hemolysis under certain flow conditions. Open invitations to participate in the study were extended through professional societies and organizations. Twenty-eight groups from around the world submitted simulation results for five flow rates, spanning laminar, transitional, and turbulent flows. Concurrently, three laboratories generated experimental validation data on geometrically similar physical models using particle image velocimetry. The simulations showed considerable variation from each other and from experiment. One main source of error involved turbulence model underestimations of the centerline velocities in the inlet and throat regions, because the flow was laminar in these regions. Turbulence models were also unable to accurately predict velocities and shear stresses in the recirculation zones downstream of the sudden expansion. The wide variety in results suggest that CFD studies used to assess safety in medical device submissions to the FDA require careful experimental validation. Better transitional models are needed, as many medical devices operate in the transitional regime. It is imperative that the community undertake and publish quality validation cases of biofluid dynamics and blood damage that include complications such as pulsatility, secondary flows, and short and/or curved inlets and outlets. The results of this interlaboratory study will be available in a benchmark database to help develop improved modeling techniques, and consensus standards and guidelines for using CFD in the evaluation of medical devices.

AB - While computational fluid dynamics (CFD) is commonly used for medical device development, its usefulness for demonstrating device safety has not been proven. Reliable standardized methods for this specialized need are lacking and are inhibiting the use of computational methods in the regulatory review of medical devices. To meet this need, participants from academia, industry, and the U. S. Food and Drug Administration recently completed a computational interlaboratory study to determine the suitability and methodology for simulating fluid flow in an idealized medical device. A technical working committee designed the study, defined the model geometry and flow conditions, and identified comparison metrics. The model geometry was a 0. 012 m diameter cylindrical nozzle with a conical collector and sudden expansion on either side of a 0. 04 m long, 0. 004 m diameter throat, which is able to cause hemolysis under certain flow conditions. Open invitations to participate in the study were extended through professional societies and organizations. Twenty-eight groups from around the world submitted simulation results for five flow rates, spanning laminar, transitional, and turbulent flows. Concurrently, three laboratories generated experimental validation data on geometrically similar physical models using particle image velocimetry. The simulations showed considerable variation from each other and from experiment. One main source of error involved turbulence model underestimations of the centerline velocities in the inlet and throat regions, because the flow was laminar in these regions. Turbulence models were also unable to accurately predict velocities and shear stresses in the recirculation zones downstream of the sudden expansion. The wide variety in results suggest that CFD studies used to assess safety in medical device submissions to the FDA require careful experimental validation. Better transitional models are needed, as many medical devices operate in the transitional regime. It is imperative that the community undertake and publish quality validation cases of biofluid dynamics and blood damage that include complications such as pulsatility, secondary flows, and short and/or curved inlets and outlets. The results of this interlaboratory study will be available in a benchmark database to help develop improved modeling techniques, and consensus standards and guidelines for using CFD in the evaluation of medical devices.

UR - http://www.scopus.com/inward/record.url?scp=84861871972&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84861871972&partnerID=8YFLogxK

U2 - 10.1007/s13239-012-0087-5

DO - 10.1007/s13239-012-0087-5

M3 - Article

VL - 3

SP - 139

EP - 160

JO - Cardiovascular Engineering and Technology

JF - Cardiovascular Engineering and Technology

SN - 1869-408X

IS - 2

ER -