High Performance Computational Fluid Dynamics (CFD) Modeling Services for Highway Hydraulics

Print
General Information
Study Number: TPF-5(279)
Former Study Number:
Lead Organization: Federal Highway Administration
Solicitation Number: 1344
Partners: MDOT SHA, MN, SC, TX
Status: Closed
Est. Completion Date:
Contract/Other Number:
Last Updated: Jun 04, 2021
Contract End Date:
Financial Summary
Contract Amount:
Suggested Contribution:
Total Commitments Received: $470,000.00
100% SP&R Approval: Approved
Contact Information
Lead Study Contact(s): Kornel Kerenyi
kornel.kerenyi@dot.gov
Phone: 202-493-3142
FHWA Technical Liaison(s): Kornel Kerenyi
kornel.kerenyi@dot.gov
Phone: 202-493-3142
Study Champion(s): Chao Huang
c.huang.ctr@dot.gov
Phone: 202--493-3098
Organization Year Commitments Technical Contact Name Funding Contact Name
Maryland Department of Transportation State Highway Administration 2014 $15,000.00 Andy Kosicki Allison Hardt
Maryland Department of Transportation State Highway Administration 2015 $15,000.00 Andy Kosicki Allison Hardt
Maryland Department of Transportation State Highway Administration 2016 $15,000.00 Andy Kosicki Allison Hardt
Minnesota Department of Transportation 2013 $30,000.00 Lisa Sayler Debbie Sinclair
South Carolina Department of Transportation 2018 $320,000.00 Randall Mungo Terry Swygert
Texas Department of Transportation 2013 $15,000.00 Ab Maamar-Tayeb Ned Mattila
Texas Department of Transportation 2014 $15,000.00 Ab Maamar-Tayeb Ned Mattila
Texas Department of Transportation 2015 $15,000.00 Ab Maamar-Tayeb Ned Mattila
Texas Department of Transportation 2016 $15,000.00 Ab Maamar-Tayeb Ned Mattila
Texas Department of Transportation 2017 $15,000.00 Ab Maamar-Tayeb Ned Mattila
Texas Department of Transportation 2018 $0.00 Ab Maamar-Tayeb Ned Mattila

Study Description

The Federal Highway Administration established an Inter-Agency Agreement (IAA) with the Department of Energy’s (DOE) Argonne National Laboratory (ANL) Transportation Analysis Research Computing Center (TRACC) to get access and support for High Performance Computational Fluid Dynamics (CFD) modeling for highway hydraulics research conducted at the Turner-Fairbank Highway Research Center (TFHRC) Hydraulics Laboratory. TRACC was established in October 2006. The technical objectives of TRACC included the establishment of a high-performance computing center for use by U.S. Department of Transportation (USDOT) research teams, including those from Argonne and their university partners. The essential resources for transportation infrastructure research and analysis at TRACC are its High Performance Computing (HPC) clusters and expert staff in the areas of computational fluid dynamics (CFD) and computational structural mechanics (CSM). Currently TRACC has two HPC clusters. The five year old Phoenix cluster is a customized system consisting of 1024 cores on 128 compute nodes, each with two quad-core AMD Opteron CPUs and 8 GB of RAM; The new HPC Zephyr cluster became available for use in October 2012. Zephyr (2944 core) is a 92 compute node cluster with each node having 2 AMD Interlagos 6273, 2.3 GHz CPUs with 16 integer cores and 8 floating point cores. TRACC researchers have developed methodologies and software applications to more easily run CFD software (STAR-CCM+) on TRACC’s systems. The TRACC team has also held workshops and many training classes to train TRACC users in the use of these software packages for analysis of transportation infrastructure problems. The operation of high-performance computing platforms is particularly effective in Argonne’s context of operating some of the fastest computers in the world, co-located with TRACC’s HPC clusters. This proximity ensures access to high levels of expertise in case of hardware malfunction, and other service disruptions, as well as integration into a large-scale computing center operation. TRACC will purchase, install and maintain the newest versions of the STAR-CCM+ CFD software used by the TRACC staff and external transportation researchers. In cooperation with the software developers, TRACC will report and resolve any issues related to software bugs or malfunctioning. As part of this objective, the TRACC team will also maintain and improve scripts that are used in conjunction with the CFD software on TRACC’s HPC clusters. The Transportation Pooled Fund study shall allow State Departments of Transportation to get access to High Performance Computational Fluid Dynamics (CFD) computing capabilities for highway hydraulics research activities at TRACC using the Inter-Agency Agreement. State DOT shall transfer funds to FHWA using the TPF study. FHWA will then add the funds to the Inter-Agency Agreement. This will allow TRACC to conduct the State DOT’s research activity.

Objectives

The objective of these pooled funds is to provide research and analysis for a variety of highway hydraulics projects managed or coordinated by State DOTs; to provide and maintain a high performance Computational Fluid Dynamics (CFD) computing environment for application to highway hydraulics infrastructure and related projects; and to support and seek to broaden the use of CFD among State Department of Transportation employees.

Scope of Work

Task 1: Computational Mechanics Research on a Variety of Projects: The TRACC scientific staff in the computational mechanics focus area will perform research, analysis, and parametric computations as required for projects managed or coordinated by State DOTs. Task 2: Computational Mechanics Research Support: The TRACC support team consisting of highly qualified engineers in the CFD focus areas will provide guidance to users of CFD software on an as needed or periodic basis determined by the State DOTs. Task 3: Computing Support: The TRACC team will use the TRACC clusters for work done on projects; The TRACC system administrator will maintain the clusters and work closely with the Argonne system administrator’s community; The TRACC system administrator will also install the latest versions of the STAR-CCM+ CFD software and other software that may be required for accomplishing projects.

Comments

Recommended funding $100,000/year; Performance Period 60 month; Suggested contribution: $15,000/State DOT/year. The Federal Highway Administration will serve as the coordinator for this pooled-fund project. State DOT's will be solicited for their interest and participation to receive Computational Fluid Dynamics (CFD) modeling services for highway hydraulics for State DOT employees.

Documents Attached
Title File/Link Document Category Document Type Privacy Document Date Download
Closeout Memo TPF-5(279) Closeout Memo.pdf Memorandum Other Public 2021-06-04
Final Report for Hydraulic Study of the South Carolina DOT Catch Basin Type 25 Hydraulic Study of the South Carolina DOT Catch Basin Type 25.pdf Deliverable Final Report Public 2021-05-27
Progress Report: October - December 2019 24-TPF-5-279-Quarterly-Report-Oct-Dec-2019.docx Progress Report Quarterly Progress Report Public 2019-12-19
Progress Report: July - September 2019 23-TPF-5-279-Quarterly-Report-Jul-Sept-2019.docx Progress Report Quarterly Progress Report Public 2019-12-19
Progress Report: April - June 2018 22-TPF-5-279-Quarterly-Report-Apr-Jun-2019.docx Progress Report Quarterly Progress Report Public 2019-12-19
Progress Report: January - March 2019 21-TPF-5-279-Quarterly-Report-Jan-Mar-2019.docx Progress Report Quarterly Progress Report Public 2019-12-19
Progress Report: October - December 2018 20-TPF-5-279-Quarterly-Report-Oct-Dec-2018.docx Progress Report Quarterly Progress Report Public 2019-12-19
Progress Report: July - September 2018 TPF-5(279)-Quarterly-Report-Jul-Sept-2018.docx Progress Report Quarterly Progress Report Public 2018-10-26
Progress Report: April - June 2018 TPF-5(279)-Quarterly-Report-Apr-Jun-2018.docx Progress Report Quarterly Progress Report Public 2018-10-26
Progress Report: January - March 2018 TPF-5(279)-Quarterly-Report-Jan-Mar-2018.docx Progress Report Quarterly Progress Report Public 2018-10-26
Progress Report: October - December 2017 16-TPF-5-279-Quarterly-Report-Oct-Dec-2017.docx Progress Report Quarterly Progress Report Public 2018-10-26
Progress Report: July - September 2017 15-TPF-5-279-Quarterly-Report-July-Sept-2017.docx Progress Report Quarterly Progress Report Public 2018-10-26
Progress Report: April - June 2017 Progress for TPF-5(279) from Apr to Jun 2017.docx Progress Report Quarterly Progress Report Public 2017-07-12
Progress Report: January - March 2017 Progress for TPF-5(279) from Jan to Mar 2017.docx Progress Report Quarterly Progress Report Public 2017-06-09
Progress Report: October - December 2016 Progress for TPF-5(279) from Oct to Dec 2016.pdf Progress Report Quarterly Progress Report Public 2017-02-13
Progress Report: July - September 2016 Progress for TPF-5(279) from Jul to Sep 2016.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: April - June 2016 Progress for TPF-5(279) from Apr to Jun 2016.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: January - March 2016 Progress for TPF-5(279) from Jan to Mar 2016.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: October - December 2015 Progress for TPF-5(279) from Oct to Dec 2015.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: July - September 2015 Progress for TPF-5(279) from Jul to Sep 2015.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: April - June 2015 Progress for TPF-5(279) from Apr to Jun 2015.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: January- March 2015 Progress for TPF-5(279) from Jan to Mar 2015.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: October- December 2014 Progress for TPF-5(279) from Oct to Dec 2014.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: July- September 2014 Progress for TPF-5(279) from Jul to Sep 2014.pdf Progress Report Quarterly Progress Report Public 2016-10-06
Progress Report: April - June 2014 MnDOT-Grate-Study-Apr-Jun-2014.pdf Progress Report Quarterly Progress Report Public 2014-08-29
Progress Report: January - March 2014 MnDOT-Grate-Study-Jan-Mar-2014.pdf Progress Report Quarterly Progress Report Public 2014-08-29
Acceptance Memo for TPF-5(279) Acceptance Memo TPF-5(279).pdf Memorandum Other Public 2013-04-24

No document attached.

High Performance Computational Fluid Dynamics (CFD) Modeling Services for Highway Hydraulics

General Information
Study Number: TPF-5(279)
Lead Organization: Federal Highway Administration
Solicitation Number: 1344
Partners: MDOT SHA, MN, SC, TX
Status: Closed
Est. Completion Date:
Contract/Other Number:
Last Updated: Jun 04, 2021
Contract End Date:
Financial Summary
Contract Amount:
Total Commitments Received: $470,000.00
100% SP&R Approval:
Contact Information
Lead Study Contact(s): Kornel Kerenyi
kornel.kerenyi@dot.gov
Phone: 202-493-3142
FHWA Technical Liaison(s): Kornel Kerenyi
kornel.kerenyi@dot.gov
Phone: 202-493-3142
Commitments by Organizations
Organization Year Commitments Technical Contact Name Funding Contact Name Contact Number Email Address
Maryland Department of Transportation State Highway Administration 2014 $15,000.00 Andy Kosicki Allison Hardt 410-545-2916 ahardt@mdot.maryland.gov
Maryland Department of Transportation State Highway Administration 2015 $15,000.00 Andy Kosicki Allison Hardt 410-545-2916 ahardt@mdot.maryland.gov
Maryland Department of Transportation State Highway Administration 2016 $15,000.00 Andy Kosicki Allison Hardt 410-545-2916 ahardt@mdot.maryland.gov
Minnesota Department of Transportation 2013 $30,000.00 Lisa Sayler Debbie Sinclair 651-336-3746 debbie.sinclair@state.mn.us
South Carolina Department of Transportation 2018 $320,000.00 Randall Mungo Terry Swygert 803-737-6691 SwygertTL@scdot.org
Texas Department of Transportation 2013 $15,000.00 Ab Maamar-Tayeb Ned Mattila 512-416-4727 ned.mattila@txdot.gov
Texas Department of Transportation 2014 $15,000.00 Ab Maamar-Tayeb Ned Mattila 512-416-4727 ned.mattila@txdot.gov
Texas Department of Transportation 2015 $15,000.00 Ab Maamar-Tayeb Ned Mattila 512-416-4727 ned.mattila@txdot.gov
Texas Department of Transportation 2016 $15,000.00 Ab Maamar-Tayeb Ned Mattila 512-416-4727 ned.mattila@txdot.gov
Texas Department of Transportation 2017 $15,000.00 Ab Maamar-Tayeb Ned Mattila 512-416-4727 ned.mattila@txdot.gov
Texas Department of Transportation 2018 $0.00 Ab Maamar-Tayeb Ned Mattila 512-416-4727 ned.mattila@txdot.gov

Study Description

Study Description

The Federal Highway Administration established an Inter-Agency Agreement (IAA) with the Department of Energy’s (DOE) Argonne National Laboratory (ANL) Transportation Analysis Research Computing Center (TRACC) to get access and support for High Performance Computational Fluid Dynamics (CFD) modeling for highway hydraulics research conducted at the Turner-Fairbank Highway Research Center (TFHRC) Hydraulics Laboratory. TRACC was established in October 2006. The technical objectives of TRACC included the establishment of a high-performance computing center for use by U.S. Department of Transportation (USDOT) research teams, including those from Argonne and their university partners. The essential resources for transportation infrastructure research and analysis at TRACC are its High Performance Computing (HPC) clusters and expert staff in the areas of computational fluid dynamics (CFD) and computational structural mechanics (CSM). Currently TRACC has two HPC clusters. The five year old Phoenix cluster is a customized system consisting of 1024 cores on 128 compute nodes, each with two quad-core AMD Opteron CPUs and 8 GB of RAM; The new HPC Zephyr cluster became available for use in October 2012. Zephyr (2944 core) is a 92 compute node cluster with each node having 2 AMD Interlagos 6273, 2.3 GHz CPUs with 16 integer cores and 8 floating point cores. TRACC researchers have developed methodologies and software applications to more easily run CFD software (STAR-CCM+) on TRACC’s systems. The TRACC team has also held workshops and many training classes to train TRACC users in the use of these software packages for analysis of transportation infrastructure problems. The operation of high-performance computing platforms is particularly effective in Argonne’s context of operating some of the fastest computers in the world, co-located with TRACC’s HPC clusters. This proximity ensures access to high levels of expertise in case of hardware malfunction, and other service disruptions, as well as integration into a large-scale computing center operation. TRACC will purchase, install and maintain the newest versions of the STAR-CCM+ CFD software used by the TRACC staff and external transportation researchers. In cooperation with the software developers, TRACC will report and resolve any issues related to software bugs or malfunctioning. As part of this objective, the TRACC team will also maintain and improve scripts that are used in conjunction with the CFD software on TRACC’s HPC clusters. The Transportation Pooled Fund study shall allow State Departments of Transportation to get access to High Performance Computational Fluid Dynamics (CFD) computing capabilities for highway hydraulics research activities at TRACC using the Inter-Agency Agreement. State DOT shall transfer funds to FHWA using the TPF study. FHWA will then add the funds to the Inter-Agency Agreement. This will allow TRACC to conduct the State DOT’s research activity.

Objectives

The objective of these pooled funds is to provide research and analysis for a variety of highway hydraulics projects managed or coordinated by State DOTs; to provide and maintain a high performance Computational Fluid Dynamics (CFD) computing environment for application to highway hydraulics infrastructure and related projects; and to support and seek to broaden the use of CFD among State Department of Transportation employees.

Scope of Work

Task 1: Computational Mechanics Research on a Variety of Projects: The TRACC scientific staff in the computational mechanics focus area will perform research, analysis, and parametric computations as required for projects managed or coordinated by State DOTs. Task 2: Computational Mechanics Research Support: The TRACC support team consisting of highly qualified engineers in the CFD focus areas will provide guidance to users of CFD software on an as needed or periodic basis determined by the State DOTs. Task 3: Computing Support: The TRACC team will use the TRACC clusters for work done on projects; The TRACC system administrator will maintain the clusters and work closely with the Argonne system administrator’s community; The TRACC system administrator will also install the latest versions of the STAR-CCM+ CFD software and other software that may be required for accomplishing projects.

Comments

Recommended funding $100,000/year; Performance Period 60 month; Suggested contribution: $15,000/State DOT/year. The Federal Highway Administration will serve as the coordinator for this pooled-fund project. State DOT's will be solicited for their interest and participation to receive Computational Fluid Dynamics (CFD) modeling services for highway hydraulics for State DOT employees.

Title File/Link Type Private
Closeout Memo TPF-5(279) Closeout Memo.pdf Memorandum Public
Final Report for Hydraulic Study of the South Carolina DOT Catch Basin Type 25 Hydraulic Study of the South Carolina DOT Catch Basin Type 25.pdf Deliverable Public
Progress Report: October - December 2019 24-TPF-5-279-Quarterly-Report-Oct-Dec-2019.docx Progress Report Public
Progress Report: July - September 2019 23-TPF-5-279-Quarterly-Report-Jul-Sept-2019.docx Progress Report Public
Progress Report: April - June 2018 22-TPF-5-279-Quarterly-Report-Apr-Jun-2019.docx Progress Report Public
Progress Report: January - March 2019 21-TPF-5-279-Quarterly-Report-Jan-Mar-2019.docx Progress Report Public
Progress Report: October - December 2018 20-TPF-5-279-Quarterly-Report-Oct-Dec-2018.docx Progress Report Public
Progress Report: July - September 2018 TPF-5(279)-Quarterly-Report-Jul-Sept-2018.docx Progress Report Public
Progress Report: April - June 2018 TPF-5(279)-Quarterly-Report-Apr-Jun-2018.docx Progress Report Public
Progress Report: January - March 2018 TPF-5(279)-Quarterly-Report-Jan-Mar-2018.docx Progress Report Public
Progress Report: October - December 2017 16-TPF-5-279-Quarterly-Report-Oct-Dec-2017.docx Progress Report Public
Progress Report: July - September 2017 15-TPF-5-279-Quarterly-Report-July-Sept-2017.docx Progress Report Public
Progress Report: April - June 2017 Progress for TPF-5(279) from Apr to Jun 2017.docx Progress Report Public
Progress Report: January - March 2017 Progress for TPF-5(279) from Jan to Mar 2017.docx Progress Report Public
Progress Report: October - December 2016 Progress for TPF-5(279) from Oct to Dec 2016.pdf Progress Report Public
Progress Report: July - September 2016 Progress for TPF-5(279) from Jul to Sep 2016.pdf Progress Report Public
Progress Report: April - June 2016 Progress for TPF-5(279) from Apr to Jun 2016.pdf Progress Report Public
Progress Report: January - March 2016 Progress for TPF-5(279) from Jan to Mar 2016.pdf Progress Report Public
Progress Report: October - December 2015 Progress for TPF-5(279) from Oct to Dec 2015.pdf Progress Report Public
Progress Report: July - September 2015 Progress for TPF-5(279) from Jul to Sep 2015.pdf Progress Report Public
Progress Report: April - June 2015 Progress for TPF-5(279) from Apr to Jun 2015.pdf Progress Report Public
Progress Report: January- March 2015 Progress for TPF-5(279) from Jan to Mar 2015.pdf Progress Report Public
Progress Report: October- December 2014 Progress for TPF-5(279) from Oct to Dec 2014.pdf Progress Report Public
Progress Report: July- September 2014 Progress for TPF-5(279) from Jul to Sep 2014.pdf Progress Report Public
Progress Report: April - June 2014 MnDOT-Grate-Study-Apr-Jun-2014.pdf Progress Report Public
Progress Report: January - March 2014 MnDOT-Grate-Study-Jan-Mar-2014.pdf Progress Report Public
Acceptance Memo for TPF-5(279) Acceptance Memo TPF-5(279).pdf Memorandum Public
No document attached.

Currently, Transportation Pooled Fund is not supported on mobile devices, please access this Web portal using a desktop or laptop computer.