Showing 1–14 of 14 results for author: Hyde, D

A Thermomechanical Hybrid Incompressible Material Point Method

Authors: Victoria Kala, Jingyu Chen, David Hyde, Alexey Stomakhin, Joseph Teran

Abstract: We present a novel hybrid incompressible flow/material point method solver for simulating the combustion of flammable solids. Our approach utilizes a sparse grid representation of solid materials in the material point method portion of the solver and a hybrid Eulerian/FLIP solver for the incompressible portion. We utilize these components to simulate the motion of heated air and particulate matter… ▽ More We present a novel hybrid incompressible flow/material point method solver for simulating the combustion of flammable solids. Our approach utilizes a sparse grid representation of solid materials in the material point method portion of the solver and a hybrid Eulerian/FLIP solver for the incompressible portion. We utilize these components to simulate the motion of heated air and particulate matter as they interact with flammable solids, causing combustion-related damage. We include a novel particle sampling strategy to increase Eulerian flow accuracy near regions of high temperature. We also support control of the flame front propagation speed and the rate of solid combustion in an artistically directable manner. Solid combustion is modeled with temperature-dependent elastoplastic constitutive modeling. We demonstrate the efficacy of our method on various real-world three-dimensional problems, including a burning match, incense sticks, and a wood log in a fireplace. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Anvil: An integration of artificial intelligence, sampling techniques, and a combined CAD-CFD tool

Authors: Harsh Vardhan, Umesh Timalsina, Michael Sandborn, David Hyde, Peter Volgyesi, Janos Sztipanovits

Abstract: In this work, we introduce an open-source integrated CAD-CFD tool, Anvil, which combines FreeCAD for CAD modeling and OpenFOAM for CFD analysis, along with an AI-based optimization method (Bayesian optimization) and other sampling algorithms. Anvil serves as a scientific machine learning tool for shape optimization in three modes: data generation, CFD evaluation, and shape optimization. In data ge… ▽ More In this work, we introduce an open-source integrated CAD-CFD tool, Anvil, which combines FreeCAD for CAD modeling and OpenFOAM for CFD analysis, along with an AI-based optimization method (Bayesian optimization) and other sampling algorithms. Anvil serves as a scientific machine learning tool for shape optimization in three modes: data generation, CFD evaluation, and shape optimization. In data generation mode, it automatically runs CFD evaluations and generates data for training a surrogate model. In optimization mode, it searches for the optimal design under given requirements and optimization metrics. In CFD mode, a single CAD file can be evaluated with a single OpenFOAM run. To use Anvil, experimenters provide a JSON configuration file and a parametric CAD seed design. Anvil can be used to study solid-fluid dynamics for any subsonic flow conditions and has been demonstrated in various simulation and optimization use cases. The open-source code for the tool, installation process, artifacts (such as CAD seed designs and example STL models), experimentation results, and detailed documentation can be found at \url{https://github.com/symbench/Anvil}. △ Less

Submitted 24 June, 2024; originally announced July 2024.

Compelling ReLU Network Initialization and Training to Leverage Exponential Scaling with Depth

Authors: Max Milkert, David Hyde, Forrest Laine

Abstract: A neural network with ReLU activations may be viewed as a composition of piecewise linear functions. For such networks, the number of distinct linear regions expressed over the input domain has the potential to scale exponentially with depth, but it is not expected to do so when the initial parameters are chosen randomly. This poor scaling can necessitate the use of overly large models to approxim… ▽ More A neural network with ReLU activations may be viewed as a composition of piecewise linear functions. For such networks, the number of distinct linear regions expressed over the input domain has the potential to scale exponentially with depth, but it is not expected to do so when the initial parameters are chosen randomly. This poor scaling can necessitate the use of overly large models to approximate even simple functions. To address this issue, we introduce a novel training strategy: we first reparameterize the network weights in a manner that forces the network to display a number of activation patterns exponential in depth. Training first on our derived parameters provides an initial solution that can later be refined by directly updating the underlying model weights. This approach allows us to learn approximations of convex, one-dimensional functions that are several orders of magnitude more accurate than their randomly initialized counterparts. △ Less

Submitted 1 June, 2024; v1 submitted 29 November, 2023; originally announced November 2023.

Comments: 18 pages, 8 figures

Sample-Efficient and Surrogate-Based Design Optimization of Underwater Vehicle Hulls

Authors: Harsh Vardhan, David Hyde, Umesh Timalsina, Peter Volgyesi, Janos Sztipanovits

Abstract: Physics simulations like computational fluid dynamics (CFD) are a computational bottleneck in computer-aided design (CAD) optimization processes. To overcome this bottleneck, one requires either an optimization framework that is highly sample-efficient, or a fast data-driven proxy (surrogate model) for long-running simulations. Both approaches have benefits and limitations. Bayesian optimization i… ▽ More Physics simulations like computational fluid dynamics (CFD) are a computational bottleneck in computer-aided design (CAD) optimization processes. To overcome this bottleneck, one requires either an optimization framework that is highly sample-efficient, or a fast data-driven proxy (surrogate model) for long-running simulations. Both approaches have benefits and limitations. Bayesian optimization is often used for sample efficiency, but it solves one specific problem and struggles with transferability; alternatively, surrogate models can offer fast and often more generalizable solutions for CFD problems, but gathering data for and training such models can be computationally demanding. In this work, we leverage recent advances in optimization and artificial intelligence (AI) to explore both of these potential approaches, in the context of designing an optimal unmanned underwater vehicle (UUV) hull. Our study finds that the Bayesian Optimization-Lower Condition Bound (BO-LCB) algorithm is the most sample-efficient optimization framework and has the best convergence behavior of those considered. Subsequently, we show that our DNN-based surrogate model predicts drag force on test data in tight agreement with CFD simulations, with a mean absolute percentage error (MAPE) of 1.85%. Combining these results, we demonstrate a two-orders-of-magnitude speedup (with comparable accuracy) for the design optimization process when the surrogate model is used. To our knowledge, this is the first study applying Bayesian optimization and DNN-based surrogate modeling to the problem of UUV design optimization, and we share our developments as open-source software. △ Less

Submitted 29 March, 2024; v1 submitted 24 April, 2023; originally announced April 2023.

Automated modeling of brain bioelectric activity within the 3D Slicer environment

Authors: Saima Safdar, Benjamin Zwick, George Bourantas, Grand Joldes, Damon Hyde, Simon Warfield, Adam Wittek, Karol Miller

Abstract: Electrocorticography (ECoG) or intracranial electroencephalography (iEEG) monitors electric potential directly on the surface of the brain and can be used to inform treatment planning for epilepsy surgery when paired with numerical modeling. For solving the inverse problem in epilepsy seizure onset localization, accurate solution of the iEEG forward problem is critical which requires accurate repr… ▽ More Electrocorticography (ECoG) or intracranial electroencephalography (iEEG) monitors electric potential directly on the surface of the brain and can be used to inform treatment planning for epilepsy surgery when paired with numerical modeling. For solving the inverse problem in epilepsy seizure onset localization, accurate solution of the iEEG forward problem is critical which requires accurate representation of the patient's brain geometry and tissue electrical conductivity. In this study, we present an automatic framework for constructing the brain volume conductor model for solving the iEEG forward problem and visualizing the brain bioelectric field on a deformed patient-specific brain model within the 3D Slicer environment. We solve the iEEG forward problem on the predicted postoperative geometry using the finite element method (FEM) which accounts for patient-specific inhomogeneity and anisotropy of tissue conductivity. We use an epilepsy case study to illustrate the workflow of our framework developed and integrated within 3D Slicer. △ Less

Submitted 27 July, 2022; originally announced August 2022.

Journal ref: Computational Biomechanics for Medicine Workshop CBM XVII 2022

A Deep Conjugate Direction Method for Iteratively Solving Linear Systems

Authors: Ayano Kaneda, Osman Akar, Jingyu Chen, Victoria Kala, David Hyde, Joseph Teran

Abstract: We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for partial differential equations. Algorithms for approximating the solution to these systems are often the bottleneck in problems that require their solution, particu… ▽ More We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for partial differential equations. Algorithms for approximating the solution to these systems are often the bottleneck in problems that require their solution, particularly for modern applications that require many millions of unknowns. Indeed, numerical linear algebra techniques have been investigated for many decades to alleviate this computational burden. Recently, data-driven techniques have also shown promise for these problems. Motivated by the conjugate gradients algorithm that iteratively selects search directions for minimizing the matrix norm of the approximation error, we design an approach that utilizes a deep neural network to accelerate convergence via data-driven improvement of the search directions. Our method leverages a carefully chosen convolutional network to approximate the action of the inverse of the linear operator up to an arbitrary constant. We train the network using unsupervised learning with a loss function equal to the $L^2$ difference between an input and the system matrix times the network evaluation, where the unspecified constant in the approximate inverse is accounted for. We demonstrate the efficacy of our approach on spatially discretized Poisson equations with millions of degrees of freedom arising in computational fluid dynamics applications. Unlike state-of-the-art learning approaches, our algorithm is capable of reducing the linear system residual to a given tolerance in a small number of iterations, independent of the problem size. Moreover, our method generalizes effectively to various systems beyond those encountered during training. △ Less

Submitted 1 October, 2022; v1 submitted 22 May, 2022; originally announced May 2022.

Comments: 12 pages, 4 figures

MSC Class: 65F10 (Primary) 68T07; 65N22 (Secondary) ACM Class: G.1.3; I.2.6; I.3.0

A Robust Grid-Based Meshing Algorithm for Embedding Self-Intersecting Surfaces

Authors: Steven W. Gagniere, Yushan Han, Yizhou Chen, David A. B. Hyde, Alan Marquez-Razon, Joseph Teran, Ronald Fedkiw

Abstract: The creation of a volumetric mesh representing the interior of an input polygonal mesh is a common requirement in graphics and computational mechanics applications. Most mesh creation techniques assume that the input surface is not self-intersecting. However, due to numerical and/or user error, input surfaces are commonly self-intersecting to some degree. The removal of self-intersection is a burd… ▽ More The creation of a volumetric mesh representing the interior of an input polygonal mesh is a common requirement in graphics and computational mechanics applications. Most mesh creation techniques assume that the input surface is not self-intersecting. However, due to numerical and/or user error, input surfaces are commonly self-intersecting to some degree. The removal of self-intersection is a burdensome task that complicates workflow and generally slows down the process of creating simulation-ready digital assets. We present a method for the creation of a volumetric embedding hexahedron mesh from a self-intersecting input triangle mesh. Our method is designed for efficiency by minimizing use of computationally expensive exact/adaptive precision arithmetic. Although our approach allows for nearly no limit on the degree of self-intersection in the input surface, our focus is on efficiency in the most common case: many minimal self-intersections. The embedding hexahedron mesh is created from a uniform background grid and consists of hexahedron elements that are geometrical copies of grid cells. Multiple copies of a single grid cell are used to resolve regions of self-intersection/overlap. Lastly, we develop a novel topology-aware embedding mesh coarsening technique to allow for user-specified mesh resolution as well as a topology-aware tetrahedralization of the hexahedron mesh. △ Less

Submitted 17 January, 2022; originally announced January 2022.

A Momentum-Conserving Implicit Material Point Method for Surface Energies with Spatial Gradients

Authors: Jingyu Chen, Victoria Kala, Alan Marquez-Razon, Elias Gueidon, David A. B. Hyde, Joseph Teran

Abstract: We present a novel Material Point Method (MPM) discretization of surface tension forces that arise from spatially varying surface energies. These variations typically arise from surface energy dependence on temperature and/or concentration. Furthermore, since the surface energy is an interfacial property depending on the types of materials on either side of an interface, spatial variation is requi… ▽ More We present a novel Material Point Method (MPM) discretization of surface tension forces that arise from spatially varying surface energies. These variations typically arise from surface energy dependence on temperature and/or concentration. Furthermore, since the surface energy is an interfacial property depending on the types of materials on either side of an interface, spatial variation is required for modeling the contact angle at the triple junction between a liquid, solid and surrounding air. Our discretization is based on the surface energy itself, rather than on the associated traction condition most commonly used for discretization with particle methods. Our energy based approach automatically captures surface gradients without the explicit need to resolve them as in traction condition based approaches. We include an implicit discretization of thermomechanical material coupling with a novel particle-based enforcement of Robin boundary conditions associated with convective heating. Lastly, we design a particle resampling approach needed to achieve perfect conservation of linear and angular momentum with AffineParticle-In-Cell (APIC) [Jiang et al. 2015]. We show that our approach enables implicit time stepping for complex behaviors like the Marangoni effect and hydrophobicity/hydrophilicity. We demonstrate the robustness and utility of our method by simulating materials that exhibit highly diverse degrees of surface tension and thermomechanical effects, such as water, wine and wax. △ Less

Submitted 29 January, 2021; originally announced January 2021.

ACM Class: I.3.0; I.6.0

Journal ref: ACM TOG 40:4 1-16 (2021)

A Hybrid Lagrangian/Eulerian Collocated Advection and Projection Method for Fluid Simulation

Authors: Steven W. Gagniere, David A. B. Hyde, Alan Marquez-Razon, Chenfanfu Jiang, Ziheng Ge, Xuchen Han, Qi Guo, Joseph Teran

Abstract: We present a hybrid particle/grid approach for simulating incompressible fluids on collocated velocity grids. We interchangeably use particle and grid representations of transported quantities to balance efficiency and accuracy. A novel Backward Semi-Lagrangian method is derived to improve accuracy of grid based advection. Our approach utilizes the implicit formula associated with solutions of Bur… ▽ More We present a hybrid particle/grid approach for simulating incompressible fluids on collocated velocity grids. We interchangeably use particle and grid representations of transported quantities to balance efficiency and accuracy. A novel Backward Semi-Lagrangian method is derived to improve accuracy of grid based advection. Our approach utilizes the implicit formula associated with solutions of Burgers' equation. We solve this equation using Newton's method enabled by $C^1$ continuous grid interpolation. We enforce incompressibility over collocated, rather than staggered grids. Our projection technique is variational and designed for B-spline interpolation over regular grids where multiquadratic interpolation is used for velocity and multilinear interpolation for pressure. Despite our use of regular grids, we extend the variational technique to allow for cut-cell definition of irregular flow domains for both Dirichlet and free surface boundary conditions. △ Less

Submitted 27 March, 2020; originally announced March 2020.

Comments: 13 pages, 18 figures

Journal ref: Computer Graphics Forum, 39(8): 1-14 (2020)

Biomechanical modeling and computer simulation of the brain during neurosurgery

Authors: K. Miller, G. R. Joldes, G. Bourantas, S. K. Warfield, D. E. Hyde, R. Kikinis, A. Wittek

Abstract: Computational biomechanics of the brain for neurosurgery is an emerging area of research recently gaining in importance and practical applications. This review paper presents the contributions of the Intelligent Systems for Medicine Laboratory and it's collaborators to this field, discussing the modeling approaches adopted and the methods developed for obtaining the numerical solutions. We adopt a… ▽ More Computational biomechanics of the brain for neurosurgery is an emerging area of research recently gaining in importance and practical applications. This review paper presents the contributions of the Intelligent Systems for Medicine Laboratory and it's collaborators to this field, discussing the modeling approaches adopted and the methods developed for obtaining the numerical solutions. We adopt a physics-based modeling approach, and describe the brain deformation in mechanical terms (such as displacements, strains and stresses), which can be computed using a biomechanical model, by solving a continuum mechanics problem. We present our modeling approaches related to geometry creation, boundary conditions, loading and material properties. From the point of view of solution methods, we advocate the use of fully nonlinear modeling approaches, capable of capturing very large deformations and nonlinear material behavior. We discuss finite element and meshless domain discretization, the use of the Total Lagrangian formulation of continuum mechanics, and explicit time integration for solving both time-accurate and steady state problems. We present the methods developed for handling contacts and for warping 3D medical images using the results of our simulations. We present two examples to showcase these methods: brain shift estimation for image registration and brain deformation computation for neuronavigation in epilepsy treatment. △ Less

Submitted 1 April, 2019; originally announced April 2019.

Suite of Meshless Algorithms for Accurate Computation of Soft Tissue Deformation for Surgical Simulation

Authors: Grand Joldes, George Bourantas, Benjamin Zwick, Habib Chowdhury, Adam Wittek, Sudip Agrawal, Konstantinos Mountris, Damon Hyde, Simon K. Warfield, Karol Miller

Abstract: The ability to predict patient-specific soft tissue deformations is key for computer-integrated surgery systems and the core enabling technology for a new era of personalized medicine. Element-Free Galerkin (EFG) methods are better suited for solving soft tissue deformation problems than the finite element method (FEM) due to their capability of handling large deformation while also eliminating th… ▽ More The ability to predict patient-specific soft tissue deformations is key for computer-integrated surgery systems and the core enabling technology for a new era of personalized medicine. Element-Free Galerkin (EFG) methods are better suited for solving soft tissue deformation problems than the finite element method (FEM) due to their capability of handling large deformation while also eliminating the necessity of creating a complex predefined mesh. Nevertheless, meshless methods based on EFG formulation, exhibit three major limitations: i) meshless shape functions using higher order basis cannot always be computed for arbitrarily distributed nodes (irregular node placement is crucial for facilitating automated discretization of complex geometries); ii) imposition of the Essential Boundary Conditions (EBC) is not straightforward; and, iii) numerical (Gauss) integration in space is not exact as meshless shape functions are not polynomial. This paper presents a suite of Meshless Total Lagrangian Explicit Dynamics (MTLED) algorithms incorporating a Modified Moving Least Squares (MMLS) method for interpolating scattered data both for visualization and for numerical computations of soft tissue deformation, a novel way of imposing EBC for explicit time integration, and an adaptive numerical integration procedure within the Meshless Total Lagrangian Explicit Dynamics algorithm. The appropriateness and effectiveness of the proposed methods is demonstrated using comparisons with the established non-linear procedures from commercial finite element software ABAQUS and experiments with very large deformations. To demonstrate the translational benefits of MTLED we also present a realistic brain-shift computation. △ Less

Submitted 13 June, 2019; v1 submitted 12 March, 2019; originally announced March 2019.

Comments: Accepted for publication in Medical Image Analysis

A Robust Volume Conserving Method for Character-Water Interaction

Authors: Minjae Lee, David Hyde, Kevin Li, Ronald Fedkiw

Abstract: We propose a novel volume conserving framework for character-water interaction, using a novel volume-of-fluid solver on a skinned tetrahedral mesh, enabling the high degree of the spatial adaptivity in order to capture thin films and hair-water interactions. For efficiency, the bulk of the fluid volume is simulated with a standard Eulerian solver which is two way coupled to our skinned arbitrary L… ▽ More We propose a novel volume conserving framework for character-water interaction, using a novel volume-of-fluid solver on a skinned tetrahedral mesh, enabling the high degree of the spatial adaptivity in order to capture thin films and hair-water interactions. For efficiency, the bulk of the fluid volume is simulated with a standard Eulerian solver which is two way coupled to our skinned arbitrary Lagrangian-Eulerian mesh using a fast, robust, and straightforward to implement partitioned approach. This allows for a specialized and efficient treatment of the volume-of-fluid solver, since it is only required in a subset of the domain. The combination of conservation of fluid volume and a kinematically deforming skinned mesh allows us to robustly implement interesting effects such as adhesion, and anisotropic porosity. We illustrate the efficacy of our method by simulating various water effects with solid objects and animated characters. △ Less

Submitted 2 February, 2019; originally announced February 2019.

Improved Search Strategies with Application to Estimating Facial Blendshape Parameters

Authors: Michael Bao, David Hyde, Xinru Hua, Ronald Fedkiw

Abstract: It is well known that popular optimization techniques can lead to overfitting or even a lack of convergence altogether; thus, practitioners often utilize ad hoc regularization terms added to the energy functional. When carefully crafted, these regularizations can produce compelling results. However, regularization changes both the energy landscape and the solution to the optimization problem, whic… ▽ More It is well known that popular optimization techniques can lead to overfitting or even a lack of convergence altogether; thus, practitioners often utilize ad hoc regularization terms added to the energy functional. When carefully crafted, these regularizations can produce compelling results. However, regularization changes both the energy landscape and the solution to the optimization problem, which can result in underfitting. Surprisingly, many practitioners both add regularization and claim that their model lacks the expressivity to fit the data. Motivated by a geometric interpretation of the linearized search space, we propose an approach that ameliorates overfitting without the need for regularization terms that restrict the expressiveness of the underlying model. We illustrate the efficacy of our approach on minimization problems related to three-dimensional facial expression estimation where overfitting clouds semantic understanding and regularization may lead to underfitting that misses or misinterprets subtle expressions. △ Less

Submitted 16 August, 2020; v1 submitted 6 December, 2018; originally announced December 2018.

Cluster Computing: A High-Performance Contender

Authors: Mark Baker, Rajkumar Buyya, Dan Hyde

Abstract: When you first heard people speak of Piles of PCs, the first thing that came to mind may have been a cluttered computer room with processors, monitors, and snarls of cables all around. Collections of computers have undoubtedly become more sophisticated than in the early days of shared drives and modem connections. No matter what you call them, Clusters of Workstations (COW), Networks of Workstat… ▽ More When you first heard people speak of Piles of PCs, the first thing that came to mind may have been a cluttered computer room with processors, monitors, and snarls of cables all around. Collections of computers have undoubtedly become more sophisticated than in the early days of shared drives and modem connections. No matter what you call them, Clusters of Workstations (COW), Networks of Workstations (NOW), Workstation Clusters (WCs), Clusters of PCs (CoPs), clusters of computers are now filling the processing niche once occupied by more powerful stand-alone machines. This article discusses the need for cluster computing technology, Technologies, Components, and Applications, Supercluster Systems and Issues, The Need for a New Task Force, and Cluster Computing Educational Resources. △ Less

Submitted 22 September, 2000; originally announced September 2000.

ACM Class: C0