InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations

Wenbin He, Junpeng Wang, Hanqi Guo, Ko Chih Wang, Han Wei Shen, Mukund Raj, Youssef S.G. Nashed, Tom Peterka

Research output: Contribution to journalArticlepeer-review

60 Citations (Scopus)


We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches have been proposed to mitigate this limitation, those approaches lack the ability to explore the simulation parameters. Our approach allows flexible exploration of parameter space for large-scale ensemble simulations by taking advantage of the recent advances in deep learning. Specifically, we design InSituNet as a convolutional regression model to learn the mapping from the simulation and visualization parameters to the visualization results. With the trained model, users can generate new images for different simulation parameters under various visualization settings, which enables in-depth analysis of the underlying ensemble simulations. We demonstrate the effectiveness of InSituNet in combustion, cosmology, and ocean simulations through quantitative and qualitative evaluations.

Original languageEnglish
Article number8805426
Pages (from-to)23-33
Number of pages11
JournalIEEE Transactions on Visualization and Computer Graphics
Issue number1
Publication statusPublished - 2020 Jan
Externally publishedYes


  • In situ visualization
  • deep learning
  • ensemble visualization
  • image synthesis
  • parameter space exploration

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations'. Together they form a unique fingerprint.

Cite this