BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Exploration Article Swipe

MAKE IMPACT

Shikhar Tuli , Niraj K. Jha · YOU? · · 2023 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2308.08666

Researchers constantly strive to explore larger and more complex search spaces in various scientific studies and physical experiments. However, such investigations often involve sophisticated simulators or time-consuming experiments that make exploring and observing new design samples challenging. Previous works that target such applications are typically sample-inefficient and restricted to vector search spaces. To address these limitations, this work proposes a constrained multi-objective optimization (MOO) framework, called BREATHE, that searches not only traditional vector-based design spaces but also graph-based design spaces to obtain best-performing graphs. It leverages second-order gradients and actively trains a heteroscedastic surrogate model for sample-efficient optimization. In a single-objective vector optimization application, it leads to 64.1% higher performance than the next-best baseline, random forest regression. In graph-based search, BREATHE outperforms the next-best baseline, i.e., a graphical version of Gaussian-process-based Bayesian optimization, with up to 64.9% higher performance. In a MOO task, it achieves up to 21.9$\times$ higher hypervolume than the state-of-the-art method, multi-objective Bayesian optimization (MOBOpt). BREATHE also outperforms the baseline methods on most standard MOO benchmark applications.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2308.08666

PDF

https://arxiv.org/pdf/2308.08666

OA Status

green

Cited By

1

Related Works

10

OpenAlex ID

https://openalex.org/W4386044350

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4386044350

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2308.08666

Digital Object Identifier

Title

BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Exploration

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2023

Year of publication

Publication date

2023-08-16

Full publication date if available

Authors

Shikhar Tuli, Niraj K. Jha

List of authors in order

Landing page

https://arxiv.org/abs/2308.08666

Publisher landing page

PDF URL

https://arxiv.org/pdf/2308.08666

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2308.08666

Direct OA link when available

Concepts

Computer science, Bayesian optimization, Baseline (sea), Emulation, Benchmark (surveying), Gaussian process, Heteroscedasticity, Kriging, Pooling, Mathematical optimization, Machine learning, Graph, Bayesian probability, Artificial intelligence, Gaussian, Theoretical computer science, Mathematics, Geology, Economic growth, Geodesy, Physics, Geography, Economics, Oceanography, Quantum mechanics

Top concepts (fields/topics) attached by OpenAlex

Cited by

1

Total citation count in OpenAlex

Citations by year (recent)

2024: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload