What visualizations have you found useful for Bayesian optimization, and why?

[sgbaird]

Some examples of visualizations:

• “Best so far” optimization traces
• Tradeoff / Pareto frontiers
• cross-validation
• 1D slice
• 2D contours