Plot breaks when using relayout with coloraxis and resizing too small #6630

I've made a codepen that captures this issue: https://codepen.io/mofojed/pen/WNYNpBv

The issue seems to be when you have a plot with a coloraxis attribute set and you try and relayout the plot to a size smaller than that axis size. I would expect that it may not draw it, but it shouldn't break the plot.

Steps to Reproduce:

1. Open the Codepen: https://codepen.io/mofojed/pen/WNYNpBv
2. Click the Medium and Large buttons to see the plot resize successfully between medium/large plots
3. Click the Small button
4. Click the Medium and Large buttons again

Expected Results:
3. Plot is resized to a small plot
4. Plot is resized back to a medium/large size

Actual Results:
3. Plot is not resized, error is thrown in the console
4. Plot no longer resizes, and appears to be completely broken.