• Switch to extensions sidebar
• Refresh page
• Dismiss button disappears after a while

If a different sidebar is showing while VS Code loads then you switch to the extensions sidebar everything is OK. It's only when you load the page with the extensions sidebar enabled.