Menubar meetings won't go away

I just installed the new macOS update and am excited to see some calendar integration!

Unfortunately, even though the option to show upcoming events in my Mac's menu bar is disabled, it still shows the event in the menu bar. I've restarted the app and it still does not help. See below:

For now, I'm forced to use Bartender app to hide this item from the menu bar.