The yellow banner has a little box at the right side, like other system notifications, that will dismiss/disable it.

I don't know if that is thread-specific or a general preference setting.

- Leigh