You can turn that off pretty easily. The AppleTV+ app has the ability to configure how it uses that little quick look space. You can set it to only display your “up next” content.
Any apps in that dock region can show featured content when they are highlighted by the user. Any app can do that, not just Apple’s. Quite a few third party apps use that space to show featured or watchlist content.