For anyone running a ROM based very closely on AOSP, the ability to disable Fast Pair was sadly not built into the OS until Android 14
Before Android 14, it is possible that Google has backported this setting to your device using Play Services. It can be found under Google Settings, Devices and sharing, Devices, and "Show Notifications"