I don't use jellyfin and I stopped using a raspi as media pc. My new media pc doesn't have an IR receiver so I use a mini bluetooth keyboard. While I used a raspi on my tv I had to dowload the correct IR package for the raspian distro I used and configured it. Or you could use Librelelec which has the IR support OOTB and check if there is a jellyfin plugin