The parts that are work are the job, but extracting rents for owning something is not work. I realise it's not a clean break, but the idea is landlords usually get a lot more value than they put in.
Whereas most of us work jobs that take more value from our labour than they'd ever actually pay us for.