The coins are on the blockchain, what you save in a wallet are the keys to access them.
Contrary to the common believe you don't need a hardware wallet to keep your keys safe, what you really need is a air gapped or cold storage and you can achieve this in many ways. I found that one of the best ways to do it is grabbing an old phone and following this guide
Tldr: install the wallet and never connect the phone to the internet again and use QR codes to sign transactions using the camera. Super practical, cheap, truly air gapped and doesn't attract attention like a hardware wallet. Additionally I would disable the wallet app when you don't use it, so the wallet will not be visible in case someone else grabs the phone (you can do this by installing the app as a system app using adb). And don't forget to save the seeds of the wallet in safe place and always use fully FOSS wallets like electrum.