I'd recommend looking at the Wyoming/Piper/Rhasspy system. There's some really good minds working on it and it's got a big community behind it already. It's also plug and play with Home Assistant which is awesome. It's the system I use and while I'm still fine tuning it for my use cases it's already pretty great.