Seems like Monica or BookStack would fit your criteria. I looked into Monica for a similar reason but ultimately it seemed like too much work to organize every person in my life so meticulously. But if that's what you want, it might be perfect for you.