I always see ActivityPub as a simple glue to existing model of social media networks.
If we want to decentralize further and further the end goal would be a serverless message format with public/private key cryptography build on something like Yggdrasil or GnuNET network.