@DePemig The filtering could be done on the client side. But if I were to implement this in server-to-server context, I would probably add a new property to Follow activity, e.g. filter.
Another example from the sender side: I am a music group and I would like to invite people to: "Follow #concert_announcement for @mycrazycoolband"
If filters are static, they could be implemented as groups / circles.