Why is my Minecraft not letting me join friends?

To get to these go to settings>account>Privacy and online safety>Xbox live privacy>view details and customize>communication and multiplayer>there are two to make sure set to allow or everybody and a third for invites: You can play with people outside of Xbox live—-Allow.