[cod] why can’t I join my friends party?

I checked my Xbox and cod settings and nothing lets me join them, is there a fix for this, or at least an explanation?