I fully expect them to join at some point before the end of the series like maybe right before they're ready to go to Laugh Tale, but I understand people's disappointment. I always just choose to trust in Oda's decisions that it'll work itself out in the end