Yeah that happened to me, I tried to party with two friends who haven't played in a while, I had the expert flag on and couldn't even start a mission with them in the party, because it was trying to flag it as expert.

The whole system really needs work. Experts only should be a toggle you set similar to friends only or team members only, not hidden under matching settings and hiding all non expert games from you when it's on.