It has happened to me enough times that I can repeat it. If zoning into a different area while your queued instance activates its doesn't send you into your instance but acts as if you are. While for pve the isn't much of an issue because those in the party can vote you out to reset it but in pvp there is nothing to do. Either sit and wait for instance to be over or relog and get the deserter penalty.
