I have several houses linked together via portals. I usually have no trouble going from one to the other. The one exception has been a connection between an alt's Lavastorm House and their Thurgadin Grand Hall. I try putting portals in those houses to connect the two and they only seem to work the first time.