I installed a folding ladder on Ananda's transom (more for the MOB case than the swimming case - one does not generally go swimming in SF Bay willingly). It's on the exhaust side, but small enough to avoid any issues there.

[Linked Image from i.imgur.com]

While sailing, a short tie keeps it elevated above the waterline for the most part.