I don't know if I'm relieved or not but I had the same glitch. I climbed my boat's rope ladder and found myself falling 30 feet to the ground on an island pretty far away. I ended up building the tiny boat and sailing back...
for a $15 game, it really needs some optimization. I think that would be a higher priority than colors...