why dont people just go backwards on reverse mountain to find the one piece?

If the one piece is at the end of the grand line, what stopping someone from just taking a shortcut to it like this? Yes, the drawing is shitty, but it should at least get the point across.