Don’t worry about moving up the ladder if it’s not set up on some solid ground, first. It’s unlikely you’d make it to the top, anyway.
It’s also pointless to climb the ladder if it’s going somewhere you don’t want to end up.
Finding a new place to move the ladder to is worth the search. It might take some readjustments and reevaluations, and you might even feel like you are merely moving sideways. But the alternative is only an illusion of progress—moving toward something that doesn’t align with your aptitudes and interests.