It looks like you're new here. If you want to get involved, click one of these buttons!
It is not in the cave, but outside on the wall. I think NE part of the map.
If you bring to giant something he requires, he will solve your quest as he will know that you' ve found this ladder for him. You cannot pick up the ladder.