Who has right of way? baserunner or 1st baseman?

ok. scary incident today. ground ball hit to shortstop. throw was off ..high and to left side of 1st baseman(in runners lane). 1stbaseman comes off base and reaches for throw and doesnt get it. meanwhile baserunner collides with 1st baseman and falls down. thank god everyone was ok. so what player had right of way? i know 1stbaseman probably was in the runners lane but i thought fielder always has right of way for ball and baserunner has to use judgement how to get to base. any comments or answers appreciated.