Because he's hit lefties well this season.
But Olivo should have pinch hit. I know it's easy to second guess, and hindsight is 20/20, but Olivo has killed lefties in more ABs than Timo this season, also you present the lefty/righty matchup. There's absolutely no reason Perez should have been left in there.