Swisher is not a fantastic defensive first baseman and Konerko's bat is a downgrade from Thome's. You downgrade offensively at three spots, two of which are the most important for hitters, just to gain a little defensive upgrade at an offensive position and a defensive upgrade in defensive position (assuming Ozzie is still willing to play BA and not trot Wise or Owens out there more than half the time.)
That's a net loss