He has always played in challenging home run parks. Comiskey Park was 352 down the lines (with 12 foot high walls), 375 to the alleys and 410 to CF. Cleveland Municipal Stadium was 395 to the alleys and 410 to CF.
Minnie still finished top 10 in slugging eight times, including second behind Williams in 1954 (and finished with the highest bWAR that season). Minoso was a 13 time All Star, Top 4 four times in MVP balloting, finished with a .299 / .387 / .461 career.
Certainly a better addition to the HOF than most of the Veterans Committee elected White Sox already in the HOF, who also did not have the biographical background and discriminatory burdens Minoso faced.