Here's the problem with the "criminals will still have guns", we do this for nothing else in the criminal code. Otherwise we would have full abortion protections, drugs would be legal, DUIs wouldn't exist, roads wouldn't have speed limits, embezzlement wouldn't be a crime, etc. Every country would have nuclear weapons.
We regulate, restrict and ban literally anything else that causes even a fraction of this death and destruction.