MPs heard it is "frankly terrifying" that just 3% of gun certificate applications are turned down amid widespread failings.
One MP even said a constituent is in hiding because their ex has had his weapons returned to him.
The government is under pressure to tighten gun laws after a string of catastrophic errors came to light at an inquest into the Plymouth killings, which claimed five innocent lives.