Perhaps people are following the Wikipedia, but this form is by no means exclusive, here the one you prefer is used instead. If there is a physically canonical one it is $\delta(x)=\lim_{\sigma \to 0}\frac{1}{\sigma\sqrt{2\pi}}e^{-x^2/2\sigma^2}$, which contains the Gaussian distribution density with the standard deviation $\sigma$, see here, or a version with the Planck constant in it. Other characteristics of the distribution, like entropy for example, are traditionally expressed in terms of $\sigma$ as well, making this form most convenient for look ups.
In quantum mechanics the Gaussian distribution represents a localized "wave packet" with "characteristic width" $\sigma$, so the limit is a transition to the complete localization of the packet in the "position space". Gaussian wave packets are often used as "typical" in heuristic quantum mechanical calculations, and the ground state of the quantum oscillator happens to be of this form. The Heisenberg uncertainty principle is also usually expressed in terms of standard deviations, $\sigma_x\sigma_p\geq1/2$ (setting the Planck constant to $1$), where $\sigma_x$, $\sigma_p$ are the standard deviations of a wave function and its Fourier transform, which represents the wave function in the "momentum space".
So the $\sigma$ version is most natural from Dirac's point of view, my guess is that rescaling to $a=\sigma\sqrt{2}$ is done by industrious mathematicians, who are less interested in physical meanings. But reversing to $1/a$ is perhaps a step too far even for many of them.