main webpage
W Topic
Computer Science
arXiv (Cornell University)
Explicit Regularisation in Gaussian Noise Injections
2020
We study the regularisation induced in neural networks by Gaussian noise injections (GNIs). Though such injections have been extensively studied when applied to data, there have been few studies on understanding the regularising effect they induce when applie…
Article

Computer Science

Study of computation

Computer science is the study of computation, information, and automation. Computer science spans theoretical disciplines (such as algorithms, theory of computation, and information theory) to applied disciplines (including the design and implementation of hardware and software).

Algorithms and data structures are central to computer science. The theory of computation concerns abstract models of computation and general classes of problems that can be solved using them. The fields of cryptography and computer security involve studying the means for secure communication and preventing security vulnerabilities. Computer graphics and computational geometry address the generation of images.

Exploring foci of:
arXiv (Cornell University)
Explicit Regularisation in Gaussian Noise Injections
2020
We study the regularisation induced in neural networks by Gaussian noise injections (GNIs). Though such injections have been extensively studied when applied to data, there have been few studies on understanding the regularising effect they induce when applied to network activations. Here we derive the explicit regulariser of GNIs, obtained by marginalising out the injected noise, and show that it penalises functions with high-frequency components in the Fourier domain; particularly in layers closer to a neural ne…
Click Computer Science Vs:
Gaussian Noise
Gaussian Function
Mathematics
Medicine
Artificial Intelligence
Algorithm
Physics
Quantum Mechanics