Can overfitted deep neural networks in adversarial training generalize? – An approximation viewpoint
Can overfitted deep neural networks in adversarial training generalize? – An approximation viewpoint (2024)
In this talk, I will discuss whether overfitted DNNs in adversarial training can generalize from an approximation viewpoint. We prove by construction the existence of infinitely many adversarial training classifiers on over-parameterized DNNs that obtain arbitrarily small adversarial training error (overfitting), whereas achieving good robust generalization error under certain conditions concerning the data quality, well separated, and perturbation level. This construction is optimal and thus points out the fundamental limits of DNNs under adversarial training with statistical guarantees. Part of this talk comes from our recent work.
Free Trial ChannelsAD
With 7-Day Free Trial
Can overfitted deep neural networks in adversarial training generalize? – An approximation viewpoint
2024 / 0 hr 52 minIn this talk, I will discuss whether overfitted DNNs in adversarial training can generalize from an approximation viewpoint. We prove by construction the existence of infinitely many adversarial training classifiers on over-parameterized DNNs that obtain arbitrarily small adversarial training error (overfitting), whereas achieving good robust generalization error under certain conditions concerning the data quality, well separated, and perturbation level. This construction is optimal and thus points out the fundamental limits of DNNs under adversarial training with statistical guarantees. Part of this talk comes from our recent work.
Watch Trailer
With 7-Day Free Trial
Cast
Popular Movies on Apple TV+
Popular TV Shows on Apple TV+
