Applied Deep Learning 2022 - Lecture 9 - Preprocessing, Augmentation, Regularization, Visualization

About this lesson

Complete Playlist: https://www.youtube.com/playlist?list=PLNsFwZQ_pkE_QaTwYxoTmmRJHtMXyIAU6 == Literature == 1. GradVis: Visualization and Second Order Analysis of Optimization Surfaces during the Training of Deep Neural Networks: https://arxiv.org/pdf/1909.12108v1.pdf 2. Synthetic Data for Deep Learning: https://arxiv.org/pdf/1909.11512v1.pdf 3. Deep Learning for Visual Computing: https://github.com/cpra/dlvc2016 4. Learning Data Augmentation Strategies for Object Detection: https://arxiv.org/abs/1906.11172 5. Wu, Lim, Davis, Goldstein. Making and Invisibility Cloak: Real World Adversarial Attacks on Object Detectors. 2019 https://arxiv.org/abs/1910.14667 6. Goodfellow, Shlens, Szegedy. Explaining and Harnessing Adversarial Examples. 2015. https://arxiv.org/abs/1412.6572 7. DocCreator. https://doc-creator.labri.fr/ 8. Ma. Data Augmentation for Audio. 2019. https://medium.com/@makcedward/data-augmentation-for-audio-76912b01fdf6 9. Park, Chan, Zhang, Chiu, Zoph, Cubuk, Le. SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition. 2019. https://arxiv.org/abs/1904.08779 10. Zach C. State of the Art Audio Data Augmentation with SpecAugment and PyTorch. 2019: https://towardsdatascience.com/state-of-the-art-audio-data-augmentation-with-google-brains-specaugment-and-pytorch-d3d1a3ce291e 11. Kanburoğlu. https://github.com/alibugra/audio-data-augmentation 12. Srivastava, Hinton, Krizhevsky, Sutskever, Salakhutdinov. Dropout: A Simple Way to Prevent Neural Networks from Overfitting: http://www.jmlr.org/papers/volume15/srivastava14a/srivastava14a.pdf 13. Wei, Zou. EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks. 2019. https://arxiv.org/abs/1901.11196v2 14. George Washington Papers. https://www.loc.gov/resource/mgw1b.481/?sp=68 15. Prince. Computer Vision Models. 2012 16. Xie, Dai, Hovy, Luong, Le. Unsupervised Data Augmentation for Consistency Training. https://arxiv.org/abs/1904.12848v4 17. DeVries, Taylo

Original Description