Deepa, A., Siddalingappa, Rashmi ORCID: https://orcid.org/0000-0001-9786-8436, Kalpana, P., Loveline Zeema, J., Vinay, M., Jayapriya, J., Suganthi, J. and Priya Stella Mary, I.
(2025)
A Comparative Analysis of L1, L2, and L1L2 Regularization Techniques in Neural Networks for Image Classification.
International Journal of Engineering Trends and Technology, 73 (10).
pp. 107-116.
Preview |
Text
Dec_1 (1).pdf - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. | Preview |
Abstract
The research examines how L1, L2, and L1L2 weight regularization methods affect neural network performance, generalization, and sparsity using the CIFAR 10 dataset. A Convolutional Neural Network (CNN) trained with the same environment for each regularization method to evaluate test accuracy, weight sparsity, and computational speed. The study shows that L1 regularization produces sparse weights, which makes models more interpretable, and L2 regularization helps prevent overfitting while improving model generalization. The combination of L1L2 regularization enables individual image classification methods to reach test accuracy. The results indicate that the weight regularization plays a vital role in creating neural networks that are both stable and efficient. They are interpretable, and L2 regularization improves generalization and reduces overfitting. The combined L1L2 regularization achieves the balance between sparsity and performance, leading to higher test accuracy compared to individual techniques for image classification. The research results demonstrate that weight regularization stands as an essential factor for Creating Neural Networks that are robust, efficient, and interpretable, thus helping to enhance Deep Learning model performance.
| Item Type: | Article |
|---|---|
| Status: | Published |
| DOI: | 10.14445/22315381/IJETT-V73I10P108 |
| Subjects: | Q Science > Q Science (General) > Q325 Machine learning |
| School/Department: | London Campus |
| URI: | https://ray.yorksj.ac.uk/id/eprint/13439 |
University Staff: Request a correction | RaY Editors: Update this record
Altmetric
Altmetric