Quick Search:

A Comparative Analysis of L1, L2, and L1L2 Regularization Techniques in Neural Networks for Image Classification

Deepa, A., Siddalingappa, Rashmi ORCID logoORCID: https://orcid.org/0000-0001-9786-8436, Kalpana, P., Loveline Zeema, J., Vinay, M., Jayapriya, J., Suganthi, J. and Priya Stella Mary, I. (2025) A Comparative Analysis of L1, L2, and L1L2 Regularization Techniques in Neural Networks for Image Classification. International Journal of Engineering Trends and Technology, 73 (10). pp. 107-116.

[thumbnail of Dec_1 (1).pdf]
Preview
Text
Dec_1 (1).pdf - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

| Preview

Abstract

The research examines how L1, L2, and L1L2 weight regularization methods affect neural network performance, generalization, and sparsity using the CIFAR 10 dataset. A Convolutional Neural Network (CNN) trained with the same environment for each regularization method to evaluate test accuracy, weight sparsity, and computational speed. The study shows that L1 regularization produces sparse weights, which makes models more interpretable, and L2 regularization helps prevent overfitting while improving model generalization. The combination of L1L2 regularization enables individual image classification methods to reach test accuracy. The results indicate that the weight regularization plays a vital role in creating neural networks that are both stable and efficient. They are interpretable, and L2 regularization improves generalization and reduces overfitting. The combined L1L2 regularization achieves the balance between sparsity and performance, leading to higher test accuracy compared to individual techniques for image classification. The research results demonstrate that weight regularization stands as an essential factor for Creating Neural Networks that are robust, efficient, and interpretable, thus helping to enhance Deep Learning model performance.

Item Type: Article
Status: Published
DOI: 10.14445/22315381/IJETT-V73I10P108
Subjects: Q Science > Q Science (General) > Q325 Machine learning
School/Department: London Campus
URI: https://ray.yorksj.ac.uk/id/eprint/13439

University Staff: Request a correction | RaY Editors: Update this record