Practical Applicability of an AI-Based Automated Classification Model in Elderly Care Institutions
Abstract
This study evaluates the practical applicability of an artificial intelligence (AI)-based automated text classification model in elderly care institutions. While prior research has primarily focused on improving algorithmic performance, limited empirical attention has been given to whether automated outputs demonstrate sufficient alignment with existing manual classification practices in real operational environments. This study reanalyzes a categorized dataset of 1,224 elderly care records to examine predictive agreement from an organizational applicability perspective. A logistic regression classifier with hyperparameter optimization was implemented, and performance was assessed using accuracy, precision, recall, and F1-score metrics. The optimized model achieved an accuracy of 0.790 and a weighted F1-score of 0.780. Category-level analysis indicated stable performance across primary operational classes, although variation in recall was observed in specific categories. The findings suggest that AI-assisted classification may function as a structured support mechanism within institutional documentation workflows. This study contributes empirical evidence regarding feasibility of practical implementation without asserting direct organizational performance transformation.
References
- S. Cheresharov, G. Dragomirov, G. Gustinov, S. Hadzhikoleva, and K. Yotov, "Transforming Nursing Home Care: An Integrated Approach Using Sensors, AI, and Monitoring Technologies," Computer Science and Interdisciplinary Research Journal, Vol. 1, No. 1, 2024.
- T. M. Song, "Trends and Utilization of Health and Welfare Big Data in Korea," Health and Welfare Policy Forum, Vol. 23, No. 3, 2018.
- H. S. Kim, D. J. Ahn, J. H. Lim, and H. Y. Lee, "A Case Study on Automatic Classification of Record Text Using Machine Learning," Journal of the Korean Society for Information Management, Vol. 34, No. 4, 2017.
- H. Sakai and S. S. Lam, "Large Language Models for Health Care Text Classification: Systematic Review," JMIR AI, Vol. 5, e79202, 2026.
- H. J. Park and H. S. Lim, "A Study on the Case Analysis and Introduction of NLP: Analysis Framework and Implications," Journal of IT Services, Vol. 21, No. 2, 2022.
- J. W. Moon, "Design and Performance Evaluation of a Text-Based Machine Learning Model for Automatic Classification of Records of Changes in the Status of Elderly Long-Term Care Recipients," Master’s Thesis, aSSIST University, Seoul, 2025.
- D. Y. Hong and J. S. Huh, "Research Trends in Record Management Using Unstructured Text Data Analysis," Journal of Korean Society for Archives and Records Management, Vol. 23, No. 4, 2023.
- D. H. Lee et al., "Clinical Decision Support System (CDSS) Technology Trends," Electronics and Telecommunications Trends, Vol. 31, No. 3, 2016.
- M. Katebi, M. Bahreini, R. Bagherzadeh, and S. Pouladi, "Artificial Intelligence and Nursing Management: Opportunities, Challenges, and Ethical Considerations—A Scoping Review," Journal of Nursing Management, 2025.
- H. Ryuno, T. Mukaihata, T. Takemura, C. Greiner, and Y. Yamaguchi, "Application of Artificial Intelligence to Electronic Health Record Data in Long-Term Care Facilities: A Scoping Review Protocol," BMJ Open, Vol. 15, e098091, 2025.
- J. W. Gong, G. Y. Kim, Y. S. Kim, and B. D. Oh, "Development of ChatGPT-Based Medical Text Expansion Tool for Synthetic Text Generation," Proceedings of the Korea Society of Computer and Information Conference, 2023.
- S. Y. Shin, "Anonymization of Healthcare Data for Privacy Protection," Communications of the Korean Institute of Information Scientists and Engineers, Vol. 36, No. 6, 2018.
- J. H. Choi, J. H. Seong, M. H. Kim, and H. C. Kwon, "Redefining Entity Types and Generating Training Data for Personal Information De-identification," Journal of KIISE, Vol. 50, No. 2, 2023.
- H. R. Seo, "Development and Utilization of Artificial Intelligence Technology Based on Electronic Medical Records for Improving Hospital Processes," Master's Thesis, University of Ulsan, 2024.
- W. S. Kang et al., "Disability Classification Design Based on Specific Behavior Record Data," Proceedings of the Korea HCI Conference, 2012.
Keywords
Details
| Section | Articles |
| Issue | Vol. 2 No. 2 (2026): Volume 2 Issue 2 (Jun 2026) |
| Published | 2026-06-18 |
| Pages | 38-47 |
License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

