Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A Data-Driven Evaluation Approach for Assessing Student Nurse Training Effectiveness in Clinical Practice Using A Fuzzy Mathematics Model

Yanmei Liu, Yuwen Chen
doi: https://doi.org/10.1101/2020.09.28.20203570
Yanmei Liu
1Huaian First People’s Hospital, Huaian, Jiangsu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yuwen Chen
2Huaiyin Institute of Technology, Huaian, Jiangsu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: feiyuce@gmail.com
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

The overall performance of student nurses during training and subsequent medical treatment practice has a direct effect on the quality of healthcare they provide in hospitals. The evaluation of student nurses’ overall performance is usually not straightforward, as the evaluation criteria includes many aspects and it’s difficult to develop a generic metric. Fuzzy mathematics provides a mathematical tool for processing data with fuzziness. Using fuzzy mathematics theory enables data-driven evaluation of the overall performance of student nurses after their training program.

INTRODUCTION

Nursing demands much practice. Student nurses need to learn skills and develop positive attitudes and actions in clinical medical treatment practice. As a result, clinical nursing practice is an important topic in nursing education. The quality of clinical nursing practice has a direct effect on healthcare quality. Nursing education needs to train student nurses with high nursing skills. To ensure and improve the all-around quality of student nurses, it is important to establish a system that evaluates the overall quality of student nurses [1, 2].

Data-driven evaluation has been used in evaluating the performance of various clinical procedures and medical treatments [3-16]. In this research, we use a system-based on the data-driven fuzzy mathematics theory [17-23] to evaluate the overall quality of student nurses in medical treatment practice through a quantitative method. In this approach, we turn qualitative indicators into quantitative indicators based on a variety of clinical-relevant indicators.

THEORY

Fuzzy mathematics is an emerging field after classical mathematics and mathematical statistics. Fuzzy mathematics expand the application of mathematics from precise phenomena to fuzzy phenomena. It mainly researches on the inaccurate inherent cases of things, which reflects the uncertain classification of things arising from the transition between differences. It is not reasonable to classify the overall quality of student nurses into ‘high’ and ‘low’; on the contrary, through the statistical analysis of qualitative indicators, we may get a scientific evaluation. As the overall quality of student nurses is changing over time, evaluating the overall quality of student nurses by evaluating the membership conditions of those indicators affecting nurses’ quality to the overall quality of student nurses will be effective. During the evaluation, indicators under consideration form the indicator set, and the levels of evaluation form the evaluation set [18].

Building a fuzzy general evaluation model contains the following steps:

Step 1 Determine the indicator set of the objects:

U = {u1,u2, … un} are the quality indicators of objects, namely, the Assessment indicators in the evaluation;

Step 2 Determine the evaluation set:

V ={v1, v2,…, vm} are levels given to the objects in the evaluation, such as excellent, good, and bad.

Step 3 Establish the evaluation matrix: Embedded Image

Step 4 General evaluation: Embedded Image

MATERIALS AND METHODS

Subjects

208 student nurses were clinically trained in our hospital during 2010. Among those students, 18 are undergraduates. Among them, there are one 23-year-old male and 17 female students. Six of them are 22 years old, eight students are 23 years old and three students are 24 years old. Besides, the participants include 190 junior college students, all females, aging from 18 to 22. Among them, 3 students are 18 years old,18 students are 19 years old, 38 students are 20 years old, 107 students are 21 years old and 24 students are 22 years old. The average age of the students is 20.88±1.05 years old.

Referees

The referees include 50 nursing teachers and 50 patients, who evaluated the overall quality of student nurses. Among the nursing teachers, one teacher is the deputy director of nurse, 21 teachers are staff nurses, and 28 teachers are ordinary nurses. All of them have work over 8 years. In terms of their teaching experiences, 22 teachers have teaching experience of more than 5 years, 28 teachers have teaching experience of about 3 to 5 years. 12 teachers are leaders of the nurse and 38 teachers are clinical caregivers. Patients involved in our research come into the hospital for over 5 days; all have a degree higher than junior high school. The patients were able to read and understand our questionnaires.

Establishing the mathematic model of the overall quality evaluation system of student nurses

According to the general fuzzy evaluation model, we need to generally analyze indicators which affect student nurses’ quality and establish the indicator system with the help of reasonable evaluation indexes. Then we determine the index proportion through multi-factor statistical methods according to evaluation criteria, standardized evaluation indexes, and the qualified membership function. Finally, we combine the index qualified data and proportion vector, getting a total score, with which we then evaluate the overall quality of student nurses.

Establishing the evaluation indicators set

The overall quality of student nurses is mainly determined by their basic quality of career and clinical skills. Both of the two dimensions involve in several indicators. We determined the indicator set of the objects U = {u1,u2, … un} considering most of the factors affecting the quality of student nurses according to their practice situation, in order to completely evaluate the quality of student nurses. Considering the fact that there are several factors, this research uses a sub-model containing several sub-indicators, as the following graph shows: Embedded Image In this graph, the Primary factor set is defined to be Embedded Image The sub-factor sets are defined to be Embedded Image As shown above, there are 2 primary indicators and 5 sub-indicators in each primary indicator.

Determining the evaluation set

The evaluation set, also called the determination set or the decision-making set, is the evaluation level of every factors in the factor set. Assuming that the evaluation set V = {v1,v2, …, vm} can be divided into 4 levels in the evaluation model; they are excellent-quality, good-quality, middle-quality and low-quality, as follows: Embedded Image

Single-factor evaluation

We gave out 100 questionnaires to patients and teachers of student nurses in department of cardio-thoracic surgery, department of orthopedics, department of pneumology, department of Cardiology, department of Gastrointestinal surgery. Patients and teachers use the same questionnaires, 50 pieces for each. The teachers filled in the questionnaire on the scene, which were all collected immediately. Besides, questionnaires given to patients were delivered with thorough explanation; only 1 patient would receive the questionnaire per room, which was collected 20mins afterwards; 45pcs are collected. In a sum, 95pcs questionnaire were collected and 85 of them are valid and helpful. We get the single evaluation of the 10 sub-indicators belonging to the two primary indicators after analyzing the 85 valid questionnaires.

Evaluating the five factors in the factor set: Embedded Image we have:

View this table:
  • View inline
  • View popup

This is the single evaluation matrix Embedded Image when conducting single-factor evaluation of the five factors in the primary-indicator factor U1, that is to say, establishing fuzzy maps. cij is the ballot number v j that ui get. Then we have: Embedded Image Evaluating the five factors in the factor set: Embedded Image we have:

View this table:
  • View inline
  • View popup
  • Download powerpoint

This is the single evaluation matrix Embedded Image when conducting single-factor evaluation of the five factors in the primary-indicator factor U2, that is to say, establishing fuzzy maps. cij is the ballot number v j that ui gets. Then we have: Embedded Image

Determining the indicator portions

We assign different scale factor to show the importance of different objects in the general fuzzy evaluation procedure. This is called weighting. The scale factor is affected mainly by the importance of the objects. In this passage, different indicators differ from their effects on the evaluation of the overall quality of student nurses. For instance, in terms of the two primary indicators, “clinical skills” is relatively more important; what’s more, among qualities of clinical skills, “nursing skills” is also more important. We need to do research through questionnaires to determine the circumstances above. As a result, by assign the scale factor, the effect of the major factors can be enhanced, which adds to the accuracy of our research.

Assuming that the weighting set of primary indicators is A, we score the two primary indicators through questionnaires, then we determine the weighting according to the score. Because of the two primary indicators, A = (a1, a2). In the equation, Embedded Image is the weighting set, that is, the fuzzy weighting vector. ai is the weighting of the ith primary indicator.

In this research, we determine the scale factor through questionnaires. Specifically, we ask the evaluators to score the importance of the three indicators, which makes this research much more scientific. We definite “very important” 4 points, “a little important” 3 points, “so-so” 2 points, “not important” 1 point. Then, we calculate the portion of each score and determine the weighting.

RESULTS

Through questionnaires, we have:

View this table:
  • View inline
  • View popup
  • Download powerpoint

According to this, we can work out the score of each primary indicator. They are: Basic career skills 395 points, clinical skills 328 points. As a result, we can determine the weighting of each choice according to the proportion of each primary-indicator score: Embedded Image Similarly, we assume that the weighting sets of sub-indicators are A1, A2. Then, there are: A1 = (A11, A12, A13, A14, A15), A2 = (A21, A22, A23, A24, A25), in it,Embedded Image.

For the determination of sub-indicators, we get the statistics table with the help of the questionnaires. We set “NO.1” 5 points (which means the most important), set “NO.2” 4 points, “NO.3” 3 points, set “NO.4” 2 points, and set “NO.5” 1 point (which means the least important).

The ranking of the five sub-indicators below “basic career quality” is as follows:

View this table:
  • View inline
  • View popup

The scores of the five indicators are 360, 260, 206, 203, 244. According to the proportion of those scores, we can get the weighting: Embedded Image In a word, weighting is the most important part of fuzzy general evaluation, which reflects the status of every factor. In this project, almost any professor can hardly show an accurate data because of the large number of factors involved. Considering this case, we choose questionnaire (multi-factor statistic methods) to determine the weighting, which is more scientific and has little effect on the evaluation result.

General evaluation of the sub-factor set

In this passage, we use weighted statistical method to estimate the weight of each factor in the sub-factor set. With the former result that the weighting set of the five factors in U1 is A1 = (0.2828,0.2042,0.1618,0.1595,0.2702), we generally evaluate the sub-factor set U1 = (moral,observation ablity,independent thinking,expression skills,spirits), calculate with M (·, +), getting Embedded Image.

The general evaluations on the career basic quality are as follows: Embedded Image Similarly, evaluate on the sub-factor set Embedded Image we have: Embedded Image

General evaluation of the primary factor set

After generally evaluate the sub-factor set U1,U2, we can get the evaluation matrix R of the primary set U = (basic quality of career,quality of clinical skills), the rows of which are Embedded Image, that is: Embedded Image We generally evaluate on it, and have: Embedded Image According to the real situation of our survey, we classify the overall quality of student nurses in our hospital into “high”, “good”, “average” and “low”. Then we correspond the four data we get in our overall evaluation with the evaluation set made of these four level V ={v1, v2, v3, v4} ={excellent-quality, good-quality, middle-quality, low-quality}. The final results are 0.5638 > 0.2462 > 0.2225 > 0.0199, so the overall quality of student nurses in our hospital is “good”.

DISCUSSION

This research shows a novel method in our hospital to evaluate the overall quality of student nurses. We first describe the fuzzy indicators reflecting evaluated things with membership function by constructing a fuzzy membership set, then generally evaluate every indicator using Fuzzy transformation theory. We use a quantitative method, which turn qualitative indicators into quantitative ones and consequently improve the accuracy of our research. This practice provides comparable basis for our hospital to take measures to improve the overall quality of student nurses, which make the decision much more scientific and reasonable. In our research, 2 primary indicators and 10 sub-indicators are used. Through questionnaires, we get the evaluation of the overall quality of student nurses in our hospital from the teachers and patients and then systematically analyze the overall quality of student nurses, which is comprehensive and effective. The final result shows that the overall quality of student nurses in our hospital is “good”, which corresponds to the clinical practice reality and is helpful to the future teaching in our hospital. This method is demonstrated to enable data-processing and analysis of the overall data-driven quality indicator model in the clinical evaluate of the nursing student training quality and effectiveness.

Data Availability

Data is not available for public access.

REFERENCES

  1. [1].↵
    Feng X, Zhou T, Zhou X, etc. Evaluation of quality of clinical nursing teaching. Journal of international nursing. 2007, 26(4):422;
    OpenUrl
  2. [2].↵
    Ren Q. Focusing on nursing teaching and enhancing the cultivating the quality of student nurses. Journal of Qilu nursing. 2008, 14(3);
  3. [3].↵
    Lerner A, Chrysanthou Y, Shamir A, Cohen-Or D. Data driven evaluation of crowds. In International Workshop on Motion in Games 2009 Nov 21 (pp. 75-83). Springer, Berlin, Heidelberg.
  4. [4].
    Chen F, Shi X, Chen S, Johnson EM, Chen B, Ren G, Wei X, Wang S, Ying K. Accelerated model-based proton resonance frequency shift temperature mapping using echo-based GRAPPA reconstruction. Magnetic resonance imaging. 2015 Feb 1;33(2):240–5.
    OpenUrl
  5. [5].
    Galelli S, Humphrey GB, Maier HR, Castelletti A, Dandy GC, Gibbs MS. An evaluation framework for input variable selection algorithms for environmental data-driven models. Environmental Modelling & Software. 2014 Dec 1;62:33–51.
    OpenUrl
  6. [6].
    Brewster C, Alani H, Dasmahapatra S, Wilks Y. Data driven ontology evaluation.
  7. [7].
    Büther F, Vehren T, Schäfers KP, Schäfers M. Impact of data-driven respiratory gating in clinical PET. Radiology. 2016 Oct;281(1):229–38.
    OpenUrl
  8. [8].
    Chen F, Taviani V, Malkiel I, Cheng JY, Tamir JI, Shaikh J, Chang ST, Hardy CJ, Pauly JM, Vasanawala SS. Variable-density single-shot fast spin-echo MRI with deep learning reconstruction by using variational networks. Radiology. 2018 Nov;289(2):366–73.
    OpenUrl
  9. [9].
    Shalom E, Shahar Y, Lunenfeld E. An architecture for a continuous, user-driven, and data- driven application of clinical guidelines and its evaluation. Journal of Biomedical Informatics. 2016 Feb 1;59:130–48.
    OpenUrl
  10. [10].
    Cheng JY, Chen F, Sandino C, Mardani M, Pauly JM, Vasanawala SS. Compressed sensing: from research to clinical practice with data-driven learning. arXiv preprint arxiv:1903.07824. 2019 Mar 19.
  11. [11].
    Chen F, Cheng JY, Pauly JM, Vasanawala SS. Semi-Supervised Learning for Reconstructing Under-Sampled MR Scans. Proceedings of the 27th Annual Meeting of ISMRM 2019.
  12. [12].
    Wu B, Ricchetti F, Sanguineti G, Kazhdan M, Simari P, Jacques R, Taylor R, McNutt T. Data-driven approach to generating achievable dose–volume histogram objectives in intensity- modulated radiotherapy planning. International Journal of Radiation Oncology* Biology* Physics. 2011 Mar 15;79(4):1241–7.
    OpenUrlPubMed
  13. [13].
    Chen F, Cheng JY, Taviani V, Sheth VR, Brunsing RL, Pauly JM, Vasanawala SS. Data-driven self-calibration and reconstruction for non-cartesian wave-encoded single-shot fast spin echo using deep learning. Journal of Magnetic Resonance Imaging. 2020 Mar;51(3):841–53.
    OpenUrl
  14. [14].
    Gudadhe M, Wankhade K, Dongre S. Decision support system for heart disease based on support vector machine and artificial neural network. In2010 International Conference on Computer and Communication Technology (ICCCT) 2010 Sep 17 (pp. 741-745). IEEE.
  15. [15].
    Cheng JY, Chen F, Alley MT, Pauly JM, Vasanawala SS. Highly scalable image reconstruction using deep neural networks with bandpass filtering. arXiv preprint arxiv:1805.03300. 2018 May 8.
  16. [16].↵
    Lipkovich I, Dmitrienko A, B D’Agostino Sr R. Tutorial in biostatistics: data-driven subgroup identification and analysis in clinical trials. Statistics in medicine. 2017 Jan 15;36(1):136–96.
    OpenUrlCrossRefPubMed
  17. [17].↵
    Buckley JJ. The fuzzy mathematics of finance. Fuzzy sets and systems. 1987 Mar 1;21(3):257– 73.
    OpenUrlCrossRefWeb of Science
  18. [18].↵
    Mordeson JN. Fuzzy mathematics. In Foundations of Image Understanding 2001 (pp. 95–125). Springer, Boston, MA.
  19. [19].
    Höhle U, Rodabaugh SE. Mathematics of fuzzy sets: logic, topology, and measure theory. Springer Science & Business Media; 2012 Dec 6.
  20. [20].
    Wolkenhauer O. Data engineering: fuzzy mathematics in systems theory and data analysis. John Wiley & Sons; 2004 Apr 7.
  21. [21].
    Jiang W, Deng L, Chen L, Wu J, Li J. Risk assessment and validation of flood disaster based on fuzzy mathematics. Progress in Natural Science. 2009 Oct 10;19(10):1419–25.
    OpenUrl
  22. [22].
    Liu L, Zhou J, An X, Zhang Y, Yang L. Using fuzzy theory and information entropy for water quality assessment in Three Gorges region, China. Expert Systems with Applications. 2010 Mar 15;37(3):2517–21.
    OpenUrl
  23. [23].↵
    Zhang RJ, Hou BH. Assessment on the introduction risk of Bactrocera dorsalis (Hendel) through imported fruits with fuzzy mathematics. Acta Entomologica Sinica. 2005;2.
View Abstract
Back to top
PreviousNext
Posted October 27, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A Data-Driven Evaluation Approach for Assessing Student Nurse Training Effectiveness in Clinical Practice Using A Fuzzy Mathematics Model
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A Data-Driven Evaluation Approach for Assessing Student Nurse Training Effectiveness in Clinical Practice Using A Fuzzy Mathematics Model
Yanmei Liu, Yuwen Chen
medRxiv 2020.09.28.20203570; doi: https://doi.org/10.1101/2020.09.28.20203570
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
A Data-Driven Evaluation Approach for Assessing Student Nurse Training Effectiveness in Clinical Practice Using A Fuzzy Mathematics Model
Yanmei Liu, Yuwen Chen
medRxiv 2020.09.28.20203570; doi: https://doi.org/10.1101/2020.09.28.20203570

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Nursing
Subject Areas
All Articles
  • Addiction Medicine (62)
  • Allergy and Immunology (142)
  • Anesthesia (46)
  • Cardiovascular Medicine (415)
  • Dentistry and Oral Medicine (70)
  • Dermatology (47)
  • Emergency Medicine (144)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (171)
  • Epidemiology (4857)
  • Forensic Medicine (3)
  • Gastroenterology (183)
  • Genetic and Genomic Medicine (676)
  • Geriatric Medicine (70)
  • Health Economics (192)
  • Health Informatics (630)
  • Health Policy (320)
  • Health Systems and Quality Improvement (206)
  • Hematology (85)
  • HIV/AIDS (156)
  • Infectious Diseases (except HIV/AIDS) (5339)
  • Intensive Care and Critical Care Medicine (331)
  • Medical Education (93)
  • Medical Ethics (24)
  • Nephrology (75)
  • Neurology (686)
  • Nursing (42)
  • Nutrition (115)
  • Obstetrics and Gynecology (126)
  • Occupational and Environmental Health (208)
  • Oncology (439)
  • Ophthalmology (140)
  • Orthopedics (36)
  • Otolaryngology (89)
  • Pain Medicine (35)
  • Palliative Medicine (16)
  • Pathology (129)
  • Pediatrics (194)
  • Pharmacology and Therapeutics (131)
  • Primary Care Research (84)
  • Psychiatry and Clinical Psychology (780)
  • Public and Global Health (1816)
  • Radiology and Imaging (324)
  • Rehabilitation Medicine and Physical Therapy (138)
  • Respiratory Medicine (255)
  • Rheumatology (86)
  • Sexual and Reproductive Health (69)
  • Sports Medicine (62)
  • Surgery (100)
  • Toxicology (23)
  • Transplantation (29)
  • Urology (37)