Background: Medical professionalism is one of the core accreditations by National Medical Commission for Graduate Medical Education competencies as the need to include teaching and assessment of professionalism in the formal curricula for undergraduate and postgraduate medical training has been globally acknowledged. Transmitting professionalism and professional values by role modelling is no longer recognised as sufficient. As this occurred, it became apparent that the evaluation of professionalism needed improvement and there have been calls for new methods to be developed. Assessment of professionalism not only allows for timely feedback to residents to help them improve, but also allows for development of better curriculum to prevent lapses in medical professionalism. This study is done with an aim to establish PMEX as a competent scoring system for the assessment of professionalism among medical students with the following objectives: to analyse the relevance of PMEX in current health scenario, to analyse the feasibility of PMEX in Competency Based Medical Education curriculum, to analyse the comprehensiveness of PMEX scoring system for practical application and to assess the efficacy of PMEX as a formative assessment tool for improvement of professional competency in medical students. This is cross-sectional study done at the Department of Surgery, Jorhat Medical College and Hospital clinical settings- OPD, IPD, pre-operative ward, post-operative ward, Major OT, Minor OT, Casualty and ICU/ITU. Assessors were interviewed to rate the relevance, feasibility and comprehensiveness of each item in P-MEX using a 1-10 numerical rating scale (1 strongly not relevant, 10 completely relevant) and also any comment or suggestion for improvement of PMEX was recorded. The study was conducted after for a duration of 6 months from February 2024 to July 2024 with sample size consisting of 6 faculty and 33 residents of General Surgery. Those who gave consent were included in the study. Exclusion criteria included post graduate residents on District Residency Program and faculty and residents who did not give consent. Sampling method was purposive sampling with pre- validated questionnaire and interview. Preparation of survey questionnaire consisted of four domains: doctor-patient relationship skills, reflective skills, time management and inter- professional relationship skills. Each behaviour was assessed in 5grades:1=unacceptable 2=below expectations 3=meet expectations 4=above expectations and 5=not applicable in this case. Each Resident was assessed by 6 assessors in 8 different obtaining clearance from Institutional Ethics Committee, Jorhat Medical College and Hospital. Feasibility has a mean of 7.34 with a range of 4-9, relevance with a mean of 7.34 and range 4-9. This shows that feasibility and relevance and comprehensiveness of this tool is very relevant in assessment of professionalism. Comprehensiveness has a mean of 7.71 with a range of 5-9. This shows that it is extremely relevant. The average improvement of the results of post-graduates starting from assessment 1 to assessment 8 shows that this tool is efficacious in formative assessment of professionalism among students. Based on the results, it is concluded that P-MEX is a competent scoring system for the assessment of professionalism among medical students.
Professionalism is defined by various scientists and researchers over the period of time. In 2002, Epstein and Hundert defined professional competence as "the habitual and judicious use of
communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and community being served’’.[1] The Royal College of Physicians, United Kingdom defined professionalism as “a set of values, behaviours, and relationships that underpin the trust the public has in doctors”. The American Board of Internal Medicine identified the key elements of professionalism as: altruism, accountability, duty, excellence, honour, integrity and respect for others. The medical educationists from Netherlands defined professionalism in terms of observable behaviours to make assessment feasible.[2] A faculty development initiative tried to build consensus by defining some of the core attributes of professionalism in an effort to make these elements more comprehensive.[3] Elements in initial definitions are easy to identify but difficult to measure as learning outcomes. Subsequent definitions evolved which included behaviours that are observable and to some extent measurable. Hence, it is amenable to assessment and inclusion as a core curricular component. while everyone agrees on the core elements of professionalism, a consensus on a culturally appropriate global definition appears to be lacking. Therefore, it is important for each country and every institution to develop its own definition of professionalism, according to the societal norms of the times and identify its core elements.[4]
Doctors are expected to consistently exhibit professional attitudes, behaviour, values and ethics in their practice. Professionalism is an important component of medicine's contract with society. The concept of the profession of a doctor has changed considerably with the times. Previously, doctors were granted autonomy by the community, with the belief that they would place the welfare of their patients before their own. However, in contemporary society,
This autonomy has been jeopardised by the altered public perception about the role of the doctor. Their behaviour is now observed and scrutinized more closely by the media. Doctors' own attitudes towards their vocation have also changed.[5]
Medical professionalism is one of the core accreditations by National Medical Commission for Graduate Medical Education competencies. Studies have shown that students who demonstrate unprofessional behaviour during their undergraduate and postgraduate education are more likely to be found guilty of unprofessional actions by the monitoring boards after they graduate. Thus, the need to include teaching and assessment of professionalism in the formal curricula for undergraduate and postgraduate medical training has been globally acknowledged. The P-MEX instrument developed by Richard L. Cruess, MD is an evaluation instrument used to assess professionalism in clinical training through a faculty-observed encounter of trainee's behavior either with or without patients. Utilizing a 4-point Likert-type scale, the trainee is evaluated on 24 different directly observable items of medical professionalism which assess skills related to: the doctor-patient relationship, reflection, time management, and interprofessional relationships [6]. Transmitting professionalism and professional values by role modelling is no longer recognised as sufficient. As this occurred, it became apparent that the evaluation of professionalism needed improvement and there have been calls for new methods to be developed. Assessment of professionalism not only allows for timely feedback to residents to help them improve, but also allows for development of better curriculum to prevent lapses in medical professionalism.[7]
This study is done with an aim to establish PMEX as a competent scoring system for the assessment of professionalism among medical students with the following objectives: to analyse the relevance of PMEX in current health scenario, to analyse the feasibility of PMEX in Competency Based Medical Education curriculum, to analyse the comprehensiveness of PMEX scoring system for practical application and to assess the efficacy of PMEX as a formative assessment tool for improvement of professional competency in medical students.
The aim of this project is to establish PMEX as a competent scoring system for the assessment of professionalism among medical students.
Objectives of the project:
Study setting-
Department of Surgery, Jorhat Medical College & Hospital Study duration- 6 months (February 2024 to July 2024)
Study design-
Cross sectional study
Study participants-Faculty and Post graduate residents of Surgery Inclusion criteria–
➢Those who gave written and informed consent for the study.
Exclusion criteria-
➢Post graduate residents on District Residency Program.
➢Faculty and Residents who do not give consent for the study.
Sampling method- Purposive sampling
Sample size- 6 Faculty and 33 Post graduate residents of Surgery. Data Collection Tool- Pre-validated Questionnaire[6] and Interview.
Data collection method:
In Group A, FOI was performed using a flexible fiberoptic bronchoscope with an appropriately sized endotracheal tube preloaded. In Group B, VL was performed using a standard video laryngoscope. All procedures were performed by anesthesiologists with at least five years of experience.
Based on the statistical analysis, the following results are obtained in our study:
Relevance has a mean of 7.34 and range 4-9 (Table1 and Figure 1) which is very relevant as per the scoring system
Table 1: Relevance of P-MEX
|
OPD |
CASUALTY |
IPD |
PREOP WARD |
POSTOP WARD |
ICU |
MAJOR OT |
MINOR OT |
Doctor – Patient Relationship skills |
8 |
7 |
9 |
8 |
8 |
7 |
8 |
7 |
Reflective skills |
9 |
7 |
8 |
8 |
8 |
7 |
7 |
8 |
Time managment skills |
7 |
6 |
9 |
9 |
8 |
8 |
9 |
8 |
Inter – professional relationship skills |
7 |
4 |
6 |
6 |
6 |
5 |
6 |
7 |
Figure 1: Relevance of P-MEX
Feasibility has a mean of 7.34 with a range of 4-9 (Table 2 and Figure 2) which is very relevant as per the scoring system in the study.
Table 2: Feasibility of P-MEX
|
OPD |
CASUALTY |
IPD |
PREOP WARD |
POSTOP WARD |
ICU |
MAJOR OT |
MINOR OT |
Doctor – Patient Relationship skills |
9 |
7 |
8 |
7 |
7 |
7 |
8 |
8 |
Reflective skills |
9 |
7 |
9 |
8 |
9 |
7 |
8 |
8 |
Time managment skills |
6 |
5 |
8 |
8 |
7 |
7 |
8 |
7 |
Inter – professional relationship skills |
8 |
4 |
7 |
7 |
7 |
6 |
5 |
9 |
9 |
7 |
OPD CASUALTY IPD PREOP POSTOP ICU MAJOR OT MINOR OT |
5 |
2 |
0 Doctor patienrt Relationship skills |
Time management skills |
Figure 2: Feasibility of P-MEX
Comprehensiveness having a mean of 7.71 with a range of 5-9 (Table 3 and Figure 3) which is extremely relevant as per the scoring system
Table 3: Comprehensiveness of P-MEX
|
OPD |
CASUALTY |
IPD |
PREOP WARD |
POSTOP WARD |
ICU |
MAJOR OT |
MINOR OT |
Patient Relationship skills |
8 |
7 |
8 |
8 |
8 |
9 |
9 |
8 |
Reflective skills |
9 |
9 |
8 |
8 |
8 |
7 |
8 |
8 |
Time managment skills |
8 |
6 |
8 |
8 |
7 |
7 |
9 |
8 |
Inter – professional relationship skills |
8 |
6 |
5 |
7 |
7 |
7 |
8 |
8 |
Figure 3: Comprehensiveness of P-MEX
9 |
7
5 |
OPD CASUALTY IPD PREOP POSTOP ICU MAJOR OT MINOR OT |
2 |
0 Doctor - patient relationship skills |
Time management skills |
Table 4: Efficacy of P-MEX
|
|
Doctor patient Relationsh ip skills |
Reflective skills Time Inter – managemen professional t skills relationship skills |
|
|||||||||||||||
|
Ass ess men t no.- 1 |
Asses sment no.-8 |
Assess ment no.-1 |
Assess ment no.-8 |
Asses sment no.- 1 |
Asse ssme nt no.- 8 |
Assess ment no.-1 |
Asses sment no.-8 |
|
||||||||||
|
PG1 |
2 |
4 |
2 |
4 |
3 |
3 |
1 |
4 |
||||||||||
|
PG2 |
3 |
3 |
2 |
4 |
2 |
4 |
3 |
3 |
||||||||||
|
PG3 |
1 |
3 |
3 |
4 |
3 |
3 |
2 |
4 |
||||||||||
|
PG4 |
2 |
3 |
2 |
3 |
3 |
4 |
3 |
4 |
||||||||||
|
PG5 |
2 |
3 |
1 |
3 |
3 |
4 |
2 |
3 |
||||||||||
|
PG6 |
2 |
3 |
2 |
3 |
3 |
3 |
3 |
4 |
||||||||||
PG7 |
2 |
4 |
1 |
4 |
3 |
4 |
2 |
3 |
|
||||||||||
PG8 |
2 |
3 |
2 |
3 |
3 |
3 |
2 |
4 |
|
||||||||||
PG9 |
2 |
4 |
1 |
4 |
2 |
3 |
2 |
4 |
|
||||||||||
PG10 |
2 |
3 |
2 |
4 |
3 |
4 |
3 |
4 |
|
||||||||||
PG11 |
3 |
3 |
2 |
3 |
2 |
3 |
1 |
3 |
|
||||||||||
PG12 |
2 |
3 |
2 |
4 |
3 |
4 |
2 |
3 |
|
||||||||||
PG13 |
2 |
3 |
3 |
4 |
2 |
3 |
1 |
4 |
|
||||||||||
PG14 |
2 |
4 |
2 |
4 |
3 |
4 |
3 |
4 |
|
||||||||||
PG15 |
2 |
3 |
2 |
3 |
2 |
3 |
3 |
4 |
|
||||||||||
PG16 |
3 |
4 |
2 |
4 |
2 |
3 |
3 |
4 |
|
||||||||||
PG17 |
2 |
3 |
3 |
4 |
1 |
3 |
2 |
4 |
|
||||||||||
PG18 |
2 |
3 |
3 |
4 |
2 |
3 |
3 |
4 |
|
||||||||||
PG19 |
2 |
4 |
3 |
4 |
1 |
3 |
2 |
3 |
|
||||||||||
PG20 |
2 |
3 |
2 |
4 |
2 |
3 |
2 |
4 |
|
||||||||||
PG21 |
3 |
4 |
3 |
3 |
2 |
3 |
1 |
3 |
|
||||||||||
PG22 |
1 |
3 |
2 |
4 |
2 |
3 |
3 |
4 |
|
||||||||||
PG23 |
3 |
3 |
1 |
3 |
2 |
3 |
2 |
4 |
|
||||||||||
PG24 |
3 |
4 |
2 |
4 |
2 |
3 |
1 |
3 |
|
||||||||||
PG25 |
3 |
3 |
1 |
3 |
2 |
3 |
3 |
4 |
|
||||||||||
PG26 |
2 |
3 |
2 |
4 |
2 |
4 |
1 |
4 |
|
||||||||||
PG27 |
2 |
3 |
3 |
3 |
2 |
4 |
3 |
4 |
|
||||||||||
PG28 |
3 |
4 |
3 |
4 |
1 |
3 |
2 |
4 |
|
||||||||||
PG29 |
2 |
3 |
2 |
3 |
3 |
4 |
1 |
3 |
|
||||||||||
PG30 |
2 |
3 |
2 |
4 |
2 |
3 |
1 |
3 |
|
||||||||||
PG31 |
3 |
4 |
2 |
4 |
2 |
4 |
1 |
3 |
|
||||||||||
PG32 |
2 |
3 |
3 |
4 |
2 |
3 |
3 |
4 |
|
||||||||||
PG33 |
3 |
3 |
3 |
3 |
2 |
3 |
1 |
3 |
|
||||||||||
Average |
2.24 |
3.3 |
2.15 |
3.64 |
2.42 |
3.33 |
2.06 |
3.76 |
|
||||||||||
Efficacy |
3.8 |
2.85 |
1.9 |
0.95 |
0 |
0 |
1 |
2 |
3 |
4 |
Assessment 1 Assessment 8 |
Figure 4: Efficacy of P-MEX
Table 5: Analysis of domains of P-MEX tool with respect to Relevance, Feasibility and Comprehensiveness
Domains of P-MEX tool |
Average of Relevance |
Average of Relevance |
Average of Relevance |
Doctor -Patient Relationship skills |
7.75 |
7.62 |
8.12 |
Reflective skills |
7.75 |
8.12 |
8.12 |
Time Management skills |
8.0 |
7.0 |
7.62 |
Inter-Professional Relationship skills |
5.87 |
6.62 |
7.0 |
Majority of the faculties found the questionnaire and method of evaluation satisfactory. One faculty expressed the opinion that the process is a bit lengthy and another one noted inconvenience in some patients, especially in critical care environments like casualty department and ICU.
The effectiveness of the study is evident from the results as with the progress of each session of each assessment of P-MEX session, the individual post graduate students showed an improvement of score in all domains of skills with an overall average lowest score of 1.75 and average highest score of 2.5 in the assessment no.1, which improved to average lowest score of 3.0 and average highest score of 4.0 in the assessment no.8.
In our study, in settings like OPD, Wards and Minor OT where relatively systematic patient inflow is there and by virtue of the patients’ condition, the scores with regards to relevance and feasibility are higher as proper assessment is possible in comparison to critical care settings.
In this study done at our setting, the data shows that in the critical settings like Casualty and ICU, there is a trend of lower scores in terms of
The study conducted by F Jahan et al showed that professionalism includes personal behaviours, knowledge, and competency. It also includes the attitudes and values one holds and that run through the profession as a whole. Medical students learn professionalism during the course by either direct teaching or experiential learning.[8] Another study conducted by Y Hur et alon core elements of medical professionalism for medical school aspirants.[9] Our study also aims to impart these core values of professionalism during the formative years of a medical student through a scientific and analytical assessment method.
The study conducted by V Passi et al explains in details about the importance of professionalism among doctors and also elaborates the importance of assessment methods for the proper development of curriculum design and teaching and learning methods for supporting professionalism.[10] The study conducted by P Wagner et al on defining medical professionalism also concluded similar findings.[11]. Our study also has the aim and objectives of finding a comprehensive assessment method of professionalism.
The study conducted by KT Tay et al depicts various accreditation frameworks by different regulatory agencies across the globe which includes Accreditation Council for Graduate Medical Education (United States),Canadian Medical Education Directives for Specialists Roles for Family Medicine, European Federation for Internal Medicine’s Physician Charter for Medical Professionalism, General Medical Council Professionalism Capabilities Framework (United Kingdom) and Indian Medical Council Professional Conduct, Etiquette and Ethics and analyses existing different methods for assessment which includes Miller’s Pyramid, Kirkpatrick’s model etc. The pointed time consuming and longitudinal nature of assessment of these methods which tends to lose the core objective of imparting professionalism in medical students many a times.[12]
The meta-analysis conducted by H Li et al analysed 74 instruments of assessment of professionalism from 80 existing studies which included P-MEX as well. The study concluded that although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies.[13] The study conducted by J Goldie et al on assessment of professionalism also has similar findings.[14]
Professionalism Mini Evaluation Exercise (P-MEX) has been recently incorporated a tool for assessment of professionalism among various medical and allied professionals among different countries as shown in the studies conducted by Y Tsuwaga et al in Japan[15], M Karukiwi et al in Finland[16], W Fong et al in multi-ethnic society of Singapore[17], M Kazemipoor et al among dental professionals[18],L Amirhajlou et al among Emergency Medicine residents[19], AL Tusci et al in Turkey[20], T Kaur et al among dental students in India[21], N Jaffari et al in Iran[22], N Abenova et al in Kazakhstan[23] and BK Arai in Brazil[24].
The studies showed a consensus conclusion that P-MEX shows evidence of adequate validity, reliability, and generalizability of findings show evidence of adequate validity, reliability, and generalizability of the P-MEX and confirmed the four areas of medical professionalism reflected in P-MEX: doctor-patient relationship, reflective skills, time management, and inter-professional relationship skills. The studies also agreed that P- MEX is the only evaluation tool for medical professionalism verified in both a Western and East Asian cultural context but commented that subjective evaluations should be complemented with external assessments or feedback in order to take individual and cultural aspects into account. Our study on P-MEX has similar results in comparison to all these studies with a relevance of mean 7.34, feasibility of mean 7.34 and comprehensiveness of 7.71 in a scale of 1-10 which is very relevant as per the scoring system in the study. The average improvement of the results of post-graduates starting from assessment 1 to assessment 8 shows that this tool is efficacious in formative assessment of professionalism among students.
Based on the results, it is concluded that P-MEX is a competent scoring system for the assessment of professionalism among medical students. This method shall enforce induction of professionalism skill teaching, learning and assessment module in under graduate and post graduate curriculum. Students and residents shall have improved proficiency of medical professionalism and faculty shall be motivated to conduct further research in professional skill. The data collected could be easily studied and the deficits were clearly recognised with regards to skills assessed in a particular setting. Moreover, the data helps us understand
Whether the study conducted in a particular setting for a particular skill is relevant and feasible enough. The questionnaire is comprehensive enough to gauge the efficacy of the study in limited setting. The feedback given to the students at the end of each session showed improvement in results in the subsequent sessions, which shows that P-MEX is a competent tool to assess, deliver feedback and help in improving the proficiency of the post graduate students. The system of assessment via P-MEX questionnaire can be further modified based on the feedback with regards to critical settings like ICU, Casualty and Major OT. Overall, the P-MEX tool is comprehensive, the study shows that the assessment by a compact questionnaire which is able to touch on all four domains of professionalism: doctor – patient relationship, time management skill, reflective skills and inter-personal skills is an effective way.