INTRODUCTION TO REQUIRED EVALUATIONS AND LIST OF EVALUATIONS USED IN THIS RESIDENCY PROGRAM
Evaluations Utilized
-
Radiology Resident Formative Evaluation by Faculty
A. Global Evaluation of Residents by Faculty
Evaluator:
Rotation:
This formative evaluation form is an important component of assessing the program's educational effectiveness and the resident's educational progress. Please indicate your evaluation rating of the resident's performance during this one month rotation with respect to the established rotation goals and objectives as they apply to the resident's individual level of training.
PATIENT CARE
(Resident should provide compassionate, and effective care for health problems)
1) Develops a management plan based on radiologic findings and clinical information.
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
2) Demonstrates proper technique in planning and performing image-guided procedures
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
3) Appropriately obtains informed consent
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
MEDICAL KNOWLEDGE and CLINICAL PERFORMANCE
(Resident should be knowledgeable, scholarly, and committed to lifetime learning)
4) Recognizes and describes relevant radiologic abnormalities
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
5) Synthesizes radiologic and clinical information and forms a diagnostic impression
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
6) Utilizes information technology to investigate clinical questions and for continuous self-learning
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
INTERPERSONAL/COMMUNICATION SKILLS
(Resident should communicate and teach effectively)
7) Shows sensitivity to and communicates effectively with all members of the health care team
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
8) Recognizes, communicates, and documents in the patient record urgent or unexpected radiologic findings
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
9) Produces radiologic reports that are accurate, concise, and grammatically correct
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
10) Effectively teaches residents, medical students and other health care professionals
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
PRACTICE-BASED LEARNING AND IMPROVEMENT
(Resident should investigate and evaluate patient care practices, appraise & assimilate scientific evidence in order to improve practices)
11) Recognizes and corrects personal errors
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
12) Accepts constructive criticism
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
PROFESSIONALISM
(Resident should be altruistic and accountable, and adhere to principles of medical ethics by respecting and protecting patients' best interests)
13) Demonstrates a responsible work ethic with regard to attendance and work assignments.
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
14) Demonstrates acceptable personal demeanor and hygiene.
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
15) Demonstrates responsible handling of patient medical record confidentiality
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
SYSTEMS-BASED PRACTICE
(Residents should understand healthcare practices)
16) Applies appropriateness criteria and other cost-effective healthcare principles to professional practice.
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
17) Demonstrates diligence in following hospital/department procedures and policies
Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
GENERAL
Please provide comments regarding the resident's overall behavior: _______________________________________
This resident has effectively met the required goals and objectives of the month's rotation as described in the
educational curriculum. (If not, please elaborate in the comment field.)
Yes______________________________________________ No____________________________________________
Comments: ______________________________________________________________________________________
If you feel comfortable, please discuss the above with the resident. Both the positive and negative.
I have discussed this evaluation with the resident. (Please indicate date in comment field)
Yes_________No ______N/A__________ -
Evaluation of Resident Performance by Peer
B. 360 Degree Evaluations
Evaluator:
Subject:
Credentials: Radiology Resident
Please consider the following statements while rating this Resident. Base your ratings on your personal observations.
PATIENT CARE - Resident should provide patient care through safe, efficient, appropriately utilized, quality-controlled radiology techniques and effectively communicates results to the referring physician and/or other appropriate individuals in a timely manner
* Develops a management plan based on radiologic findings and clinical information:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Is helpful in orienting lower level residents new to the service or hospital:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Demonstrates sensitivity to a patient's cultural/social/economic issues:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Demonstrates strong sense of patient ownership and accountability:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
MEDICAL KNOWLEDGE - Resident should engage in continuous learning and apply appropriate state of the art diagnostic and/or interventional radiology techniques to meet the imaging needs of patients, referring physicians and the health care system
* Recognizes and describes relevant radiologic abnormalities:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Is available to and takes time to teach lower level residents when working together:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Utilizes information technology to investigate clinical questions and for self-learning:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Performs procedures effectively:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
INTERPERSONAL/COMMUNICATION SKILLS - Resident should communicate effectively with patients, colleagues, referring physicians and other members of the health care team concerning imaging appropriateness, informed consent, safety issues and imaging results
* Shows sensitivity & communicates effectively with all members of the health care team:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Effectively teaches non-radiology residents, students and other health care professionals:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Takes time to explain to lower level residents how to dictate reports:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
PRACTICE-BASED LEARNING AND IMPROVEMENT - Resident should participate in evaluation of one's personal practice utilizing scientific evidence, "Best practices" and self-assessment programs in order to optimize patient care through lifelong learning
* Participates in Journal Club, Morbidity and Mortality, Interesting Case Conferences or QI/QA activities:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Appropriately accepts constructive criticism Without taking it personally and attempts to make improvements:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
* Is insightful into own character, being able to recognize personal errors and correct them:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
PROFESSIONALISM - Resident should commit to high standards of professional conduct, demonstrating altruism, compassion, honesty and integrity, follows principles of ethics and confidentiality, and considers religious, ethnic, gender, educational and other differences when interacting with patients and other members of the health care team
Demonstrates a responsible work ethic including showing up on time and not leaving until the work is finished:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
Is willing to take a turn to help out when needed including being willing to switch rotations or take call if needed to cover for the other residents:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
Works professionally alongside other residents and faculty w/o complaining or gossiping:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
Manages personal stress effectively:
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
SYSTEMS-BASED PRACTICE - Resident should understand how the components of the local and national healthcare system functions interdependently and how changes to improve the system involve group and individual efforts
*Dedicates time to study effectively, looks up answers to questions raised daily
Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge
OVERALL PERFORMANCE
How would you rate this resident overall as someone you would like to work with? -
Radiology Resident Evaluation by either a Technologist, Ultrasonographer or Nurse
B. 360 Degree Evaluations
Resident Name:
For each category circle a number (1-9) that you feel is appropriate.
Clinical Knowledge: Residents should be able to explain procedures to patients in a knowledgeable fashion. Should be aware of the reason for the procedure and the clinical condition of the patient. Knowledge is consistent with level of training and has progressed since previous rotation.
Is aware of the patient’s clinical condition, indications for possible outcomes and complications.
9 8 7
Understands the indication for examination and expected outcome and complications.
6 5 4
Unsure of reason for performing examination or possible complications.
3 2 1
Technical knowledge: Evaluation based on knowledge of procedure, machines, scanning parameters, filming, and PACS functions (pertinent to the modality you are in). Residents should be aware of radiation protection techniques including use of, collimation and appropriate reduction in fluoroscopy time to protect patient and physician.
Shows a very thorough understanding of technical concepts. Can optimize more detailed technical settings.
9 8 7
Selects and utilizes material and equipment correctly. Can use the technology/machines needed, i.e. ultrasound units, fluoroscopy units, CT
6 5 4
Needs to improve knowledge of techniques.
3 2 1
Patient Care: Resident interaction with patients.
Excellent bedside manner. Receives positive feedback from patients.
9 8 7
Good with patients.
6 5 4
Inappropriate with patients. Receives negative comments from patients.
3 2 1
Interpersonal/Communication Skills: Refers to ability to interact well with other members of the patient care team.
Performs duties conscientiously and enthusiastically. Reports where and when scheduled. Works well with the technologists.
9 8 7
Performs duties willingly and without complaint. Generally works well with others.
6 5 4
Avoids duties and/or complains often. Often “disappears”.
3 2 1
Comments will be very much appreciated. Comments are mandatory if an unsatisfactory evaluation of 1 or 2 is given.
Comments:
Signature: Date: -
Patient Survey of Resident
B. 360 Degree Evaluations
Please take a moment to evaluate the following OSUMC radiology resident.
PHYSICAN NAME:
Overall satisfaction (circle one; 1=very poor, 10=excellent): 1 2 3 4 5 6 7 8 9 10
Circle below Yes or No to the questions:
Introduced him/herself to you and your family: YES OR NO
Was polite and considerate at all times: YES OR NO
Was dressed professionally (clean, tidy, “business-like”): YES OR NO
Behaved appropriately: YES OR NO
Listened carefully to your concerns and questions: YES OR NO
Explained risks and benefits of the procedure in a clear fashion: YES OR NO
Discussed results of procedure to your satisfaction: YES OR NO
Gave good, clear, accurate instructions for post-clinic care: YES OR NO -
Radiology Resident Self Evaluation
B. 360 Degree Evaluations
Instructions for Self Evaluations
1. In keeping with the ACGME Milestones initiative this evaluation rates residents on continuum of achievement.
2. Please select the appropriate level of achievement for yourself as resident:
Level 1: I demonstrate milestones expected of one who has had some education in diagnostic radiology.
Level 2: I am advancing and demonstrate additional milestones.
Level 3: I continue to advance and demonstrate additional milestones; I consistently demonstrate the majority of milestones targeted for residency.
Level 4: I have advanced so that I now substantially demonstrate the milestones targeted for residency. This level is designed as the graduation target.
Level 5: I have advanced beyond performance targets set for residency and I am demonstrating “aspirational” goals which might describe the performance of someone who has been in practice for several years. It is expected that only a few exceptional residents will reach this level.
Patient Care & Technical Skills - Milestones
PCTS 1: Consultant
__Level 1: Uses evidence-based imaging guidelines. Appropriately uses the medical record to obtain patient information.
__Level 2: Recommends appropriate imaging of common conditions.
__Level 3: Recommends appropriate imaging of uncommon conditions.
__Level 4: Integrates current research and literature with guidelines to recommend imaging.
__Level 5: Participates in research, development, and implementation of imaging guidelines.
PCTS 2: Competence in Procedures 1
__Level 1: Competently performs basic procedures with minimal attending intervention.
__Level 2: Competently performs intermediate procedures with minimal attending intervention.
__Level 3: Competently performs advanced procedures with minimal attending intervention.
PCTS 3: Competence in Procedures 2
__Level 1: Recognizes and manages complications of basic procedures.
__Level 2: Recognizes and manages complications of intermediate procedures.
__Level 3: Recognizes and manages complications of advanced procedures.
Medical Knowledge – Milestones
MK1: Protocol selection and optimization of images
__Level 1: Selects appropriate protocols for basic imaging, including on-call protocols.
__Level 2: Selects appropriate protocols for intermediate imaging.
__Level 3: Selects appropriate protocols for advanced imaging. Demonstrates knowledge of physical principles to optimize image quality.
__Level 4: Independently modifies protocols as determined by clinical circumstances. Applies physical principles to optimize image quality.
__Level 5: Teaches and/or writes imaging protocols.
MK2: Interpretation of examinations
__Level 1: Makes core observations, formulates differential diagnoses, and recognizes critical findings. Differentiates normal from abnormal.
__Level 2: Makes secondary observations, narrows the differential diagnosis, and describes management options.
__Level 3: Provides accurate, focused, and efficient interpretations. Prioritizes differential diagnoses and recommends management.
__Level 4: Makes subtle observations. Suggests a single diagnosis when appropriate. Integrates current research and literature with guidelines to recommend management.
__Level 5: Demonstrates expertise and efficiency at a level expected of a subspecialist. Advances the art and science of image interpretation.
Professionalism – Milestones
PROF1: Professional Values and Ethics
__Level 1: Demonstrates professional behavior.
__Level 2: Is an effective health care team member.
__Level 3: Is an effective heath care team leader.
__Level 4: Serves as a role model for professional behavior.
__Level 5: Participates in local and national organizations to advance professionalism in radiology. Mentors others regarding professionalism and ethics.
Interpersonal and Communications Skills – Milestones
ICS1: Effective communication with patients, families and caregivers.
__Level 1: Communicates information in routine, uncomplicated circumstances. Obtains informed consent.
__Level 2: Communicates under direct supervision, in challenging circumstances, difficult information.
__Level 3: Communicates under indirect supervision, in challenging circumstances, difficult information.
__Level 4: Independently communicates complex and difficult information, such as errors, complications, adverse events, and bad news.
__Level 5: Serves as a role model for effective and compassionate communication. Develops patient-centered educational materials.
ICS2: Effective communication with members of the health care team: Written/Electronic
__Level 1: Generates accurate reports with appropriate elements required for coding.
__Level 2: Efficiently generates clear and concise reports that do not require substantive faculty member correction on routine cases.
__Level 3: Efficiently generates clear and concise reports that do not require substantive faculty member correction on complex cases.
__Level 4: Efficiently generates clear and concise reports that do not require substantive faculty member correction on all cases.
__Level 5: Generates tailored reports meeting needs of referring physician. Develops templates and report formats.
ICS2: Effective communication with members of the health care team: Verbal
__Level 1: Communicates urgent and unexpected findings according to institutional policy and ACR guidelines.
__Level 2: Communicates findings and recommendations clearly and concisely.
__Level 3: Communicates appropriately under stressful situations.
__Level 4: Communicates effectively and professionally in all circumstances.
__Level 5: Leads interdisciplinary conferences. Serves as a role model for effective communication.
Practice-Based Learning and Improvement – Milestones
PBLI1: Radiation Safety
__Level 1: Describes the mechanisms of radiation injury and the ALARA concept.
__Level 2: Accesses resources to determine exam-specific average radiation dose information.
__Level 3: Communicates the relative risk of exam-specific radiation exposure to patients and practitioners.
__Level 4: Applies principles of Image Gently and Image Wisely.
__Level 5: Promotes radiation safety. -
AOCR Program Director Annual Resident Evaluation Report
B. 360 Degree Evaluations
-
AOCR Program Complete Summary for Graduating Resident
B. 360 Degree Evaluations
-
Monthly Formative Radiology Resident Evaluation of Faculty
Enter description here.
Rotation: ________________________
Staff name: ______________________
Instructions: Please evaluate the faculty member by checking a number from 1 to 5 with 1 representing "almost never" and 5 "almost always" regarding how often the faculty member performs each behavior. For parameters for which you have had no direct observation or those which do not apply to your interactions with the faculty, check "NA" (not applicable). Your evaluation will be kept anonymous and only compiled data will be presented to the faculty. Comments may be given at the end of the form.
GENERAL:
1. Staffs out studies early enough so that fellow/resident dictation can be completed by the end of the workday or the end of the scheduled call.
Almost never 1 2 3 4 5 Almost always N/A
2. Staff works efficiently without complaining about the amount of work to do and is considerate by attempting to avoid putting all the work on the fellow/resident.
Almost never 1 2 3 4 5 Almost always N/A
3. Staff regularly takes time out of work to teach fellow/resident how to recognize a diagnosis and associated imaging findings on an imaging study.
Almost never 1 2 3 4 5 Almost always N/A
4. Regularly attends scheduled conferences/lectures.
Almost never 1 2 3 4 5 Almost always N/A
5. At conferences, gives frequent high-quality teaching experience.
Almost never 1 2 3 4 5 Almost always N/A
6. Varies teaching methods (lectures, case presentations, slides, films, video, etc.).
Almost never 1 2 3 4 5 Almost always N/A
AVAILABILITY:
1. Is available to help referring clinicians.
Almost never 1 2 3 4 5 Almost always N/A
Feedback:
1. Gives the resident feedback during the rotation about how the resident is performing.
Almost never 1 2 3 4 5 Almost always N/A
Expertise/clinical skills:
1. Maintains updated expertise by citing recent literature and new technology to resident (e.g. new radiological procedures, alternative imaging studies and methods).
Almost never 1 2 3 4 5 Almost always N/A
2. Integrates imaging findings and clinical history to narrow the differential diagnosis.
Almost never 1 2 3 4 5 Almost always N/A
Research:
1. Helps fellow/resident design and overcome problems in pursuing the resident's own research project.
Almost never 1 2 3 4 5 Almost always N/A
2. Staff makes him-/herself available to assist residents in writing manuscripts for publication or in preparing oral presentations for local, national meetings or medical school lectures.
Almost never 1 2 3 4 5 Almost always N/A
Professionalism:
1. Speaks well of other staff in front of colleagues or residents.
Almost never 1 2 3 4 5 Almost always N/A
2. Disagrees with a resident's interpretation without being insulting.
Almost never 1 2 3 4 5 Almost always N/A -
OSUMC Radiology Resident Annual Program Evaluation
Enter description here.
1. On average, how many hours do you spend per week in assigned duties? _______/week
2. Do you average at least one day off per week? Yes_____ No _____
If not, which rotation(s) did this occur?
3. Do you feel that the program director and faculty members are available to you for advice and counseling?
Yes _____ No _____
4. Do you feel you get enough advice and counseling? Yes _____ No _____
5. Does the Staff radiologist at the beginning of each rotation review the written learning objectives and expectations with you?
Yes _____ No _____
If not, on which rotation(s) did this not occur?
4. Are you provided with written and verbal feedback at the end of each rotation? Yes _____ No ___
If not, on which rotation(s) would you have liked to have had some feed back?
5. Does the residency program place excessive reliance on service vs education? Yes _____ No _____
If yes, on which rotation(s) did this occur?
6. Is there a rapid and reliable system for you to communicate with your attending physicians?
Yes _____ No _____
If not, on which rotation(s) are there issues and what are the issues?
7. Are you provided an adequate work area (computer/place to hang coat facilities)? Yes _____ No _____
If not, at which facilities?
8. Do you have any concerns regarding your safety while at OSUMC or CMH?
Yes _____ No _____
If yes, at which facilities?
9. Are the library facilities adequate? Yes _____ No _____
If not, please comment:
10. Are you able to get enough procedures? Yes _____ No _____
If not, please comment on why that may be or give your suggestions for improvement:
11. My least favorite parts of the residency program are:
12. My favorite parts of the residency program are:
13. What would you suggest be done to improve the radiology residency program at OSUMC?
14. Please make any other comments here: -
AOCR Resident Evaluation of the Program
-
OSUMC Radiology Journal Club Worksheet
H. Journal Club
Resident name:
Date of Journal club:
Title & full citation of Journal article:
Please comment on:- Abstract: (Ex - was it a concise overview? Did the conclusion match the aim? Were there discrepancies between the abstract and the body of the paper?)
- Introduction: (Ex-did it include reasonable rationale why to do the study? Were goals of study included? Does it explain how the authors aims fit into what is already known on the subject?)
- Materials and Methods: (Ex-Is this a good blueprint that another person could read and reproduce? Do the methods attempt to minimize bias and confounding factors? Are the patients included and excluded appropriately? Are correct statistics used?)
- Results: (Ex- Do the results follow the order of the methods? Are there any unexpected results data sets? Are the results clear? Are all subjects and materials accounted for?)
- Discussion: (Ex- Does it state if the hypothesis was verified? Does the discussion compare and contrast with prior literature? Is there an explanation of differences compared to prior literature? Are any unexpected results explained?
- Conclusion: (Ex - Given the limitations of the study, are the conclusions valid? Does the conclusion respond to or answer the question asked in the aim of the study? Are the conclusions proven in the manuscript?)
- What knowledge gap did this manuscript fill in (practice based learning improvement)?
- Any other comments?
Glossary:
Evidence based medicine - Deciding which clinical practice to use based on critical literature analysis Practice based learning improvement - Filling in knowledge gaps.
Reference: BudovekJJ. Evidence Based Radiology: A primer for reading scientific articles. AJR 2010;195:1-4 -
Resident Portfolio Form
Enter description here.
-
Faculty Evaluation of the Residency Program
Enter description here.
Please use this scale to answer questions 1-10:
1- Strongly Disagree; 2- Disagree; 3- Neutral; 4- Agree; 5- Strongly Agree
____1. PATIENT/CASE VOLUME: There are a sufficient number and variety of patients/cases to facilitate high quality resident/fellow education.
____2. CURRICULUM: The residency/fellowship program curriculum provides the appropriate educational experiences for residents/fellows to analyze, investigate and improve patient care practices.
____3. PROGRAM DIRECTOR: The program director effectively communicates with program faculty members to understand their role in resident/fellow education and development.
____4. ADMINISTRATIVE SUPPORT: There are adequate administrative support services to facilitate faculty participation in resident/fellow education.
____5. SUPERVISION: The program resident/fellow supervision policy has been clearly communicated to program faculty and is used by the program.
____6. TRANSITION OF CARE: The program transition of care/hand-off policy and tools have been distributed to program faculty and they are used.
____7. EVALUATION: Program faculty receive regular and timely feedback about their teaching and supervision skills.
____8. FACULTY DEVELOPMENT: There are beneficial resources available for program faculty to improve their teaching and supervision skills.
____9. SCHOLARLY ACTIVITY: Program faculty have the adequate resources to participate in scholarly activities.
____10. FACULTY: The program faculty provide the diversity of experience and expertise to accomplish the goals and objectives of the program.
Please describe the strengths of the residency:
Please describe the opportunities for improvement in the residency: -
Dictation Evaluation Form
Enter description here.
-
Procedure Competency Form
Enter description here.