Learning Objective III

Graduates will have excellent oral as well as written communication skills.

The CS Department designed and implemented Course Direct Measures (CDMs) in Fall 2012 to be assessment points most closely associated with student outcomes required by ABET accreditation or learning objectives of a course.

All CS 5000-level or above courses requiring a class project, exam, assignment, or quiz that involved either writing a report or making a presentation for any semester from Fall 2021 - Fall 2024 were asked to evaluate the graduate students' communication skills. Instructors generated a CDM by providing an assessment of the class performance for the associated PLO (e.g., graduate student communication skills) based on the level of attainment using the following 5-point scale:

  1. Student fails to demonstrate understanding of concepts required for communication skills
  2. Student fails to meet minimum criteria for success for communication skills
  3. Student barely meets minimum criteria for success for communication skills
  4. Student clearly demonstrates evidence of success for communication skills
  5. Student exhibits outstanding performance for communication skills

This assessment was generally based on targeted assignments, quizzes, or course project performances, although depending on the specific class, instructors took additional data into consideration.

We tried to ensure that a sufficient number of courses were chosen in each semester to provide adequate assessment of graduate students' communication skills.

Instructors were also required to include the sample of performance indicators that demonstrate the accuracy of the assessment. The samples of student work that demonstrate the accuracy of the assessment score can be provided upon request.

A satisfactory level of attainment is that 80% of graduate students score 3 or higher on the 1-5 scale.

A sample template of a CDM to evaluate graduate student communication skills is shown below.

LO(3) Tool - Graduate Student Communication Skills

USU Computer Science

Course

CS#### - Title

Course Description

####

Semester

Spring/Fall 20##

Instructor

####

No. of CS Graduate Students

##

Relevant LO

LO(3) - Graduates will have excellent oral as well as written communication skills.

Assessment Format

(Choose one or more assignment, project, paper, or presentation)

Assessment Criteria

(Adjust these category breakdowns as appropriate)

  • Poor (score < 50%) - 1
  • Beginning (50% ≤ score < 70%) - 2
  • Fair (70% ≤ score < 80%) - 3
  • Proficient (80% ≤ score < 90%) - 4
  • Exemplary (90% ≤ score ≤ 100%) - 5

Summary

  1. xx/xx students (x.x%)
  2. xx/xx students (x.x%)
  3. xx/xx students (x.x%)
  4. xx/xx students (x.x%)
  5. xx/xx students (x.x%)

Supporting Materials

(Description of the assignment, project, paper, or presentation used)

The CDM Evaluation scores table presents a summary of the numerical component of the assessment results in terms of the CDM evaluation scores for graduate student communication skills for 13 courses offered in the past four years from Fall 2021 to Fall 2024.

Each number in the table is a fraction number, where the numerator denotes the number of graduate students who scored 3 or higher on a scale of 1-5 and the denominator denotes the total number of graduate students.  These evaluation scores correspond to the average percentage of graduate students above the expected attainment (i.e., scoring 3 or higher on a scale of 1-5).

Course Number Fall 2021–Spring 2022 Fall 2022–Spring 2023 Fall 2023–Fall 2024
CS 6080 17/17    
CS 6110 7/9    
CS 6040 17/19    
CS 6510 15/15    
CS 6640     23/24
CS 5665     13/13
CS 6680   8/11  
CS 6830 14/18    
CS 6840   17/22  
CS 6820   7/10  
CS 6890 (NLP)     15/15
CS 6890 (Security)     9/9
CS 6890 (VR)   7/7  

This table demonstrates that since Fall of 2021, 8 out of 13 (i.e., 61.54%) courses have over 80% of graduate students scoring 3 or higher on a scale of 1-5.

Archive of Graduate Program Assessment Learning Objective III