The CareerTech Testing Center

…the provider of online testing solutions

CareerTech Assessment – A Snapshot

Aligning with state and national standards and certifications whenever possible

Assisting Skills Centers and Student Organizations› Life Skills

~96,000+ tests administered in FY13› 130+ skill standards & 130+ assessments› Tests free to OK teachers

Increasing development efforts towards national assessments› National Law, Public Safety, Security and Corrections

Core Assessment

A System with Value Added…

State/National Industry Association Driven › 50% Aligned or Endorsed

Oklahoma Industry Validated › 3:1 Industry to Instructor Committee Ratio

Provides Students & Employers Independent Measure of Competency Provides Valuable Analyses

› Student…remediation› Program…program improvement› State…professional development› Item…assessment improvement

On The Horizon….

Increase Number of Skills Standards & Assessments

Increase Alignments & Endorsements

Maintain Excellent Online Infrastructure

The Sky’s the Limit!

Competency Based Education Includes….

Skills Standards

Competency Tests

Curriculum

Skills Standards….

Include a body of knowledge, skills and abilities needed to successfully perform in an occupation

Are developed and validated by industry representatives

Are tied to industry standards whenever possible Provide a basis for identifying/developing

curriculum materials Drive competency test development

So…What is a Competency Test Anyway?

Four Key Characteristics Measures readiness for a specific

occupation Follows the Skills Standards for that

occupation Aligns with occupational certification

whenever possible Provides meaningful information for

program improvement

How is a CompetencyTest Created?

Once the Skills Standards list is completed, frequency and criticality ratings are used to determine the number of test questions

Questions are written by subject matter experts

Questions are then compiled and reviewed by a committee of subject matter experts before the test is administered to students

Who Should Take a Competency Test?

ANY/EVERY student who…

is enrolled in the program for which the test was developed.

has completed training for an occupation and passed all related performance evaluations for an occupation.

is READY to take the test according to the instructor.

What Needs to be Done Before Testing Students?

determine which test is to be administered be sure that each student who is being tested

is READY to test schedule a time/date to test the student(s) with

the Testing Liaison (complete test referral form?)

provide the test number and the PID Code to the Testing Liaison

Instructors should…

Test Referral Process

Prior to administering any assessment, it is the responsibility of the testing liaison to obtain the following information for each student:

• WAVE ID (obtained from Department of Education), the Student’s Social Security Number or a local Student ID number or some other number unique to that student

• PID code (a unique code given to each program to identify it)

• Instructor’s Last Name• Student’s First & Last Names• The type of program the student is enrolled in• The type of student (high school or post secondary)

Who Administers the Competency Tests?

Testing Liaisons

Administrators at each school designate a Testing Liaison to administer the competency tests in a SECURE testing environment.

Security/Confidentiality Issues

NEVER give out username and password Tests are not to be used for pre- or post-

testing Testing Liaisons are to maintain physical

control of testing materials at all times Instructors are NOT allowed to view tests

(unless participating in the annual test review) A student may use a unique ID in lieu of their

SSN (Ex: a student ID number with zeros that precede it to create a nine character ID)

Test Administration

A set of instructions is provided at the beginning of each assessment.› In this set of instructions, any reference materials that

may be used will be listed here.

At the end of the assessment, a link is provided to the Coaching Report.› Don’t forget that a copy should be provided to the

student, the instructor, and that the testing liaison should also keep a copy

Testing Environment

The testing environment should be such that participants can concentrate on their assessments with minimal distractions.

Considerations regarding the testing environment include:› Consistent/adequate lighting levels› Temperature at a comfortable level with proper

ventilation› Space is quiet with minimal distractions› Participants should be asked to behave consistently (no

eating, getting up and moving about)› Avoid/delay the test administration when a participant

appears hurried, troubled, or ill

Responsibilities of the Test Proctor

• Participant authentication: a picture ID should always be shown and login should be handled quickly and quietly by the proctor

• Protection of the security of the online testing system. Username AND password should NEVER be revealed

• PROHIBIT THE USE OF ALL COMMUNICATION AND TECHNOLOGY DEVICES (photos of test items and text messaging are common problems)

• Computer usage: Monitor whether participants are trying to access the internet or other programs

Responsibilities of the Test Proctor (continued)

• The proctor should be vigilant in their observance of the testing environment: Note passing, hand gestures, etc.

• Reference materials, texts, notes, etc., are not allowed in the testing area unless specifically allowed for in the exam or in a student’s Individualized Education Plan

• If a candidate is caught cheating during an examination, testing will stop immediately The candidate will receive a failing result and the incident will be reported to the CareerTech Testing Center (CTTC)

• Students with an IEP may have special accommodations as specified in an IEP, IRP, 504, LEP, and ELL

Re-Take Policy

In the event a participant fails his or her first (1st) attempt to pass a CTTC test examination (score was less than 70%), the CTTC does not require any specific waiting period between the first (1st) and second (2nd) attempt to pass such examination.

Remediation is required prior to the 2nd or any subsequent administration.

After the second (2nd) attempt, the participant will be required to wait three (3) calendar days to retake the examination. The 3rd and final attempt requires a wait of three calendar days prior to retake.

Cheating on Tests

If any candidate is caught cheating during an examination, testing will stop immediately The candidate will receive a failing result and the incident will be reported to the CareerTech Testing Center (CTTC).

Several factors to consider when cheating occurs:Widespread cheating (e.g., answer copying)

throws into question the validity of resultsLeaking of items from your repository is expensive

and damaging to an organizations reputation.New technologies used in cheating.

Coaching Reports

The Copy Should Be Kept in a Secure

Location and

Provided To:

•Student•Instructor•Testing Liaison

COACHINGREPORT

Coaching Reports Cont.

The Coaching Report provides:

Mean performance by duty area

Percentage Score

Document competency attainment

Identify relative areas of individual remediation

A method for individual program improvement

A method for state program improvement

Coaching Reports

Updates

The Updates section on the testing website should be checked often:

› You will find information on new alignments, endorsements, and various other information

› If any test numbers change, that information will be listed here

The CareerTech Testing Center Blog

Our Blog is a repository of information on a variety of topics. (www.careertechtesting.net)

Some topics are original thought, some inspired by the world around us and some are articles and reports generated by others that have application to Testing and career and technology education in Oklahoma and throughout.

We invite you to read and use the information that is provided. Please be aware that some links will lead to articles that do not represent an official view of ODCTE and we are not responsible for their content or accuracy.

We hope that you find our Blog useful and informative! J.T.

Contact Us

CareerTech Testing CenterOklahoma Department of Career and

Technology Education1500 W. Seventh Avenue

Stillwater, OK  74074Main Office:  405-743-5412

FAX:  405-743-6885Robyn Drury 405-743-5413