Standards perspective on the formative and summative language assessment

Mer av detta

Multiple Choice/ Poetry Analysis Lecture

av Tero Louni

Unity3D_AnimatorController

av Mike Ton

Beginnings of American Democracy

av Noemi Gonzalez

Power Messaging

av Les Flammer

Standards perspective on the formative and summative language assessment

Reliability

There is a very close relationship between reliability and consistency, since the instrument (test) has to measure efficiently what it is supposed to be measuring.

Test Reliability

The test should be in accordance with the target population, paying special attention to its design and writing the items in a clear and concise manner.

Test Administration Reliability

Refers to the conditions under which the test will be taken (environment and familiarity with the process).

Rater Reliability

Human error or subjectivity can affect the scoring process.

Intra-rater reliability

the same evaluator scores the same data at different times.

Inter-rater reliability

two or more evaluators score the same data and obtain different results.

Student-Related Reliability

An evaluation can be inconsistent when the student manifests factors (fatigue, anxiety, illness, etc.) that alter the truth value of a specific score.

Characteristics

There is a small probability of error

Replicable

Summative assessment

Evaluates the knowledge and skills obtained during the whole learning process (general achievement in a specific area), qualifies performance.

Impact on students

Persistence with learning.

Motivates students to continue their efforts.

Students benefit from the external uses of this assessment (professional qualifications, job selection, school performance).

Process-focused assessments

Prioritize student ingenuity

Performance-assessments

Improve student understanding in a practical way

Product-assessments

Deliver the final product previously agreed upon according to the guidelines.

Authenticity

Must take into account the real world in terms of applicability and concordance.

Validity

Must conform to guidelines that justify meaning and utility

Reliability

Consistent at the time of application and reliable

Practicality

It is affordable in terms of cost and time; in addition, the evaluation process is efficient.

Objectives

Establish eligibility for study programs.

Determine the success of students at a given point in time.

Validity

The degree to which the evidence supports whether the answers and the way the interpretation is used are appropriate.

Consequential Validity

It refers to the effect and impact of the evaluation on the students' reality.

Construct-Related Evidence

It comprises a set of knowledge and skills about a specific area that requires additional data to make inferences to be measured.

Criterion-Related Evidence

Provided that the results match equally with those of the criterion measure of other tests of the same nature.

Content-Relate Evidence

Content validity has to do with the reasonableness of the skill or knowledge provided in the course.

Requirements

The performance of the examinees must conform to the content to be assessed.

Sample the subject matter from which conclusions are drawn.

Formative assessment

• It is based on retrospective instruction, is conducted during the instructional process. • Its purpose is to provide feedback and for teaching-learning methods. • It is a collaborative practice between teachers and students.

Impact on students learning

It is effective at the time of evaluation

Good class management is achieved

It is a useful resource throughout the duration of the course

Acceptance by students

They strive to achieve the socialized objectives

Engage with their learning

Strategies & techniques

allow students to be involved in the process of making decisions about their classes and learning.

Structuring lesson introductions

Start the class with a logical order (greeting, topic, objectives) and a brief description that captures the students' attention.

Sharing learning objectives

Teacher and student commit to achieve the objectives set (in terms of performance and responsibility).

Target-setting

Students become responsible for their own learning process and meaningful knowledge is achieved.

Principles

Give way for responses on feedback.

Don't disturb students' concentration.

Encourage motivation

Good feedback for self-evaluation

Combining effort and time in activities

Performance standards

Types

Informal

Interpretation of instruction or teaching methods according to the will of the teacher.

Evidence of learning without a sensible order and documented casually.

Learning expectations that are executed without a plan in advance.

Formal

Interpretation of instruction or teaching methods based on evidence gathered.

Evidence of learning based on activities performed and documented.

Learning expectations based on a timeline.