update (additional sections)
is the basis for
consolidated
formalised

Evaluation for Online learning

Main topic

RE

Requirement Elicitation

Artifact-driven techniques

r

background studydata collectionquestionnairescard sort & repertory gridscenario & storyboardprototypingknowledge reuse

background study

Collect, research and synthesize about the client (in this situation is the school).

r

Is an education organization for teaching, evaluating students, giving knowledge to people.Structure : Manage staff, teachers, students.Have two types of school: public school and private school.Have many subjects, each subject can have many classes with different teachers or time. One teacher can teach the same subject in many classes but that classes cannot exist at the same time. Each class has a minimum and maximum number of students.Year divided into semesters, classes belong to one semester. School will have a test in the middle and at the end of semester.Students will be evaluated depending on the results of the classes they attend.

Research and report about other platforms that have similar domains (online study platform): Coursera, UET courses, ViettelStudy,..

r

Coursera: Popular online website with thousands of lectures in different fields which is taught by top instructors. Self study courses or specialization have the output of a Sharable Certificates and online degree. UET courses: A website for UET students and lecturers. Lecturers can post the lectures as well as the exercises. Students can see and learn the courses, do the exercises and submit the homework that the lecturers will evaluate.ViettelStudy: System for students and teacher from junior to high school, can choose the reviewed courses from another learning pla, classrooms with student and teacher in reality are reflected to the systems

Build the document of the system-as-is : workflow, business rules, defect/complaint reports, update, change request.

Make sure to have the right and sufficient info, not more or less on how and what client and user want in order to evaluate the platform

r

Users want the platform to be easy to use, nice interface, good and variety exam content.  Clients want the platform to be efficient, meet their demand goal. Can direct to online class and opposite, good evaluation system that helps raise lecture quality. Test and exam that can assess student knowledge. 

Prepare basic info about the client (VNU), what is the inadequacies of online learning, their goal for this platform

r

Due to the Coronavirus pandemic, all schools and universities have to change from offline study to online. In order to keep the learning and teaching quality not unaffected, students can still be evaluated in a proper and official way. Client (VNU) requests to build a platform that can evaluate students, teachers and the lecture quality of online learning. And also a system for online exams and tests.   

questionnaires

Create survey question for client, user student and teacher

r

Example question for student :Does the teacher give enough homework ?very fewfewenougha little muchtoo muchDo you need more interaction time with teachers and off-class communication ?yesnoDo you like to study online?yesnoDo you find it is hard to study online?easynormalhardvery hardDo you have problems with using a keyboard?I don't know to use keyboardMy typing speed is slowI have no problem with using keyboardExample question for teacher :Do you have difficulty in adjusting to the online class and evaluating your students?a little bitno problemWhat are the disadvantages of online studying?text field

data collection

r

Usages statistics, cost, number of students have computers,..Teaching and assessing methods of teachers and school...Difficulties:May take timeData may be difficult to execute to apply to the system

Collect data about the number of students and teachers who have to join learning courses, number of courses, estimate the request per second.

Research about the requirement of the performance, usability, cost, security,.. How many users will access the system at one time, how security could the system be?

prototyping

Quick implementation of some aspects, focus on specific functions like creating courses, registering to the courses, … to get feedback from real users.

r

Functional aspect : focus on specific functioninitial classroom, courses, show high rated courses,..rating lecture’s quality function after class, send feedbackchatbox between student and teacherexercises and submit UI: focus on usability by showing input-output forms,...return exam result after doing it.online statistic board, activity trackingThe Goal is check user feedback directly, focus on unclear, hard-to formulate problems user may caught

Stakeholder-driven techniques

Interview

Student

r

Question :How you think online learning evaluation will help you ?Which kind of test and exam will you want to do to practice your online studying ?What things you want to improve in online learning ?What are the features you think the system should have for students ?How do you think about a beautiful interface ?Do you want to interact with the teacher anh how ?What is the average internet speed you are using ?How many classes do you have per week and per day ?Do you think online learning is effective ?Do you often lose focus when studying online ?What equipment do you usually use to learn? smartphone or pc/laptop or both ?

Teacher

r

Question:What are the difficulty you face while teaching online ?How you want to keep track of your student study progress ?What things you want to improve in online learning ?What are the features you think the system should have for teachers ?How do you think about a beautiful interface ?Which criterias to evaluate students ?How many classes do you have per week and per day ?How many assignments do you give per week and per day ?How long for the test exam ?What types of test questions are commonly used ?What tools do you need to teach ?

Education expert

r

Question:How online learning impact on the national entrance exam ?How to make online learning validated as offline learning ?What criteria are needed to ensure the quality of lectures and subjects ?What conditions are available to use the existing system ?

Domain Analysis

Preliminary proposal (draft)

System as-is

System to-be

Glossary of terms (Definitions)

Requirement Evaluation

Final proposal

Inconsistency management

Types of inconsistency

Teminology Clash

r

"User" vs "People""Graded Student" and "Marked Student"

Designation clash

r

People for "Student" and "Teacher"

Strong conflict

r

"User must login to use System" And "Information about class can be read without user log in"

Weak conflict

Handling inconsistencies

r

use "User" to call the person who use systemuse "Teacher" and "Student" for each type of use not peopleUsers dont need to log in unless they used system to interact with other user or to check, change personal imformation

Conflict management

r

identify (overlapping)detect (conflicts)resolve (conflicts)evaluate resolutions

Risk analysis

Risk

Likelihood of occurence

Undesirable consequences

Likelihood of occurence if the risk occurs

Severity

Risk types

Product-related

Functional Risks

r

info inaccuracy, System do wrong,...

Non-Functional Risks

r

Bad UI/UX, poor response time, poor peak throughput,unavailability

Process-related

top 10 risks [Boehm, 1989]

r

req volatility, personnel shortfalls, dependencies on external sources, unrealistic schedules/budgets, ... 

Risk management (RM)

Identify

Product-related

r

System let unauthorized user join classSystem automatic log out student when they are in a test System dont automatic record time student attend classSystem dont redirect student to learning website when they attend classSystem still give attendance point to student when they didnt answer report...

Process-related

r

key member suddenly quitshortest human resourcesestimate wrong budget and timelearning website is not avaiablerequirement change

Risk tree

Assess

Qualitative

Quantitative

Control

Counter measures (CMs)

Explore

r

Using elicitation techniques : survay, interviewReusing known countermeasures : generic countermeasures to top 10 risks [Boehm, 1989]Using risk reduction tactics: Reduce risk likelihood: new reqs to ensure significant decrease, Avoid risk: new reqs to ensure risk may never occur, Reduce consequence likelihood: new reqs to ensure significant decrease of consequence likelihood

Evaluate + Select

FRs

NFRs

Cost-effectiveness

RRL

Risk documentation

Annotated risk tree

Integrating RM into RE (DDP)

r

(Optional)

Alternative option evaluation

Qualitative

NFRs

Level labels

Quantitative

Weighted matrix

Criteria weights

Option weighted score

Requirements prioritisation

Value-cost prioritisation

AHP technique

Criteria: value, cost

Build comparison matrix

Determine how value, cost
distribute among Reqs

value-cost diagram

Requirement specification

Requirement document (RD)

RD template:OR

IEEE

Volere

styles

free NL

structured NL

template

Diagrams

formal specification

Requirement QA

Inspection and review

Querying specification db

Requirement validation by spec animation

Formal checking

r

Language checkConsistency and completeness checksModel checkingTheorem proving

Outputs

Consolidated RD

r

ValidatedVerifiedChecked (for target qualities)Fixed (if errors occured)

Others

Group

Assessment

Mid-term

End-of-term
Scope: All (final)

Report

Modelling

Behavioural model

Operational model

Agent model

Object model

Goal diagram

Paradigm: Goal orientation

RE life cycle

1. Domain understanding & Elicitation

2. Evaluation & Agreement

3. Specification & Documentation
(Requirement document - RD)

4. Validation & Verification
(Requirement QA, consolidation)