Skip to content

Commit d4d7d27

Browse files
authored
Update index.md
1 parent eaed6da commit d4d7d27

1 file changed

Lines changed: 48 additions & 53 deletions

File tree

  • docs/teacher/reference/response_area_components

docs/teacher/reference/response_area_components/index.md

Lines changed: 48 additions & 53 deletions
Original file line numberDiff line numberDiff line change
@@ -84,82 +84,77 @@ This is a 'no code' parametric configuration. Settings will be upgraded as the s
8484
- **Evaluation Function Parameters** - Configure as provided, and add new parameters as required. Details depend on the selected Evaluation Function.
8585
- **Input Symbols:** This is a powerful feature for defining a dictionary of accepted symbols. For each symbol, you define:
8686
* **Symbol:** The LaTeX-rendered symbol (e.g., `$f(x)$`).
87-
* **Code:** The machine-readable variable name (e.g., `fx`). This is what you use in your reference answer and what the evaluation function sees.
87+
* **Code:** The machine-readable variable name (e.g., `fx`). This is what your students will type and what the evaluation function sees.
8888
* **Alternatives:** A list of other codes you want to accept for the same symbol (e.g., `f_x`, `f(x)`, `f`). This allows you to anticipate different ways students might type the same thing.
8989
* **Visibility:** A `TRUE`/`FALSE` toggle. If "Display input symbols" is enabled in the Input tab, this setting determines whether a specific symbol is shown to the student. This allows you to show students common symbols while still accepting less common or alternative ones in the background.
9090

91-
- **Input Symbols** - Define a dictionary of symbols and their equivalent in code form.
92-
- This essentially associates a LaTeX-rendered symbol with a machine-readable variable label, with the LaTeX render returned to the student through the preview. These symbols may also be hidden to students.
93-
- All inputs are plain text. For example, the symbol `$f(x)$` may have code `fx` and alternatives `f_x`, `f(x)`, `f`. This dictionary will be provided to the evaluation function, even if the teacher has not displayed it to the student. This allow teachers to accept several alternative symbols, such as those with different cases or conventional expressions.
94-
- The configuration of input symbols is a very important part of providing high quality feedback.
95-
- Note that the 'visibility' Boolean applies if input symbols are displayed to students, otherwise it is irrelevant. It allows Teachers to communicate some symbols to students, while keeping others hidden to the student but visible to the evaluation function.
96-
9791
### 3. FEEDBACK
9892

99-
Add alternative reference answers, 'cases', with customised parameters, so that multiple cases can be dealt with independently. Cases can be used to capture multiple correct approaches that are not equivalent. Cases can also be used to identify common incorrect approaches and to provide customised feedback. The FEEDBACK tab is typically populated after students start using the system, and when data is available to point to common expressions. Configuring a case works similarly to setting up the default answer in the INPUT tab, with added options for changing the colour of the given feedback, give custom feedback and toggling whether the case answer should be considered correct or not. Adding custom feedback will overwrite the feedback produced by the evaluation function. When a response is submitted, it is evaluated for all cases and feedback for the first case that matches will be displayed. When determining which matched case is first, the default answer described in the INPUT tab will take precedence over all other cases, otherwise the feedback for the matched case with the lowest number will be displayed (i.e. the answer given in the INPUT tab can be considered to be Case 0). <br> Feedback fields also support LaTeX equations in both `$f(x)$` and `$$f(x)$$` formats, and Markdown inputs such as line breaks. Make sure to follow good typesetting practice in this field.
93+
Here, you can go beyond a simple "correct/incorrect" and provide nuanced feedback by creating **"cases."**
94+
95+
Cases are an alternative answer you want to check for. You can use cases to:
96+
* Award full marks for a different but equally valid answer.
97+
* Identify a common mistake and provide specific, tailored feedback to help the student learn.
98+
99+
For each case, you can:
100+
* Enter an alternative answer to check for.
101+
* Specify if the case should be marked as "correct" or "incorrect."
102+
* Write custom feedback text that overrides the default feedback from the evaluation function.
103+
* Change the color of the feedback (e.g., green for correct, orange for a hint).
104+
105+
Teachers typically add cases after students start submitting answers, and data about common student answers is created.
106+
107+
When a student submits a response, it's evaluated against all cases. The system displays feedback for the **first case that matches**. The main answer you set in the 'Input' tab is treated as "Case 0" and is always checked first.
108+
109+
Feedback fields also support LaTeX equations in both `$f(x)$` and `$$f(x)$$` formats, and Markdown inputs such as line breaks. Make sure to follow good typesetting practice in this field.
100110

101111
![Screenshot](screenshots/Feedback.gif)
102112

103113
### 4. TEST
104114

105-
tests provide a systematic way to log what behaviour the teacher expects. It provides a useful record and an efficient way to retest the bevhaiour of a response area over time (e.g. as evaluation functions evolve, or as the subject matter itself changes).
106-
107-
## Restrictions on changes: the input type
115+
Tests provide a systematic way to log what behaviour the teacher expects. You can create a list of test inputs and define the expected outcome for each.
108116

109-
It is possible to change the input type (e.g. from _Text_ to _Number_) without any restrictions until the response area is saved (with or without publishing) to students.
117+
It provides a useful record and an efficient way to retest the bevhaiour of a response area over time (e.g. as evaluation functions evolve, or as the subject matter itself changes).
110118

111-
After the response area is saved, it is still possible to change the input type, but it will result into replacing the response area by a new one. The previous response area will still exist, but only on the previous version of the question. When replacing the response area, all response area content data (those entered by teachers including tutorials, final answer and worked solutions) are copied, but any existing response area event data (student answers, click events and statistics) will remain linked only to the previous response area.
119+
## Restrictions on changing the input type
112120

113-
Student answers, click events and statisticsthose data are never lost by deleting a response area, they are always preserved. Once a question is saved (with or without publishing), then any new changes are saved into a new (draft) version of the question. So, if e.g. a response area is deleted after a question was published, then it is deleted from the draft version only. And if this draft version is later published, then the previously published version is preserved (and with it the "deleted" response area and linked submissions).
121+
It is possible to change the input type (e.g. from _Text_ to _Number_) without any restrictions until the response area is saved.
114122

115-
The reason why the input type change is restricted is to preserve high quality data analytics as explained in the examples below.
123+
After the response area is saved, it is still possible to change the input type, but it will result into replacing the response area by a new one. The previous response area will still exist, but only on the previous version of the question. When replacing the response area, all content (e.g. answers, feedback cases) is preserved, but any existing student submissions and analytics will remain linked only to the previous response area.
116124

117-
### An Example 1 - changing input type on PUBLISHED response area
125+
Student answers, click events and statistics are never lost by deleting a response area. Once a question is saved (with or without publishing), then any new changes are saved into a new (draft) version of the question. So, if e.g. a response area is deleted after a question was published, then it is deleted from the draft version only. And if this draft version is later published, then the previously published version is preserved (and with it the "deleted" response area and linked submissions).
118126

119-
#### FIRST Part
120-
- The teacher creates a new question with Response Areas RA1 and RA2. -> The version of the question is QV1 with status DRAFT.
121-
- The teacher is making changes (including the change of the input type if needed). -> The changes are being saved into QV1 with no restrictions
122-
- The teacher performs PUBLISH action (let's assume RA1 and RA2 input types are both _Number_ for this example). -> The QV1 version status is changed to PUBLISHED
123-
- Students are submitting their answers -> submissions are recorder against Response Area RA1 and RA2 (in the single _Number_ format for both response areas)
124-
- The teacher clicks on a question to edit it -> with the first click a new question version QV2 is created with status DRAFT
125-
- The teacher makes following changes (which are being recorded against QV2):
126-
- In RA1: adds a new Input Symbol -> the change is recorded against RA1
127-
- In RA2: the teacher unlocks and changes the input type -> RA2 is deleted (from the question version QV2) and a new response area RA3 is created (let's assume input type _Table_ for this example)
128-
- The teacher performs PUBLISH action -> the QV2 is published (with response area RA1 with input type _Number_ and response area RA3 with input type _Table_)
129-
- Students are submitting their answers -> submissions are recorder against Response Area RA1 (in the single _Number_ format) and against Response Area RA3 (in the _Table_ format)
127+
The reason why the input type change is restricted is to preserve high quality data analytics as explained in the examples below.
130128

131-
=> No submissions are lost. The original submissions (in the _Number_ format) are linked to the RA2, which is preserved on the question version QV1. New submissions (in the _table_ format) are linked to the RA3 which is recorded on the question version QV2.
129+
### Example 1 - changing input type on PUBLISHED response area
132130

133-
**Please note:** All statistics and submissions are currently displayed against the published question version only. So, though the submissions against RA2 are preserved, it is not currently possible to see them. We are working on the improvement to make this possible.
131+
1. **Create and Publish:** You create a question with "Response Area 1" and "Response Area 2," both using the *Number* input type. You **Publish** the question. Let's call this `Version 1`.
132+
2. **Students Submit Answers:** Students begin submitting answers, which are recorded for both response areas.
133+
3. **Edit the Question:** You decide to edit the question. The system automatically creates a new draft, `Version 2`.
134+
4. **Make Changes:**
135+
* In "Response Area 1," you add a new input symbol. This is a simple change and doesn't affect the input type.
136+
* In "Response Area 2," you change the input type from *Number* to *Table*.
137+
5. **The Result:** Because `Version 1` was published, changing the input type triggers the replacement process. The original "Response Area 2" is archived (with its student data) in `Version 1`. A brand new "Response Area 3" (with the *Table* input type) is created in its place in `Version 2`.
138+
6. **Publish Again:** You publish `Version 2`.
134139

135-
#### SECOND Part - this is an extension of the FIRST Part
136-
- The teacher decides to REVERT (the question created in the FIRST Part) to the question version QV1 -> a new question version QV3 is created and the content of the QV1 is copied to QV3 -> QV3 is DRAFT version which contains RA1 (input type _Number_) and RA2 (input type _Number_)
137-
- The teacher performs PUBLISH action -> the QV3 is published and the teacher can now see submissions against RA1 and RA2, but he cannot see anymore submissions against RA3 (these are preserved against the QV2 version)
140+
**The Takeaway:**
141+
* New student submissions will be recorded for "Response Area 1" (*Number*) and "Response Area 3" (*Table*).
142+
* The original submissions to "Response Area 2" are safe and preserved with `Version 1`, but you won't see them in the analytics for the currently published `Version 2`.
143+
* If you later **Revert** to `Version 1`, you will once again see the analytics for "Response Area 1" and the original "Response Area 2".
138144

145+
**Please note:** All statistics and submissions are currently displayed against the published question version only. So, though the submissions against "Response Area 2" are preserved, it is not currently possible to see them. We are working on the improvement to make this possible.
139146

140-
### An Example 2 - changing input type on SAVED response area
147+
### Example 2 - changing input type on SAVED response area
141148

142-
- The teacher creates a new question with Response Areas RA1 and RA2. -> The version of the question is QV1 with status DRAFT.
143-
- The teacher is making changes (including the change of the input type if needed). -> The changes are being saved into QV1 with no restrictions
144-
- The teacher performs SAVE action (let's assume RA1 and RA2 input types are both _Number_ for this example). -> The QV1 version status is changed to SAVED
145-
- The teacher clicks on a question to edit it -> with the first click a new question version QV2 is created with status DRAFT
146-
- The teacher makes following changes (which are being recorded against QV2):
147-
- In RA1: adds a new Input Symbol -> the change is recorded against RA1
148-
- In RA2: the teacher unlocks and changes the input type -> RA2 is deleted (from the question version QV2) and a new response area RA3 is created (let's assume input type _Table_ for this example)
149-
- The teacher performs PUBLISH action -> the QV2 is published (with response area RA1 with input type _Number_ and response area RA3 with input type _Table_)
150-
- Students are submitting their answers -> submissions are recorder against Response Area RA1 (in the single _Number_ format) and against Response Area RA3 (in the _Table_ format)
151-
- The teacher decides to REVERT to the question version QV1 -> a new question version QV3 is created and the content of the QV1 is copied to QV3 -> QV3 is DRAFT version which contains RA1 (input type _Number_) and RA2 (input type _Number_)
152-
- The teacher performs PUBLISH action -> the QV3 is published and the teacher can now see submissions against RA1. There are no submissions against RA2 as it has not been (until now) published. Submissions against RA3 are not visible, but they are preserved against the question version QV2.
149+
This scenario works almost identically to the one above. The key is that once a question version is **Saved**, the input types of its response areas are locked to protect potential future analytics. If you edit a saved question and change an input type, it will still trigger the replacement process (archiving the old and creating a new response area).
153150

154-
### An Example 3 - adding new response area to a published question
151+
### Example 3 - adding new response area to a published question
155152

156-
- The teacher creates a new question with Response Areas RA1 and RA2. -> The version of the question is QV1 with status DRAFT.
157-
- The teacher is making changes (including the change of the input type if needed). -> The changes are being saved into QV1 with no restrictions
158-
- The teacher performs SAVE (or PUBLISH) action (let's assume RA1 and RA2 input types are both _Number_ for this example). -> The QV1 version status is changed to SAVE (or PUBLISHED)
159-
- The teacher clicks on a question to edit it -> with the first click a new question version QV2 is created with status DRAFT
160-
- The teacher adds a new response area RA3
153+
1. **Start with a Published Question:** You have a published question (`Version 1`) with "Response Area 1" and "Response Area 2."
154+
2. **Edit the Question:** You start editing, which creates a new draft (`Version 2`).
155+
3. **Add a New Response Area:** You add "Response Area 3."
161156

162-
=> At this point the teacher is making changes in the question version QV2 (DRAFT) in which:
157+
**The State of `Version 2` (Draft):**
158+
* The input types for "Response Area 1" and "Response Area 2" are **locked**. This is because they exist on a previously saved version (`Version 1`). To change their type, you must go through the replacement process described above.
159+
* The input type for the new "Response Area 3" is **unlocked**. You can change it freely because it doesn't exist on any previously saved version and has no associated student data to protect. It will only become locked after you Save or Publish `Version 2`.
163160

164-
- The input types of RA1 and RA2 are locked, because they exist on a saved version QV1. It does not matter if QV1 is (only) saved or published or if there are or there are not existing submissions. The reason why it is locked is that the teacher can revert into this version later after submissions are created. By locking it we are making sure that the "unlock" process will be triggered which will preserve the original response area and it will create a new response area and it will make sure that the submissions are linked to response area with compatible input type.
165-
- The input type of RA3 is not locked at this point, because RA3 does not (yet) exist on any saved question version.

0 commit comments

Comments
 (0)