Evaluation Chemical Engineering B1 1st block 2017-2018

Page created by June Price
 
CONTINUE READING
Evaluation Chemical Engineering B1 1st block 2017-2018
Evaluation Chemical Engineering B1 1st block 2017-2018
OKC-ST, Quality assurance committee Scheikundige Technologie, April 2018

Contents
   1. Introduction
   2. Points of attention
   3. Quantitative results
   4. Common points
   5. Evaluation per module part
Appendix 1    UT survey Module Chemie

1.        Introduction
The Quality assurance committee (in Dutch ‘onderwijskwaliteitcommissie’, OKC-ST) 1 is responsible
for the evaluation of the bachelor modules.
This report is based on:
• Panel meeting with 9 students on 14 November 2017;
• UT web survey of the module;
• A lecturer panel meeting with students and lecturers on 15 January 2018;
• Quantitative results (pass rates and obtained study load).

The student panel meeting minutes were in Dutch. The document for the lecturer panel meeting was
made up in Dutch. Language in the lecturer panel meeting was English and the minutes of this meeting
were partly in Dutch, partly in English.
As the official language in the programme committee of Scheikundige Technologie/Chemical
Engineering is English since November 2017, this report has been written in English, in the course of
which Dutch source texts were translated.

1
     Students: Noor van de Beek, Claudia Hovius, Evelien Kamphuis, Reinder Kersten, Fleur Sebek, Yordi Slotboom.
     Chairman: Henk van den Hengel (Coordinator Quality Assurance TNW). Support: Eline Marsman (Quality Assurance
     cluster Science & Technology.
Evaluation Chemical Engineering B1 1st block 2017-2018
2.         Points of attention

    Points of attention 2017/2018                        Action           Reaction 2
    Common points
    • None.                                              • n/a            • n/a
    Results
    • None.                                              • n/a            • n/a
    Chemistry - theory
    • None.                                              • n/a            • n/a
    Chemistry - project
    • None.                                              • n/a            • n/a
    Math A + B1
    • None.                                              • n/a            • n/a
    Lab course (chemistry – practice)
    • None.                                              • n/a            • n/a

    Points of attention 2016/2017                                   Result
    Common points
    • None.                                                         • n/a
    Results
    • None.                                                         • n/a
    Chemistry – theory
    • Students think the Inorganic Chemistry book is                • This year’s students share this opinion. It was not
      unnecessary.                                                    clear that the inorganic book was unnecessary.
    Chemistry - project
    • Because of several uncertainties not every project            • This year this issue did not occur.
      group could start immediately with their project.
    Math A + B1
    • The students are not satisfied with the Math B1               • This year’s students think the lectures are good.
      lectures.
    • There was confusion among students about which                • This year there was no confusion about the list of
      list of grades was the correct one.                             grades.
    Lab course (chemistry – practice)
    • None.                                                         • N.v.t.

2
      This column gives a concise description of the reaction of the lecturer. Details can be found in the report. ‘No reaction
      on this point’ means that the lecturer hasn’t given a reaction on this point. ‘Reaction only possible after publication’
      means that reaction is only possible after publication.
                                                                                                                                  2
Evaluation Chemical Engineering B1 1st block 2017-2018
3.          Quantitative results

3.1      Arrangement of the module ‘Grondslagen van de chemie’
The arrangement of the module is described in table 1.

Table 1           Arrangement of the module
 Part                                                  Study load (EC)         Hours
 Chemistry – theory + project                                8.5                238
 Math A+B1                                                    4                 112
 Lab course 1 (chemistry – practice)                         2.5                 70
 Total                                                        15                420

3.2      Student population
Table 2 gives an overview of the total enrolment. The enrolment consists of:
• First-time students in higher education who started on 1 September. They are called ‘regular’
  students; this category is subdivided into students from the Netherlands and from Germany.
• Students who switched from another higher education programme to ST: ‘switchers’;
The evaluation focuses on the regular students: switchers are ignored.

Table 2           First-year enrolment
                                    1 Sept. 2017      1 Sept. - 1 Oct.        Oct. – Nov.      1 Dec. 2017
 Regular – Netherlands                   49                 -1                     -3               45
 Regular - Germany                        0                  0                      0                0
 Regular - total                     49 (100%)              -1                     -3           45 (92%)
 switchers                                1                  0                      0                1
 Total                                   50                 -1                     -3               46

3.3      Results
Table 3 gives the results of the 45 regular students left on 1 December 2017.

Table 3           Results (regular first-year students per 1 December 2017)
                                                                         Inside module                      Outside module
                                                                                                                    
Module part                                 EC       Pass         Fail      % Pass        Participation       Pass      Fail
Chemistry – theory + project                8.5       40           5      89% (90,85)    100% (100,100)        -             -
Math A + B1                                  4        32          13      71% (73,60)    100% (100,100)        5             1
Lab course 1 (chemistry – practice)         2.5       44           1      98% (98,92)    100% (100,100)        -             -
Module Chemistry                            15        34          11      76% (80,72)    100% (100,100)        5             0
 Percentage of students who have received a pass grade for the course inside the module (including possible resits inside
      the module). Signal value ≥ 70%. xx means < signal value.
 Percentage of the regular population who have received a grade for the part of the module. Signal value ≥ 95%. xx means
      < signal value.
 The percentages from 2016-2017 and 2015-2016 are between brackets.
 A fail is defined as < 5.5.

Points of attention
• None.

                                                                                                                        3
The average value of obtained study load (in EC) in the 1st module is shown in table 4.

Table 3       Obtained study load (of the regular population per 1 December 2017)
EC                                                           2017/2018    2016/2017      2015/2016
1e module including resits outside the module                 13.0 (87%)   13.8 (92%)     13.6 (91%)
 Signal value ≥ 70%. xx means < signal value

Points of attention
• None.

3.4    Grades web surveys
The results of the UT survey can be found in appendix 1.

Table 5       Grades web survey
Module                                    Average grade  
UT module survey                              7.7 (7.1;7.5)
     Signal value ≥ 6.0 xx means below the signal value.
     Grades from 2016/2017 and 2015/2016 between brackets.

Points of attention
• None.
Reaction: The chairman stresses that the mark of a 7.7 is the highest mark the module has ever received.
A lot of students passed the module. The chairman heard from the lecturers that students have worked
hard.

                                                                                                       4
4.      Common points
The UT conducts a web survey for every programme and every module. Results for this module can be
found in appendix 1.

Average grade UT survey: 7.7        Number of respondents: 25        Response: 50%

Further results are based on the panel meeting on 14 November 2017 with 9 first year students and the
lecturer panel meeting on 15 January 2018 with 4 students and most of the lecturers.

Student panel meeting and lecturer panel meeting

During the first lectures a lot of information was given. Only later it became clear to the students what
was meant with all this information.

There was no connection between the module parts. The project was not linked well to the chemistry
course (Chemie), although this differed per project subject. Math did also not connect with the other
courses.
Reaction: The chairman finds the missing link surprising. Students present at the lecturer panel meeting
did see a connection between the module subjects. Maybe this depended on the project topic you had.
There are no clear suggestions for improvement.

The study load was not evenly spread throughout the module. The load during the third block of
Chemistry was high. During block one and two the study load was well-spread. It must be noted that
the study load depended on the lab group as specific lab deadlines could coincide with other deadlines
and tests.
Reaction: According to the chairman this is a scheduling issue that the team needs to look at.

In the third block of Chemistry there was a tutorial in the Spiegel where the tables were not suitable to
make the exercises.
At first, the slides of Chemistry were only posted on the BMT Blackboard site. Later on, the lecturer
also posted it on the ST Blackboard site.
One student had a lot of overlap in his schedule, due to his transfer from one project group to another.
He had to solve most problems himself, because the involved lecturers had not been informed about
this change.

Points of attention last year
• None.

Points of attention
• None.

                                                                                                        5
5.      Evaluations per module part

Further results are based on the panel meeting on 14 November 2017 with 9 first year students and the
lecturer panel meeting on 15 January 2018 with 4 students and most of the lecturers.

5.1.   Chemistry - theory
Student panel meeting and lecturer panel meeting

1. Common points
The lectures were of high level, but still good to follow. The first lecture was quite easy, but after that
the level went up quickly.
Reaction: No remarks.

2. Lecture
There were four lecturers. Lecturer A was enthusiastic and kept the attention of the students. Lecturer B
explained the topics very well, although some of the writings on the blackboard were not always
readable. Lecturer C had good lectures, but he treated his slides very fast. He solved this by tutoring
well during the tutorials. Lecturer D explained a lot of additional information and did not explained very
well. This made the lectures last longer than they should. Because of this not all of the core subjects
were taught.
Reaction: The chairman asks if students also gave this feedback to lecturer D. At the panel meeting it is
not clear who is meant by lecturer D. Lecturer C will skip some of the slides so he can slow down a bit.
Lecturer C thinks indeed he has too many slides. According to the module coordinator it is not yet clear
who will teach next year. The idea is to have one lecturer for the organic chemistry part next year,
instead of having two different lecturers.

3. Tutorial
The guidance of lecturers and tutorial assistants during the tutorials was sufficient. The students liked
the fact that they were asked how they wanted to set-up the tutorial. As a result the tutorial was
experienced as very useful and the students were good informed about what they could expect of the
tutorial.
Reaction: No remarks.

4. Study material
The slides were clear. The manual was sufficient. In the first block it was very clear what exercises
should be done. This is also the case for the blocks after that, although the information was slightly more
concise. Most of the students ordered the Organic Chemistry book and the Inorganic Chemistry book.
However, the Inorganic Chemistry book was considered unnecessary. The information in this book was
also entered in the manual. It was not clear to the students at the start of the year that the Inorganic
Chemistry book was not mandatory.
Reaction: Similar to previous years, there is again the comment about the Inorganic Chemistry book.
According to the lecturer, it was never said that the book was not obliged, as it was compulsory. Some
students like the book as an extra background information, it is a different way than the lecturer writes
it down. The lecturer will think about a new book, as also the programme will become English starting
next year. A new lecturer will be appointed for the inorganic part as the current lecturer will not teach
anymore next year. According to the students the book was quite expensive. Students prefer a smaller
book. The lecturer adds that it is also a book that can be used for parts of electrochemistry (module 4).
The lecturer has a cheaper and simpler book in mind for the first quartile.

                                                                                                         6
5. Testing
There were three tests in total and it was clear what was expected from the students for these tests. There
was not sufficient time for the students to prepare for the test of the third block. Together with other
interfering deadlines (e.g. the project deadline) this caused that students experienced this test as more
difficult. The subjects that needed to be studied for all testes were clear and readily available. There was
enough time available for making the test. The retake of block one and two was comparable with the
original test. The retake of block three was of a good level. There was sufficient time for both retakes.
Reaction: The first lecture (of the third part) was 1.5 weeks before the test. Tests were all in the same
week. According to one student, there was no time at the end and it was difficult to plan what you needed
to do each day. The chairman mentions that the grades of the third test were much lower compared to
the first two tests. The chairman asks the reason for this. A student explains that when you score good
for the first two tests you don’t study hard for the third test as you can compensate between tests. Because
of other activities (project, practicum) students didn’t have enough time to prepare between lectures.
This should be taken into account for the schedule of next year.

Points of attention last year
• Students think the Inorganic Chemistry book is unnecessary.

Comparison to last year
This year’s students share this opinion. It was not clear that the inorganic book was unnecessary.

Points of attention
• None.

                                                                                                          7
5.2.   Chemistry - project
Student panel meeting and lecturer panel meeting

1. Common points
The subject of one of the project groups did not have a lot to do with chemistry (Energy Drinks). The
students think it does not fit the project very well. The practical assignment did not match this project
either.
Reaction: Students present at the meeting were not in the Energy Drinks group. According to the module
coordinator, this project topic was done before and there were no complaints before.
Reaction by email of the project coordinator after the meeting: “I think it is rather important to specify
that this project is actually one of those that has the highest scientific content in terms of chemistry.
Other projects like crystallization in chocolate or filtering of beer have a lower content in chemistry,
and these we can re-evaluate for next year.”

2. Lectures
The students think that the information skills lectures were not always useful. Most students point out
that it was more about English writing. They suggest a shorter lecture, with extra information in a
hand-out.
Reaction: The chairman asks if shorter lectures and hand-outs on information skills are possible. The
module coordinator explains that they depend on an external information specialist. The module
coordinator will contact the information specialist and try to change some aspects.

3. Guidance + deadlines
The guidance was different for each project group. The students think some tutors were more involved
than others. As a result some groups got more guidance and tutors had very different expectations.
Some tutors responded very slowly, and for instance took a long time to give feedback on concept
reports.
Because tutors made their own deadlines for their project group, the students experienced different
workloads during the module. However, the communication about these flexible deadlines was good.
Reaction: Students felt a big different in guidance and deadlines. There was a difference in amount of
energy students put in their project. Students didn’t feel this was fair. Some groups had to send in their
work many (7) times, as the tutor was not satisfied. One student mentions that the feedback given was
also inconsistent.
For one group the subject changed as the first subject was simple and they found a new subject
themselves of which they could present a lot. The amount of information presented differed between
groups. Also, the number of days students spend on experiments differed. One group had the problem
that the chemicals weren’t available at the start of their project. The module coordinator will try to
make improvements and give clearer instructions to the tutors.
Reaction by email of the project coordinator after the meeting: “This is actually the very essence of the
project. It is personalized and adjusted to the needs and competences of each group of students. The
group that had to send in their work seven times was a weak group in terms of writing, and we are very
grateful to the tutor who took care of them, as he was striving to improve their writing skills. There is
nothing we can do about this – the only alternative would be that we give the same project to everyone,
with strict guidelines about what to do, and then it’s not a project anymore, it’s a practicum.” and “I
would suggest to modify the sentence ‘the module coordinator will try to make improvements and give
clearer instructions to tutors’ into – The project coordinator insists that these differences are inherent
to different projects, and with a student-centered education that adapts to individual needs.”

4. Study material
The information in the study manual was not very extensive. However, enough additional information
was given in the presentation.
Reaction: No remarks.

                                                                                                          8
5. Workshop + presentation
Students found the workshop about presenting informative.
Students did not know how the presentation and the project were graded. They would like to know
grading points beforehand. The timing of the grading was different per tutor. This leaded to some
frustration among students as regards the retakes and the possible compensation at the end of the module
for the project.
Reaction: Students did bad on the last chemistry test. The project was the last grade of the chemistry
part. So according to the students, you didn’t know if you needed to take the retake. The presentation
grades were given a week after the presentations. The chairman proposes that the grades of the
presentation are published sooner, so students have an idea about how their presentation went.
The chairman asks if an assessment form or assessment criteria were on Blackboard. According to the
module coordinator, in the learning goals there is a short description that says something about the
assessment criteria. The tutors use an assessment form. The chairman asks if the assessment forms can
be put on Blackboard. The module coordinator will ask the project coordinator if this is possible.
Reaction by email of the project coordinator after the meeting: “…according to the rules we have two
weeks to give marks. I can’t give the marks sooner than a week later. The assessment forms were on
Blackboard ….and they still are.”

Points of attention last year
• Because of several uncertainties not every project group could start immediately with their project.

Comparison to last year
This year this issue did not occur.

Points of attention
• None.

                                                                                                      9
5.3.   Math A + B1
Student panel meeting and lecturer panel meeting

1. Common points
The math case did not connect well with the theory during the lectures. The lecturers expected the
students to already have the knowledge from high school, which they did not have.
The grading of the case was not communicated well enough.
The lack of prior knowledge was solved by the lecturer by giving extra explanation.
In the second session of the case the lecturer had taken this into account, resulting in fewer problems.
Reaction: According to the chairman and lecturer, this year a lot of was spent on discussing about the
content of the case. It was changed what mathematics was taught in the first module (differential
equations wasn’t included). According to the students, it was a pretty good case for the second module,
not for the first module as students hadn’t learned already what they needed to know. The pass/fail
assessment felt stressful to students as students already felt that they passed the test but also needed to
pass the case, which may still cause them to fail this part. The chairman explains that the goal of the
case is to apply what you have learned in a chemical context. This year, it was not the application of
something you learned, as you didn’t learn about differential equations.
According to the lecturer, there were two sessions before the case. At the first session, one student was
confused by the slides. Students from the second session found the session better. Students didn’t know
before what to do and didn’t know about differential equations. A lecture before the case on differential
equations would be helpful. The kind of questions wasn’t what students expected from the case. Now,
students feel this case would be more suitable for the second module.

2. Lecture
Students liked the lecturers. The pace of the lectures was good.
Reaction: No remarks.

3. Tutorial
The guidance during the tutorials was good. There were additional exercises available during self-study
moments. Detailed solutions of the more difficult exercises were available in the book.
Reaction: No remarks.

4. Study material
Students liked the Math A reader. Students find it practical that the theory and the exercises were
combined in one reader.
For math B the calculus book was used. The study guide was clear. Moreover, everything was clearly
written in the slides. The slides were orderly, and sometimes even more clear than the book.
Reaction: No remarks.

5. Testing
The two regular tests were of good level. One question in the first test was misinterpreted by many
students (because a 0 , 5 was seen as ½), leading to wrong answers for several questions. This was not
taken into account in the grading.
There was a lot of practice material available. There was sufficient time for the tests and the retest.
Students experienced the retest as somewhat more difficult than the first test.
Reaction: According to the lecturer the 0 , 5 was between brackets and therefore formulated as an
interval of which students could have known it was not meant as a ½.

6. Other remarks
A student remarks that he would like to have some time between the last lecture (Monday) and the test
(on Friday) to let it sink in. The student would prefer to have a weekend to prepare for the test. This is
difficult to fit in the schedule. The lecturer explains that then the time between the test and retest will be
less, so less time to prepare. The chairman will look into this and discuss this with the other programmes
that take math as well.

                                                                                                           10
Points of attention last year
• The students are not satisfied with the Math B1 lectures.
• There was confusion among students about which list of grades was the correct one.

Comparison to last year
• This year’s students think the lectures are good.
• This year there was no confusion about the list of grades.

Points of attention
• None.

                                                                                       11
5.4.   Lab course (chemistry – practice)
Student panel meeting and lecturer panel meeting

1. Common points
With several experiments prior knowledge about MATLAB was required. Because the lecture about
that MATLAB part was moved, several matters were not clear. This made it difficult to work out those
experiments.
Reaction: In the original planning the lecture came before the experiments. The chairman assumes this
will not happen next year. The reason why it was moved is not clear. There were 4 MATLAB lectures,
so there were some before the lab practice. Some skills could have been used if the lectures were all put
before the experiments.

2. Lab work
The guidance during the experiments was very good. There was sufficient attention for the students, as
well as enough working space.
Reaction: No remarks.

3. Study material
The students did not know what to prepare for the first experiment. They would rather see more
explanation up front about what is expected of them.
It is not clear which grade they got for this part. There is no clear overview of the grades (some of the
grades were e-mailed, other could be found on Blackboard).
Reaction: Students needed to prepare for the experiments but didn’t know to what extend they needed
to prepare. The lecturer explains that in the manual of both experiments there is an introductory part
where explicitly is stated what needs to be prepared. The lecturer is therefore a bit puzzled that there is
any doubt about what needed to be done. Maybe some students hadn’t seen the manual at the start of
the experiments. The lecturer mentions the existence of the manual. The lecturer can imagine that there
is a lot of information provided in the first weeks. Students think sometimes reminding students about
the presence of the manual may help, as at the start of the first module a lot of information is coming to
the students.
The grades of MATLAB were put in the Blackboard grade centre. The grades of the first experiments
and synthesis were distributed by e-mail. During the module you didn’t really know how you were doing.
Having all the grades in Blackboard would be nice. Students didn’t have a lab journal, they just had to
write in word documents which were provided by e-mail. The chairman explains that students see their
final module subject grades for the first time at the end of the module when they are registered in OSIRIS.
It is preferred to have all the grades in the grading centre. CANVAS will replace Blackboard, which
also has a grading centre. The chairman is willing to try to set-up the grading centre for this module.

4. MATLAB + error analysis
The explanation was very brief. Subsequently there was time for solving the exercises in couples. The
total available time was insufficient. Because the deadline was the same evening, it became very
difficult to meet the deadline.
The guidance was good.
Reaction: Students heard that the reason for this short deadline is that more time will give students the
opportunity to communicate about the assignments with each other. By having little time, students do
not really learn from doing the assignments. In the second module this is less of problem as you know
how the programme works. The first assignments were quite doable. The assignments became more
difficult over time. One student mentions the idea to spread the content from 5 to 6 lectures. One student
explains that the second MATLAB group could look at the assignment beforehand and prepare for the
assignment as it was already published for the first group. Maybe it is possible to put the assignments
earlier (a day before) online so also the first group would be able to prepare. This will be discussed
with the lecturer.

                                                                                                        12
Points of attention last year
• None.

Points of attention
• None.

                                13
Appendix 1   UT survey module Chemie

                                       14
15
16
You can also read