|
V.
TRAINING EVALUATION
Three-step evaluation processes -- namely (1) post-class survey by
training subject shared, (2) post-field survey by MFI visited, and (3)
overall evaluation, including reviewing the participants’ expectations
expressed in written prior to class training sessions -- were designed to
evaluate the conduct, programme contents and deliveries, training
instructors/facilitators, the attainment level of skills and knowledge and
the overall participants’ observations on facilities and secretariat
service.
The synthesis based on the cross-checked tabulations of the participants’
feedbacks -- as tabulated by Christina Sudiro of NAM CSSTC -- could be
summarized as follows:
A. Class and Field Sessions
|
Respondent |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
GENDER |
|
Male |
Female |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
|
|
6 |
|
|
|
|
|
|
|
|
TOTAL |
|
|
45 |
% |
|
|
55 |
% |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
100 |
% |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
WORK FOR: |
Government |
Private |
|
NGO |
|
|
|
Academic |
|
|
|
|
|
|
|
8 |
|
- |
|
|
3 |
|
- |
|
|
TOTAL |
|
|
73 |
% |
|
|
|
|
27 |
% |
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
100 |
% |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Post-Class Survey |
|
|
|
|
|
|
|
|
Total questionnaires
distributed |
242 |
copies |
|
|
|
Total respondents |
|
|
11 |
persons |
|
|
|
Response rate |
|
|
|
100 |
% |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Post-Class Survey
(Average) |
|
|
|
|
|
|
Subject Evaluated |
|
|
Scoring
(10-1) |
|
|
|
|
|
|
|
|
|
10: Excellent; |
|
|
|
|
|
|
|
|
|
1: Very poor; |
|
|
|
|
|
|
|
|
|
0: No response |
|
|
|
Facilitator |
|
|
|
Score |
Resp. |
%-age |
|
|
|
Outlined and covered
the course objectives |
10 |
110 |
45 |
% |
|
|
|
9 |
115 |
48 |
% |
|
|
|
|
|
|
|
|
8 |
5 |
2 |
% |
|
|
|
|
|
|
|
|
7 |
6 |
2 |
% |
|
|
|
|
|
|
|
|
6 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
3 |
1 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Professional,
organized and prepared |
10 |
111 |
46 |
% |
|
|
|
9 |
113 |
47 |
% |
|
|
|
|
|
|
|
|
8 |
8 |
3 |
% |
|
|
|
|
|
|
|
|
7 |
5 |
2 |
% |
|
|
|
|
|
|
|
|
6 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
5 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Demonstrated
knowledge of subject materials |
10 |
112 |
46 |
% |
|
|
|
9 |
115 |
48 |
% |
|
|
|
|
|
|
|
|
8 |
6 |
2 |
% |
|
|
|
|
|
|
|
|
7 |
5 |
2 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
4 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
1 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Answered question
clearly and completely |
10 |
121 |
50 |
% |
|
|
|
9 |
101 |
42 |
% |
|
|
|
|
|
|
|
|
8 |
9 |
4 |
% |
|
|
|
|
|
|
|
|
7 |
5 |
2 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
3 |
1 |
% |
|
|
|
|
|
|
|
|
4 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
2 |
1 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Friendly and patient |
|
|
|
10 |
132 |
55 |
% |
|
|
|
|
|
|
|
|
9 |
97 |
40 |
% |
|
|
|
|
|
|
|
|
8 |
5 |
2 |
% |
|
|
|
|
|
|
|
|
7 |
4 |
2 |
% |
|
|
|
|
|
|
|
|
6 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
2 |
1 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Reviewed course
concepts throughout the day |
10 |
122 |
50 |
% |
|
|
|
9 |
101 |
42 |
% |
|
|
|
|
|
|
|
|
8 |
7 |
3 |
% |
|
|
|
|
|
|
|
|
7 |
3 |
1 |
% |
|
|
|
|
|
|
|
|
6 |
3 |
1 |
% |
|
|
|
|
|
|
|
|
5 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
3 |
1 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Overall rating of
the Facilitator |
10 |
115 |
48 |
% |
|
|
|
|
|
|
|
|
9 |
110 |
45 |
% |
|
|
|
|
|
|
|
|
8 |
6 |
2 |
% |
|
|
|
|
|
|
|
|
7 |
6 |
2 |
% |
|
|
|
|
|
|
|
|
6 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
4 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
Facilities |
|
|
|
|
Score |
Resp. |
%-age |
|
|
|
The classroom
provided a comfortable environment |
10 |
177 |
73 |
% |
|
|
|
9 |
57 |
24 |
% |
|
|
|
|
|
|
|
|
8 |
5 |
2 |
% |
|
|
|
|
|
|
|
|
7 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
1 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
The supporting
equipments were set up on time |
10 |
185 |
76 |
% |
|
|
|
9 |
54 |
22 |
% |
|
|
|
|
|
|
|
|
8 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
1 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
1 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
Other facilities
functioned properly |
10 |
184 |
76 |
% |
|
|
|
9 |
55 |
23 |
% |
|
|
|
|
|
|
|
|
8 |
2 |
1 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
1 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
Secretariat Service |
|
|
Score |
Resp. |
%-age |
|
|
|
Registration was
timely and efficient |
10 |
190 |
79 |
% |
|
|
|
9 |
26 |
11 |
% |
|
|
|
|
|
|
|
|
8 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
26 |
11 |
% |
|
|
|
EXCELLENT |
|
|
Total |
242 |
100 |
% |
|
|
|
The staff was
courteous, professional and helpful |
10 |
190 |
79 |
% |
|
|
|
9 |
26 |
11 |
% |
|
|
|
|
|
|
|
|
8 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
26 |
11 |
% |
|
|
|
EXCELLENT |
|
|
|
|
Total |
242 |
100 |
% |
|
|
Customer |
|
|
|
Score |
Resp. |
%-age |
|
|
|
Would you recommend
this subject to others |
Yes |
227 |
94 |
% |
|
|
|
No |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
NC |
15 |
6 |
|
|
|
|
RECOMMENDED |
|
Total |
242 |
100 |
% |
|
|
|
Would you recommend
the Facilitator to others |
Yes |
224 |
93 |
% |
|
|
|
No |
4 |
2 |
% |
|
|
|
Conclusion: |
|
|
|
NC |
14 |
6 |
% |
|
|
|
RECOMMENDED |
|
Total |
242 |
100 |
% |
|
|
Post-Field Survey |
|
|
|
|
|
|
|
|
Total questionnaires
distributed |
22 |
copies |
|
|
|
Total respondents |
|
|
11 |
persons |
|
|
|
Response rate |
|
|
|
100 |
% |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Post-Field Survey
(Average) |
|
|
|
|
|
|
Subject Evaluated |
|
|
Scoring
(10-1) |
|
|
|
|
|
|
|
|
|
10: Excellent; |
|
|
|
|
|
|
|
|
|
1: Very poor; |
|
|
|
|
|
|
|
|
|
0: No response |
|
|
|
Exercise Material |
|
|
Score |
Resp. |
%-age |
|
|
|
Briefing on the
objective & methodology was clear |
10 |
10 |
45 |
% |
|
|
|
9 |
11 |
50 |
% |
|
|
|
|
|
|
|
|
8 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
7 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
22 |
100 |
% |
|
|
|
Outline & covered
the course objectives |
10 |
10 |
45 |
% |
|
|
|
9 |
10 |
45 |
% |
|
|
|
|
|
|
|
|
8 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
7 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
22 |
100 |
% |
|
|
|
Clear, organized and
well prepared |
10 |
12 |
55 |
% |
|
|
|
9 |
9 |
41 |
% |
|
|
|
|
|
|
|
|
8 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
22 |
100 |
% |
|
|
|
Expressing knowledge
on load subject |
10 |
12 |
55 |
% |
|
|
|
9 |
10 |
45 |
% |
|
|
|
|
|
|
|
|
8 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
22 |
100 |
% |
|
|
|
Overall rating of
the Exercise Material |
10 |
10 |
45 |
% |
|
|
|
9 |
9 |
41 |
% |
|
|
|
|
|
|
|
|
8 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
2 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
22 |
91 |
% |
|
|
Service Management |
|
|
Score |
Resp. |
%-age |
|
|
|
Exercise is timely
and efficient |
10 |
11 |
50 |
% |
|
|
|
9 |
10 |
45 |
% |
|
|
|
|
|
|
|
|
8 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
Total |
22 |
100 |
% |
|
|
|
The staff was
courteous, professional and helpful |
10 |
13 |
59 |
% |
|
|
|
9 |
8 |
36 |
% |
|
|
|
|
|
|
|
|
8 |
1 |
5 |
% |
|
|
|
|
|
|
|
|
7 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
6 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
5 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
4 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
3 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
2 |
0 |
0 |
% |
|
|
|
|
|
|
|
|
1 |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
0 |
0 |
0 |
% |
|
|
|
EXCELLENT |
|
|
|
|
Total |
22 |
100 |
% |
|
|
Customer |
|
|
|
|
|
Score |
Resp. |
%-age |
|
|
|
Would you recommend
this Exercise Site to others |
Yes |
21 |
95 |
% |
|
|
|
No |
1 |
5 |
% |
|
|
|
Conclusion: |
|
|
|
NC |
0 |
0 |
% |
|
|
|
RECOMMENDED |
|
Total |
22 |
100 |
% |
|
|
|
Would you recommend
the Facilitator to others |
Yes |
22 |
100 |
% |
|
|
|
No |
0 |
0 |
% |
|
|
|
Conclusion: |
|
|
|
NC |
0 |
0 |
% |
|
|
|
RECOMMENDED |
|
|
|
|
Total |
22 |
100 |
% |
B. Overall Evaluation
Basically there are two kinds of evaluation. First is to evaluate the
filled-out Form of Expectation distributed beforehand to the participants,
then to openly discuss the compiled original statements written by the
participants together in class. Second is to evaluate the filled-out form
of overall evaluation after completion of all training subjects delivered
including the field studies. The overall evaluation is summarized as
follows:
1. On Expectation
There are 4 (four) main issues expressed by the participants
concerning: (1) understanding the microfinance; (2) putting substances
delivered to their countries’ context; (3) possible application of
knowledge and experience learned; and (4) other expectations. Choosing YES
to indicate their expectations are met, if NO to indicate not met.
Result of the assessment on the participants’ expectations that was openly
discussed among them is as follows:
|
No |
WRITTEN EXPECTATIONS |
YES |
NO |
|
1 |
Understanding the development of microfinance and MFI |
|
|
|
1.1 |
How the microfinance institution in Indonesia has progressed – its
development |
√ |
|
|
1.2 |
To
have a wide understanding of microfinance and MFIs, both theories and
practical point of view |
√ |
|
|
1.3 |
Learn how can MFI help the poor on the world |
√ |
|
|
1.4 |
Expect to learn more about the development and establishing of other
types of MFIs other than savings and credit cooperative model |
√ |
|
|
1.5 |
How to mobilize and promote MFIs |
√ |
|
|
1.6 |
Analyzing the best practices of microfinance areas of credit delivery
system, motivation and capacity building, monitoring and evaluation |
√ |
|
|
1.7 |
The development of microfinance should be real within its impacts on
the households quality of life and the importance (number and services
quality) of MFI |
√ |
|
|
1.8 |
To
have more understanding of requirements of setting up an MFI |
√ |
|
|
1.9 |
How to set it up on a competitive environment |
√ |
|
|
1.10 |
How to attain growth that is qualitative |
√ |
|
|
1.11 |
How to develop other products as an institution |
√ |
|
|
1.12 |
How to build a sustainable organization |
√ |
|
|
1.13 |
Role, techniques, and method of development for MFI |
√ |
|
|
1.14 |
How to facilitate MFI development as a new initiative |
√ |
|
|
1.15 |
How to improve the management system of new MFI |
√ |
|
|
1.16 |
MFI structures for operations |
√ |
|
|
1.17 |
Incentives |
|
√ |
|
1.18 |
Role of regulatory authority |
√ |
|
|
2 |
Substances (either policy and/or technical aspects) to be delivered be
related to your country’s context |
|
|
|
2.1 |
How government assists MFI |
√ |
|
|
2.2 |
| |