NTCIR-10 Project Evaluation
NTCIR-10 Project Evaluation Form
- Please take a few minutes to fill out the following questionnaire. It will help the future NTCIR workshops.
- Please answer in English or Japanese.
1.
=== Questions for all participants ===
Please tell us about your relationship to the NTCIR-10 workshop. You are:
a. A Registered NTCIR-10 task participant that submitted results
b. A Registered NTCIR-10 task participant that did not submit results (Please comment Why not?)
c. A Past Task participant that did not participate in NTCIR-10 (Please comment Why not?)
d. never participated in NTCIR evaluation before (Please comment Why not?)
e. A NTCIR test collection user
f. NTCIR-10 Conference Attendee
g. Other (Please describe)
Comments:
2.
=== Questions for task participants (from 2 to 16) ===
Please give your comments on the process of the NTCIR Project, not only on the meeting.
2. How did you hear about the Call for Participation to the task(s)?
a. NTCIR Website
b. Mailing list
c. Conference
d. Journal
e. Other
if you chose b~e, please specify the name.
3.
※From 3 to 9, please choose among your task(s).
Also, please fill out the comments to improve the meeting.
3. Data Distribution
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
4.
Task design
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
5.
Announcement
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
6.
Evaluation method(s)
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
7.
Task schedule
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
8.
Sharing raw submission data (submission results from other participants) in NTCIR-9
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
9.
Did you use raw submission data for post submission analysis?
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
CrossLink
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
INTENT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
1CLICK
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
PatentMT
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
RITE
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
SpokenDoc
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Math
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
MedNLP
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
10.
Travel support
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
11.
Task proposal schedule for NTCIR-10
5 (Very Good)
4 ...
3 ...
2 ...
1 (Can be improved)
Comments/How:
12.
Will you recommend others to participate NTCIR Task(s) ?
5 (Yes)
4 ...
3 ...
2 ...
1 (No)
How/Reasons:
13.
Do you want to organize a Task at the next (or future) NTCIR?
5 (Yes)
4 ...
3 ...
2 ...
1 (No)
How/Reasons:
14.
Do you recommend others to be a NTCIR Task Organizer?
5 (Yes)
4 ...
3 ...
2 ...
1 (No)
How/Reasons:
15.
Have you written (or Will you write) blog post(s) or tweet(s) about NTCIR-10 Task(s)?
Yes
No
16.
Other comments (If you can afford, please write up your name and contact address here.)