A survey is designed to explore the participants’ opinions, attitudes and actions towards certain topics. The amount of information possessed by participants is not the only factor that influences their willingness to participate; question types and options design also influence participants’ responses. In reality, given cost constraints and questionnaire length, it is not feasible to provide a multiple survey design for a single concept, or to verify participants' response mode under different survey designs. This study used an experimental design to measure political knowledge from Taiwan’s Election and Democratization Study (TEDS) as an example, based on (1) an “open-ended vs. close-ended” question design; (2) whether it provides “non-response” as an option, to design four different types of surveys. The study uses a posttest-only control group design with university students as participants. We randomly released the questionnaires to participants and had 1,110 valid questionnaires.

The study found that question type and non-response design affects the participant response mode; a close-ended questionnaire design does increase the correct response ratio from participants, but it also produces a higher proportion of incorrect answers than an open-ended questionnaire. An openended questionnaire design does not have options as reference, and so it could lower the willingness of participants to take part in the survey, and it therefore resulted in a higher non-response ratio. From the composite design of question type and non-response option, we were able to precisely estimate types of participants as in Mondak (1999), but the combinations of different types of participants vary significantly as results from the level of difficulties in a questionnaire designed to measure political knowledge.