(1) are relevant
(2) ask a single question
(3) are clear and concise
(4) use appropriate language
(5) have mutually exclusive and exhaustive response options
Each of these are outlined in more detail below.
Double barreled questions should not be used in a survey. Since double barreled questions ask multiple questions, when respondents answer we do not know if they are responding to (a) the first question, (b) the second question, or (c) both questions. Thus, make sure you ask a single question at a time.
Example: Do you agree or disagree that guns and prayer should be allowed in schools?
Double Barreled questions: A question that actually asks two (or more) questions.
High cognitive burden question:
Low cognitive burden question:
Cognitive burden: effort being used in the working memory
Item non-response: when respondents do not answer a given question (i.e. do not answer question 12)
Drop offs: when respondents stop the survey (i.e. do not answer the last 20 questions)
How to set up the Flesch Reading Ease and Flesch-Kincaid Grade Level measures
Response options should be both mutually exclusive and exhaustive
Please select your age range
These response options are exhaustive but not mutually exclusive. If someone is 70 years old they would need to select two age ranges. To fix this problem either (a) "51-70" should be "51-69" or (b) "70 or older" should be "71 or older"
How many books have you read in the last month?
These response options are mutually exclusive but not exhaustive. If someone has not read a book in the last month they are not able to answer this question. So the response option of "0" or "I have not read any books in the last month" should be added.
Mutually exclusive: response options do not overlap
Exhaustive: all responses are included