Description of experiment: We wanted to find out how many people will, when forced to respond, provide an honest answer to the question “How much do you earn”.
Background: We surveyed 1263 people and we asked them all to provide their income in an open question. The exact question and instruction was “What is your personal annual income, before tax in $USD? [Please enter only numbers and not words]”
This is quite a sensitive topic and it’s perceived that many people do not like to answer.
Results: In this survey, 76% of people gave an answer that looks true, whilst 24% refused or gave answers that were rather confusing or ambiguous.
Commentary: In summary it looks like about 25% of the data is not reliable.
This is actually not bad. Normally when we offer an option of “Rather not say”, we get about 25%-35% selecting it. In future we will revert to this because, although we’ll lose a little data, we just think it’s a bit more elegant to give respondents the clear option to opt out of answering intrusive questions.