Hi @Rich_Brophy - interested in your thoughts on how best to deal with response bias.
It seems so difficult to get reliable answers when you interview people about your website and ask what they do, what they would do in a particular situation, and why – and then watch them use your website. People can be so reluctant to offend and instead do their best to tell you want you want to hear.
This is why I find out thumbs up/down and our Google Analytics and other insights tools so useful because it’s pretty much unfiltered.
Are there other ways that you account for or manage response bias?
This is a perennial hazard @jennifer.weiley - unfortunately I don’t think there is any way to remove 100% of response bias. It’s a bit like quantum theory - by observing, we influence.
When I do face-to-face testing, I explain that there is a team behind the product / solution, but my role is a tester - implying that I am not the designer of the product being tested. It’s opaque (which may raise ethical questions), but I find it makes participants more relaxed and more forthcoming with criticism.
When creating questionnaires, I look at questions and ask myself “Would I ask this differently if I had a different solution in mind?”.
I definitely think having questions and response choices reviewed by others is effective - but language ALWAYS shapes thinking, so as above, I think good has to be good enough because there is no perfect.
I just wanted to say thank you for these templates! I recently used one as a guide for a short stint of user research and it was really helpful to look at your layout - and in particular your Research Plan example.
Sure - it would be great to say hello and chat about the Research Plan. Could you send me an email and we’ll take it from there? ( kate.mckay@environment.nsw.gov.au )