Finding the right user to test your software
Over the years of development on my product, I have been working with different batches of tester. And I have noticed some good time, as well as some bad time with some of them. I noticed a "trend" that lead to my different emotions.
I feel fruitful and respected when I work with tester who is knowledgeable. The "knowledge" I am referring to, is the understanding of the domain that the software is dealing with. One analogy I can thought of, is the necessity to recruit driver in testing out a car. You won't find someone who don't know how to drive a car for testing.
OK, I hear your voice. You say the test is biased if the user is already "contaminated".
I would agree if the test is focused on the perception on something intangible. E.g. the color should be used or where the submit button should be placed. But if the test require the knowing of the mechanism, it falls into another dimension.
What's more, if your test is composed by a league of such user, I could not imagine how diversify the feedback will be. Each of them will likely to represent the personal preference of the user and what matter worst is, these user will likely NOT to be the same group of user who gonna pay and use your product.
Developing software is an art, but spotting the right gang of people to give you feedback is even so. Now I will go back to my cave and meditate on the next features to implement.
I feel fruitful and respected when I work with tester who is knowledgeable. The "knowledge" I am referring to, is the understanding of the domain that the software is dealing with. One analogy I can thought of, is the necessity to recruit driver in testing out a car. You won't find someone who don't know how to drive a car for testing.
OK, I hear your voice. You say the test is biased if the user is already "contaminated".
I would agree if the test is focused on the perception on something intangible. E.g. the color should be used or where the submit button should be placed. But if the test require the knowing of the mechanism, it falls into another dimension.
What's more, if your test is composed by a league of such user, I could not imagine how diversify the feedback will be. Each of them will likely to represent the personal preference of the user and what matter worst is, these user will likely NOT to be the same group of user who gonna pay and use your product.
Developing software is an art, but spotting the right gang of people to give you feedback is even so. Now I will go back to my cave and meditate on the next features to implement.