Reglamento administración y control de bienes del sector público

There is chosen to make use of the scenario testing method3_{, because the} results contain the experience of users with the different concepts. For this method a scenario is written of using the product, that the user will preform. The scenario is a guideline for the user, of how to use the product. During the test the test person will experience the product in the situation it is used for. Making use of this method for the crossing designer has multiple advantages.

-­‐ The user is using the actual product, and can experience how it is working with the crossing designer.

-­‐ The user will learn the product, the crossing designer is a new tool for the user and therefore they need help to understand how it works. With the scenario testing the user will have a guideline of how the product should be used.

-­‐ _{The scenario includes all the important features of the crossing} designer. It makes sure that the user won’t forget or miss things of the crossing designer that could influence the users experience. -­‐ _{All the users will test the crossing designer in the same way, and}

experience the same features. When there is no scenario results might differ from each other because users have done something different.

Besides these advantages another advantage was that only features of the scenario has to be built as a prototype.

1. Page 55

2. Page 39

77

Protocol

A protocol describes the activities, requirements and evaluation of a test. A protocol is important to make sure tests are done in the correct way and reliable results are obtained. A protocol will help in doing the test each time the same, so that results can be compared. Important aspects of the protocol of scenario testing are; the scenario’s, the test persons and the scoring method.

Scenarios

For the three different concepts a scenario1 _{for testing the prototype is} written. Chosen is not to write one scenario useable for all the concepts but to write for each concept a scenario, this to make sure that the users can see the differences in the features between the prototypes. In the three different scenarios the main story is the same, so that the user can compare the functioning.

The test person will test all three scenarios. The order of the scenarios has effect on the results of the user test, because there is a learning effect during the testing of the three concepts. The crossing designer is quite a new product, so the concept that is tested first will prepare the test person already for the next concept that is tested. For the step-by-step structure concept the main focus is supporting the understanding and use of the crossing designer optimally, while for the other two concepts the focus is more that people get support in the breeding process and that they will learn to use the product after several times. Therefore the test persons are divided over two groups; the people who have the scenario of the step-by- step structure first and the group who have one of the other two scenarios first. For the factors that could be affected by the order of testing, the scores of the two groups need to be taken separately to take the learning process into account before taking any conclusions.

Test persons

The user test is done with a group of 16 people. This group can be divided in two type of stakeholder, 10 breeders who are the final users of the crossing designer and 6 producers of the crossing designer who are the people of AIP. There has been chosen to include the producers in the user test to get information about the technical aspects of the concepts. The crossing designer is still in the early stages of the developing process, and there hasn’t been looked at the technical possibilities. Besides that the people at AIP work closely together with a lot of breeders and have a lot of knowledge about the interests of breeders in the crossing designer, which they can share in the user test. Testing the people of AIP will represent the interest of a big group of users.

Scoring

Testing is done to determine which concepts fits bests with the consumer needs and should be developed further with. The concepts can be 1. Appendix IV

78

compared with the requirements2 _{set for the project. Part of the} requirements can be checked without a user test but some not. The requirements that should be tested with the user test are the requirements that are related to experiencing the product. Besides the checking the concept with the requirements, the results of the user test also should give information about whether the crossing designer supports all steps in the design process, which concepts workflow best fits with the breeding process and the positive and negative aspect of the concepts.

To get these results the test person is analysed when making the test, and a questionnaire1 _{is held during an interview after testing. There has been} chosen to do an interview because the crossing designer is still in the developing phase so there are still a lot of things variable that can be better discussed during an interview. During the interview there is also gained more understanding of why the user has this opinion, and understanding that is very important in the early stages of the design process because it will help with the further development of the crossing designer.

Results

The results of the test are separated in two parts, the scoring results2 _that are the result of how the users have scored the different concepts and the discussion results3 _{that are the results of the comments the users have} been given on the concepts during the interviews. The results have been analysed to take conclusions about the concepts and decide with which concept to work further. From the scoring results can be concluded that most users prefer the Web-based concept (10 out of 16), but to understand this and support this we have to take a look at the other scores to conclude that the Web-based concept is the best.