Creating an Observer Form

84 STEPS

1. This tutorial reviews how to add Observers and set up an Observers Report for your Ref Insight account.

The example in this tutorial is typical for soccer, but can be modified for any sport.

2. To start, click the arrow next to Evaluation to expand the dropdown.

3. Click Observer Reports

4. Click Observer Form Settings

5. There are several regions within this page, each of which will be reviewed in this tutorial.

6. The first step is to add Observers to your account. Observers can be selected from anyone within the Directory. Your account administrator will determine what, if any, assigning rules apply to Observer match roles.

7. To add or remove an Observer, click Edit

8. To remove an existing Observer, click the garbage can next to their name.

9. For this example, we will add a new Observer. Click Select Person to expand the dropdown list of people within the Directory.

10. Type the name of the person in the search bar and press Enter.

11. Click the name of the person you want to add as an Observer.

12. Click Add Observer

13. Confirm this action by clicking Add Observer again.

14. Adding an Observer here displays the Observer menu item in the Officials Portal for that person. Ensure the Observer has been invited to the Officials portal.

Click cancel to return to the previous page.

15. Now let's set up the Observer Report, which our Observers will fill out using the Ref Insight App.

The first section to set up is Performance Categories by Role.

16. Click Edit

17. Double Click the cell under Enabled to edit it.

18. Click the cell under Role

19. The dropdown list displays the match roles added to the account by your administrator.

For this example, we will choose Referee.

20. Click the cell under Category Name.

21. You can customize your Performance Category for each match role according to your needs. For this example, we will make Match Control a performance category for the Referee.

22. Type in a weighting for this category. Higher numbers correspond to a heavier weighting for this category, meaning this category has a higher importance than other categories.

For this example, we will give this category a weighting of 4.

23. Select the sort order for this category from the dropdown. Lower numbers mean the category will appear higher in the list when the Observer fills out the form.

24. For this example, we will have Match Control appear first in the list of categories for the Referee.

25. Click Add Row to add the next category.

26. Let's now add another performance category for the Referee.

27. For this example, our next category for the Referee is Interaction with Participants, with a weighting of 3 and appearing second in the list, below Match Control.

28. Click Add Row and continue in this way until all performance categories are added for each match role you want to appear in the Observer form.

29. We have now added multiple performance categories for the Referee, AR1, and AR2 for our Observer report.

30. Click Save when finished.

31. Click cancel to return to the previous page.

32. The Performance Categories by Role are now displayed here. Click Edit if you want to edit the Role, Category Name, Weighting, or Sort Order.

33. Next, we'll set up the Performance Rating Scale. This scale provides ratings for the performance categories we established in the previous steps.

34. Click Edit

35. Double Click the cell under Name to edit it.

36. The name of each level of rating is customizable. For this example, our highest rating will be named Very Good.

37. Choose the numeric value that corresponds to the level we previously named. This value will be used to calculate a composite score for the performance categories we created and according to the weighting we previously assigned to them.

38. Select the sort order of this rating. For this example, we will list Very Good at the top by selecting the number 1.

39. Click Add Row to add the next rating level.

40. We made Good (Expected) our next level, with a numeric value of 3 and appearing below the Very Good level.

41. Repeat these steps to add in the remaining levels of your rating scale. Note that for the level "Not Observed" we did not give it a numeric value. If a performance category is rated as "not observed" it will be left out of the score calculation.

42. Click Save when finished.

43. Click cancel to return to the previous page.

44. Next, we will set up our Observer Terminology, which provides options to describe specific incidents and provide recommendations to your administrator about the overall performance of the official.

45. Click Edit

46. It is important to note that the dropdown list under Type is pre-configured. If you need additional options, please submit a ticket to support@refinsight.com with an explanation and description of your request.

47. There are currently four Types of terminology to choose from.

For this example, we will start with descriptions of Accuracy, which will connect to CMI (Critical Match Incident) and Send-off Type.

48. The name of the Accuracy options is customizable. For this example, our first option will be Correct.

49. Click Add Row to add the next option.

50. Continue adding options such as Incorrect or Inconclusive for Accuracy Type.

51. In this example, we also added options for CMI Type, Send-off Type, and Recommendation.

Recommendation is designed to provide the administrator with an overall recommendation for the official observed. Items under the Name column are customizable.

52. Click Save when finished.

53. Click cancel to return to the previous page.

54. Our entries are now displayed under each section of the Observer Form: The first section is Performance Categories by Role.

55. The second section is the Performance Rating Scale.

56. Our last section was Observer Terminology.

57. As Observer reports are submitted, they will display on the Observer Reports page.

58. Use the interactive menu to display and sort the columns of this report.

To view additional details, click the magnifying glass next to a specific report.

59. Under the Observer Report area, additional details are shown, such as whether the Observer watched the full match or only part of the match. If only part of the match was observed, the Observer indicates how many minutes they watched.

60. Match details are shown on the right side of the page.

61. The Overall Recommendation is selected from a dropdown we created in our settings. General Comments are free text added by the Observer. Receptive to Feedback items are automatically included in the Observer form.

62. Click Calculate Simple Composite Score to calculate the score for this official based on the Ratings the Observer provided and the weightings we selected for each category in our settings.

63. The Simple Composite Score is displayed here and is included as a column in the master report that can be sorted and filtered using the interactive menu.

64. Under Ratings, each category for this role is listed in the order determined in our settings. The scores (number and name) the Observer chose according to the rating scale we set up previously are also displayed.

65. Free text comments can be added by the Observer if they wish, and will be displayed here.

Note that only observations with Full Match selected will allow ratings and comments to be made.

66. If a Critical Match Incident is included, the CMI Type, Accuracy, Send Off Type (if applicable), and Comments are displayed. Our previous settings are selected by the Observer through dropdown lists.

67. Click cancel to return to the master report.

68. Use the interactive menu to sort, filter, or apply control breaks to get insights into your Observer reports. Let's look at a couple of examples of useful insights.

Click Actions.

69. Click Format, then Control Break.

70. Click Column 1

71. To pull reports together for a single official, click Official.

72. Click Column 2

73. To nest reports for an official by their role, click Role for the second column.

74. Click Apply

75. Our master report now gathers Observations for each official by match role.

76. Another useful control break is by Overall Recommendation.

Click inside the cell to Edit the Control Break.

77. Click Column 1

78. Click Overall Recommendation

79. Click Column 2

80. Click - Select Column - to remove the nested control break.

81. Click Apply

82. Our observation reports are now gathered by Overall Recommendation Level. You can nest control breaks with match role or official, filter for specific composite scores, dates, ratings, and many other items.

83. Thank you for watching the tutorial on Setting Up Observation Forms and exploring the useful insights that come from these reports to support your referee development.

84. A tutorial for Observers on accessing and filling out an Observer report is also available within the Officials Portal Knowledge Base.