The final 25-item SIT-UAS demonstrated good internal consistency (α = 0.84) and inter-rater agreement for scoring (Fleiss’ κ = 0.76). SIT-UAS scores correlated significantly with instructor-rated non-technical competence (r = 0.61, p < .001) and predicted simulator mission success (OR = 3.4 per SD increase).
(Your Name), Academic Affiliation Journal: Human Factors in Aviation or International Journal of Aerospace Psychology Abstract Objective: To design and empirically validate a Situational Judgement Test (SIT) tailored for Unmanned Aircraft System (UAS) operators (SIT-UAS), assessing non-technical skills such as decision-making, situational awareness, and risk management.
The SIT-UAS is a reliable and valid tool for assessing judgement in UAS operations. It offers a practical, low-fidelity alternative for selection and training needs analysis. sit uas
Correct (expert rated best): B (Immediate RTH – prioritizes safety over mission) Least effective: A (Continued flight risks loss of aircraft)
Traditional technical assessments for UAS pilots focus on procedural knowledge, yet most operational failures stem from poor judgement under ambiguous or time-critical conditions. Existing selection tools lack scenario-based items specific to UAS challenges (e.g., beyond visual line of sight operations, lost link procedures). The SIT-UAS is a reliable and valid tool
Scenario: You are operating a UAS beyond visual line of sight. The ground control station displays a “Link Quality Low” warning, and you have not received a telemetry update for 12 seconds. Your mission objective is to survey a flooded area. What do you do?
A three-phase mixed-methods approach: (1) Critical incident interviews with 20 expert UAS operators to generate realistic scenarios; (2) Expert panel (n=10) to establish correct/incorrect response keys; (3) Validation with 150 UAS trainees, comparing SIT-UAS scores against instructor ratings and simulator performance. D. Wait 30 seconds
A. Continue the mission, hoping the link recovers. B. Immediately initiate return-to-home (RTH). C. Climb to higher altitude to improve line of sight. D. Wait 30 seconds, then command RTH if no recovery.