|
With mock_uss instances configured for a locality
8:45
|
→
0:00
|
1) Configure mock_uss locality
0:00
|
|
✅ |
✅ |
|
|
U-space required services
8:45
|
→
0:00
|
2) Get system versions
0:00
|
|
✅ |
✅ |
|
|
U-space flight authorisation
1:39
|
ASTM F3548-21
1:38
|
→
0:01
|
3) Get system versions
0:00
|
|
✅ |
✅ |
|
|
Skipped: DSS pool information
Test suite action to run TestScenario scenarios.astm.utm.dss.pool_info.PoolInfo could not find required resource ID "interuss_dss_instances" used to populate child resource ID "dss_instances"
|
|
|
|
|
|
4) ASTM F3548 flight planners preparation
0:01
|
✅ |
✅ |
✅ |
✅ |
|
For each resource environment supplying dss, planning_area, id_generator, and flight_intents
0:30
|
DSS testing for ASTM F3548-21
0:15
|
5) ASTM SCD DSS: Operational Intent Explicit Subscription handling
0:00
|
|
✅ |
|
|
|
6) ASTM SCD DSS: Implicit Subscription handling
0:01
|
|
✅ |
|
|
|
7) ASTM SCD DSS: Operational Intent Reference Simple
0:01
|
|
✅ |
|
|
|
8) ASTM SCD DSS: Constraint Reference Simple
0:00
|
|
✅ |
|
|
|
9) ASTM SCD DSS: Constraint Reference Synchronization
0:00
|
|
✅ |
✅ |
|
|
10) ASTM SCD DSS: USS Availability Synchronization
0:00
|
|
✅ |
✅ |
|
|
11) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
0:00
|
✅ |
✅ |
|
|
|
12) ASTM SCD DSS: Subscription and entity deletion interaction
0:01
|
|
✅ |
✅ |
|
|
13) ASTM SCD DSS: Subscription and entity interaction
0:08
|
|
✅ |
✅ |
|
|
14) ASTM SCD DSS: Operational Intent Reference Key Validation
0:00
|
|
✅ |
|
|
|
15) ASTM SCD DSS: Operational Intent Reference Synchronization
0:00
|
|
✅ |
✅ |
|
|
16) ASTM SCD DSS: Interfaces authentication
0:01
|
|
✅ |
|
|
|
17) ASTM SCD DSS: Subscription Simple
0:01
|
|
✅ |
|
|
|
18) ASTM SCD DSS: Subscription Validation
0:00
|
|
✅ |
|
|
|
19) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
0:00
|
✅ |
✅ |
|
|
|
20) ASTM F3548-21 UTM DSS interoperability
0:00
|
|
❌ |
❌ |
|
|
21) ASTM SCD DSS: Subscription Synchronization
0:01
|
|
✅ |
✅ |
|
|
Skipped: ASTM UTM DSS: Direct datastore access
Test suite action to run TestScenario scenarios.astm.utm.dss.DatastoreAccess could not find required resource ID "dss_datastore_cluster" used to populate child resource ID "datastore_cluster"
|
|
|
|
|
|
22) OVN Request Optional Extension to ASTM F3548-21
0:00
|
|
✅ |
|
|
|
23) ASTM SCD DSS: Report
0:00
|
|
✅ |
|
|
|
24) ASTM Availability DSS: USS Availability Mutation
0:00
|
|
✅ |
|
|
|
DSS testing for ASTM F3548-21
0:15
|
25) ASTM SCD DSS: Operational Intent Explicit Subscription handling
0:00
|
|
|
✅ |
|
|
26) ASTM SCD DSS: Implicit Subscription handling
0:02
|
|
|
✅ |
|
|
27) ASTM SCD DSS: Operational Intent Reference Simple
0:00
|
|
|
✅ |
|
|
28) ASTM SCD DSS: Constraint Reference Simple
0:00
|
|
|
✅ |
|
|
29) ASTM SCD DSS: Constraint Reference Synchronization
0:00
|
|
✅ |
✅ |
|
|
30) ASTM SCD DSS: USS Availability Synchronization
0:00
|
|
✅ |
✅ |
✅ |
|
31) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
0:00
|
|
|
✅ |
|
|
32) ASTM SCD DSS: Subscription and entity deletion interaction
0:01
|
|
✅ |
✅ |
|
|
33) ASTM SCD DSS: Subscription and entity interaction
0:08
|
|
✅ |
✅ |
|
|
34) ASTM SCD DSS: Operational Intent Reference Key Validation
0:01
|
|
|
✅ |
|
|
35) ASTM SCD DSS: Operational Intent Reference Synchronization
0:00
|
|
✅ |
✅ |
|
|
36) ASTM SCD DSS: Interfaces authentication
0:01
|
|
|
✅ |
|
|
37) ASTM SCD DSS: Subscription Simple
0:01
|
|
|
✅ |
|
|
38) ASTM SCD DSS: Subscription Validation
0:00
|
|
|
✅ |
|
|
39) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
0:00
|
|
|
✅ |
|
|
40) ASTM F3548-21 UTM DSS interoperability
0:00
|
|
❌ |
❌ |
|
|
41) ASTM SCD DSS: Subscription Synchronization
0:01
|
|
✅ |
✅ |
|
|
Skipped: ASTM UTM DSS: Direct datastore access
Test suite action to run TestScenario scenarios.astm.utm.dss.DatastoreAccess could not find required resource ID "dss_datastore_cluster" used to populate child resource ID "datastore_cluster"
|
|
|
|
|
|
42) OVN Request Optional Extension to ASTM F3548-21
0:00
|
|
|
✅ |
|
|
43) ASTM SCD DSS: Report
0:00
|
|
|
✅ |
|
|
44) ASTM Availability DSS: USS Availability Mutation
0:00
|
|
|
✅ |
|
|
For each resource environment supplying uss1, uss2, and flight_intents
0:10
|
45) Nominal planning: conflict with higher priority
0:02
|
|
✅ |
|
✅ |
|
46) Nominal planning: conflict with higher priority
0:02
|
|
✅ |
ℹ️ |
✅ |
|
47) Nominal planning: conflict with higher priority
0:03
|
|
✅ |
ℹ️ |
✅ |
|
48) Nominal planning: conflict with higher priority
0:03
|
|
✅ |
ℹ️ |
✅ |
|
For each resource environment supplying uss1, uss2, and flight_intents
0:17
|
49) Nominal planning: not permitted conflict with equal priority
0:04
|
|
✅ |
|
✅ |
|
50) Nominal planning: not permitted conflict with equal priority
0:04
|
|
✅ |
✅ |
✅ |
|
51) Nominal planning: not permitted conflict with equal priority
0:04
|
|
✅ |
✅ |
✅ |
|
52) Nominal planning: not permitted conflict with equal priority
0:05
|
|
✅ |
✅ |
✅ |
|
For each resource environment supplying tested_uss, invalid_flight_intents, conflicting_flights, and non_conflicting_flights
0:37
|
Single flight planner testing for ASTM F3548-21
0:19
|
53) Validation of operational intents
0:01
|
|
✅ |
|
|
|
54) Data Validation of GET operational intents by USS
0:15
|
✅ |
✅ |
|
|
|
55) Awareness of relevant operational intents
0:01
|
✅ |
✅ |
|
|
|
56) ASTM SCD USS: Interfaces authentication
0:01
|
|
✅ |
|
|
|
57) Off-Nominal planning: down USS
0:00
|
|
✅ |
|
✅ |
|
58) Off-Nominal planning: down USS with equal priority conflicts not permitted
0:01
|
|
✅ |
|
✅ |
|
Single flight planner testing for ASTM F3548-21
0:19
|
59) Validation of operational intents
0:01
|
|
✅ |
✅ |
|
|
60) Data Validation of GET operational intents by USS
0:15
|
✅ |
✅ |
✅ |
|
|
61) Awareness of relevant operational intents
0:01
|
✅ |
✅ |
✅ |
|
|
62) ASTM SCD USS: Interfaces authentication
0:01
|
|
✅ |
✅ |
|
|
63) Off-Nominal planning: down USS
0:01
|
|
✅ |
✅ |
✅ |
|
64) Off-Nominal planning: down USS with equal priority conflicts not permitted
0:01
|
|
✅ |
✅ |
✅ |
|
→
0:03
|
65) ASTM F3548 flight planners preparation
0:03
|
✅ |
✅ |
✅ |
✅ |
|
66) ASTM F3548 makeUssReport
0:00
|
|
✅ |
✅ |
|
|
67) ASTM F3548-21 evaluate system versions
0:00
|
|
✅ |
✅ |
|
|
68) ASTM F3548 UTM aggregate checks
0:00
|
|
✅ |
✅ |
|
|
→
0:00
|
69) Generic flight planners preparation
0:00
|
✅ |
✅ |
✅ |
|
|
For each appropriate combination of flight planner(s)
0:01
|
70) Flight authorisation validation
0:00
|
|
✅ |
|
|
|
71) Flight authorisation validation
0:00
|
|
|
✅ |
|
|
U-Space network identification
7:05
|
ASTM F3411-22a
7:05
|
→
5:41
|
Skipped: Get system versions
Test suite action to run TestScenario scenarios.versioning.GetSystemVersions could not find required resource ID "test_env_version_providers" used to populate child resource ID "version_providers"
|
|
|
|
|
|
72) ASTM NetRID Service Provider operator notification under slow update rate
0:00
|
|
✅ |
|
✅ |
|
73) ASTM NetRID Display Provider behavior
0:00
|
✅ |
✅ |
|
|
|
74) ASTM NetRID networked UAS disconnection
1:25
|
|
✅ |
|
✅ |
|
75) ASTM NetRID Service Provider operator notification on missing fields
1:37
|
|
✅ |
|
✅ |
|
76) ASTM NetRID Service Provider notification behavior
0:01
|
✅ |
✅ |
|
✅ |
|
77) ASTM NetRID nominal behavior
2:26
|
|
✅ |
|
✅ |
|
78) ASTM NetRID SP clients misbehavior handling
0:11
|
|
✅ |
|
✅ |
|
For each F3411 DSS instance
1:24
|
DSS testing for ASTM NetRID F3411-22a
0:42
|
79) ASTM NetRID DSS: Endpoint encryption
0:00
|
|
|
|
|
|
80) ASTM NetRID DSS: Simple ISA
0:00
|
|
✅ |
|
|
|
81) ASTM NetRID DSS: Submitted ISA Validations
0:00
|
|
✅ |
|
|
|
82) ASTM NetRID DSS: ISA Expiry
0:05
|
|
✅ |
|
|
|
83) ASTM NetRID DSS: ISA Subscription Interactions
0:00
|
|
✅ |
|
|
|
84) ASTM NetRID DSS: Subscription Validation
0:00
|
|
✅ |
|
|
|
85) ASTM NetRID DSS: Subscription Simple
0:01
|
|
✅ |
|
|
|
86) ASTM F3411-22a NetRID DSS interoperability
0:11
|
|
❌ |
❌ |
|
|
87) ASTM NetRID DSS: Token Validation
0:00
|
|
✅ |
|
|
|
Skipped: ASTM NetRID DSS: Direct datastore access
Test suite action to run TestScenario scenarios.astm.netrid.v22a.dss.DatastoreAccess could not find required resource ID "dss_datastore_cluster" used to populate child resource ID "datastore_cluster"
|
|
|
|
|
|
88) ASTM NetRID DSS: Concurrent Requests
0:25
|
|
✅ |
|
|
|
DSS testing for ASTM NetRID F3411-22a
0:42
|
89) ASTM NetRID DSS: Endpoint encryption
0:00
|
|
|
|
|
|
90) ASTM NetRID DSS: Simple ISA
0:00
|
|
|
✅ |
|
|
91) ASTM NetRID DSS: Submitted ISA Validations
0:00
|
|
|
✅ |
|
|
92) ASTM NetRID DSS: ISA Expiry
0:05
|
|
|
✅ |
|
|
93) ASTM NetRID DSS: ISA Subscription Interactions
0:00
|
|
|
✅ |
|
|
94) ASTM NetRID DSS: Subscription Validation
0:00
|
|
|
✅ |
|
|
95) ASTM NetRID DSS: Subscription Simple
0:01
|
|
|
✅ |
|
|
96) ASTM F3411-22a NetRID DSS interoperability
0:11
|
|
❌ |
❌ |
|
|
97) ASTM NetRID DSS: Token Validation
0:00
|
|
|
✅ |
|
|
Skipped: ASTM NetRID DSS: Direct datastore access
Test suite action to run TestScenario scenarios.astm.netrid.v22a.dss.DatastoreAccess could not find required resource ID "dss_datastore_cluster" used to populate child resource ID "datastore_cluster"
|
|
|
|
|
|
98) ASTM NetRID DSS: Concurrent Requests
0:25
|
|
|
✅ |
|
|
→
0:00
|
99) ASTM F3411-22a NetRID aggregate checks
0:00
|
❌ |
❌ |
❌ |
|
|
→
0:00
|
100) U-space MSL altitude
0:00
|
|
✅ |
|
|
|
→
0:00
|
101) Unconfigure mock_uss locality
0:00
|
|
✅ |
✅ |
|