Test characteristic | Value |
---|---|
Test run identifier | TR-e456523 |
Start time | 2024-12-19 16:17:43 UTC |
End time | 2024-12-19 16:18:44 UTC |
Test baseline identifier | TB-f381196 |
Environment identifier | TE-c8d3580 |
Codebase version | interuss/monitoring/v0.0.0-9848684 |
Commit hash | 9848684815df0a2dcb30390d85bf613ab56fd736 |
prod_env_version_providers
(resources.versioning.VersionProvidersResource)auth_adapter
utm_auth
resource
test_exclusions
(resources.dev.TestExclusionsResource)utm_client_identity
(resources.communications.ClientIdentityResource)auth_adapter
utm_auth
resource
id_generator
(resources.interuss.IDGeneratorResource)client_identity
utm_client_identity
resource
planning_area
(resources.astm.f3548.v21.PlanningAreaResource)problematically_big_area
(resources.VerticesResource)conflicting_flights
(resources.flight_planning.FlightIntentsResource)invalid_flight_intents
(resources.flight_planning.FlightIntentsResource)non_conflicting_flights
(resources.flight_planning.FlightIntentsResource)utm_auth
(resources.communications.AuthAdapterResource)second_utm_auth
(resources.communications.AuthAdapterResource)test_env_version_providers
(resources.versioning.VersionProvidersResource)auth_adapter
utm_auth
resource
flight_planners
(resources.flight_planning.FlightPlannersResource)auth_adapter
utm_auth
resource
dss
(resources.astm.f3548.v21.DSSInstanceResource)auth_adapter
utm_auth
resource
dss_instances
(resources.astm.f3548.v21.DSSInstancesResource)auth_adapter
utm_auth
resource
mock_uss
(resources.interuss.mock_uss.client.MockUSSResource)auth_adapter
utm_auth
resource
Suite / action generator | Scenario | mock_uss | uss1_core | uss1_dss | uss2_core | uss2_dss | <None> | Time | ||
---|---|---|---|---|---|---|---|---|---|---|
ASTM F3548-21 | → | 1) Get system versions | ✅ | ✅ | 0:00 | |||||
2) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | ✅ | 0:00 | ||||
For each F3548 DSS instance | DSS testing for ASTM NetRID F3548-21 | 3) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:01 | ||||||
4) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:00 | ||||||||
5) ASTM SCD DSS: Constraint Reference Simple | ✅ | 0:00 | ||||||||
6) ASTM SCD DSS: Constraint Reference Synchronization | ✅ | ✅ | 0:01 | |||||||
7) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | 0:00 | |||||||
8) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | 0:00 | |||||||
9) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | 0:00 | |||||||
10) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | 0:07 | |||||||
11) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:00 | ||||||||
12) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
13) ASTM SCD DSS: Interfaces authentication | ✅ | 0:01 | ||||||||
14) ASTM SCD DSS: Subscription Simple | ✅ | 0:01 | ||||||||
15) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | ||||||||
16) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | 0:00 | |||||||
17) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | 0:00 | |||||||
18) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | 0:00 | |||||||
Skipped: ASTM UTM DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.utm.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster" |
||||||||||
19) OVN Request Optional Extension to ASTM F3548-21 | ✅ | 0:00 | ||||||||
20) ASTM SCD DSS: Report | ✅ | 0:00 | ||||||||
DSS testing for ASTM NetRID F3548-21 | 21) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:00 | |||||||
22) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:00 | ||||||||
23) ASTM SCD DSS: Constraint Reference Simple | ✅ | 0:00 | ||||||||
24) ASTM SCD DSS: Constraint Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
25) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | 0:00 | |||||||
26) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | 0:00 | ||||||||
27) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | 0:00 | |||||||
28) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | 0:07 | |||||||
29) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:00 | ||||||||
30) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
31) ASTM SCD DSS: Interfaces authentication | ✅ | 0:01 | ||||||||
32) ASTM SCD DSS: Subscription Simple | ✅ | 0:01 | ||||||||
33) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | ||||||||
34) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | 0:00 | ||||||||
35) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | 0:00 | |||||||
36) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | 0:00 | |||||||
Skipped: ASTM UTM DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.utm.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster" |
||||||||||
37) OVN Request Optional Extension to ASTM F3548-21 | ✅ | 0:00 | ||||||||
38) ASTM SCD DSS: Report | ✅ | 0:00 | ||||||||
For each appropriate combination of flight planner(s) | 39) Solo happy path | 0:00 | ||||||||
40) Solo happy path | 0:00 | |||||||||
For each appropriate combination of flight planner(s) | 41) Validation of operational intents | ✅ | ✅ | 0:00 | ||||||
42) Validation of operational intents | ✅ | ✅ | 0:00 | |||||||
For each appropriate combination of flight planner(s) | → |
Skipped: All actions from action generator Test suite action to run ActionType.ActionGenerator action_generators.flight_planning.FlightPlannerCombinations could not find required resource ID "priority_preemption_flights" used to populate child resource ID "priority_preemption_flights" |
||||||||
For each appropriate combination of flight planner(s) | 43) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | 0:01 | |||||
44) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||
45) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||
46) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | 0:01 | ||||||
For each appropriate combination of flight planner(s) | 47) Data Validation of GET operational intents by USS | ✅ | ✅ | ✅ | 0:15 | |||||
48) Data Validation of GET operational intents by USS | ✅ | ✅ | ✅ | 0:15 | ||||||
For each appropriate combination of flight planner(s) | 49) Awareness of relevant operational intents | ✅ | ✅ | ✅ | 0:01 | |||||
50) Awareness of relevant operational intents | ✅ | ✅ | ✅ | 0:01 | ||||||
For each appropriate combination of flight planner(s) | → |
Skipped: All actions from action generator AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.conformance_monitoring_sa` which it requires to create operational intent references in an off-nominal state. Update `scopes_authorized` to include `utm.conformance_monitoring_sa` to provide this authorization. 7 scopes currently declared as authorized for AuthAdapterResource: , utm.availability_arbitration, interuss.flight_planning.plan, interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.constraint_management, utm.strategic_coordination |
||||||||
For each appropriate combination of flight planner(s) |
Skipped: All actions from action generator AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.conformance_monitoring_sa` which it requires to create operational intent references in an off-nominal state. Update `scopes_authorized` to include `utm.conformance_monitoring_sa` to provide this authorization. 7 scopes currently declared as authorized for AuthAdapterResource: , utm.availability_arbitration, interuss.flight_planning.plan, interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.constraint_management, utm.strategic_coordination |
|||||||||
→ | 51) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | ✅ | 0:00 | |||
52) ASTM F3548-21 evaluate system versions | ✅ | ✅ | 0:00 | |||||||
53) ASTM F3548 UTM aggregate checks | ✅ | ✅ | 0:00 |