Test characteristic | Value |
---|---|
Test run identifier | TR-4920777 |
Start time | 2024-12-19 16:17:45 UTC |
End time | 2024-12-19 16:18:43 UTC |
Test baseline identifier | TB-c13921d |
Environment identifier | TE-dc44283 |
Codebase version | interuss/monitoring/v0.0.0-9848684 |
Commit hash | 9848684815df0a2dcb30390d85bf613ab56fd736 |
conflicting_flights
(resources.flight_planning.FlightIntentsResource)id_generator
(resources.interuss.IDGeneratorResource)client_identity
utm_client_identity
resource
invalid_flight_intents
(resources.flight_planning.FlightIntentsResource)non_conflicting_flights
(resources.flight_planning.FlightIntentsResource)planning_area
(resources.astm.f3548.v21.PlanningAreaResource)problematically_big_area
(resources.VerticesResource)query_behavior
(resources.interuss.QueryBehaviorResource)system_identity
(resources.versioning.SystemIdentityResource)test_exclusions
(resources.dev.TestExclusionsResource)utm_client_identity
(resources.communications.ClientIdentityResource)auth_adapter
utm_auth
resource
dss
(resources.astm.f3548.v21.DSSInstanceResource)auth_adapter
utm_auth
resource
dss_instances
(resources.astm.f3548.v21.DSSInstancesResource)auth_adapter
utm_auth
resource
flight_planners
(resources.flight_planning.FlightPlannersResource)auth_adapter
utm_auth
resource
mock_uss
(resources.interuss.mock_uss.client.MockUSSResource)auth_adapter
utm_auth
resource
prod_env_version_providers
(resources.versioning.VersionProvidersResource)auth_adapter
utm_auth
resource
second_utm_auth
(resources.communications.AuthAdapterResource)test_env_version_providers
(resources.versioning.VersionProvidersResource)auth_adapter
utm_auth
resource
utm_auth
(resources.communications.AuthAdapterResource)Suite / action generator | Scenario | mock_uss | uss1_core | uss1_dss | uss2_core | uss2_dss | <None> | Time | ||
---|---|---|---|---|---|---|---|---|---|---|
ASTM F3548-21 | → | 1) Get system versions | ✅ | ✅ | 0:00 | |||||
2) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | ✅ | 0:00 | ||||
For each F3548 DSS instance | DSS testing for ASTM NetRID F3548-21 | 3) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:00 | ||||||
4) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:00 | ||||||||
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, utm.availability_arbitration |
||||||||||
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, utm.availability_arbitration |
||||||||||
5) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | 0:00 | |||||||
6) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | 0:00 | |||||||
7) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | 0:00 | |||||||
8) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | 0:07 | |||||||
9) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:01 | ||||||||
10) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
11) ASTM SCD DSS: Interfaces authentication | ✅ | 0:01 | ||||||||
12) ASTM SCD DSS: Subscription Simple | ✅ | 0:01 | ||||||||
13) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | ||||||||
14) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | 0:00 | |||||||
15) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | 0:00 | |||||||
16) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | 0:00 | |||||||
Skipped: ASTM UTM DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.utm.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster" |
||||||||||
17) OVN Request Optional Extension to ASTM F3548-21 | ✅ | 0:00 | ||||||||
18) ASTM SCD DSS: Report | ✅ | 0:00 | ||||||||
DSS testing for ASTM NetRID F3548-21 | 19) ASTM SCD DSS: Implicit Subscription handling | ✅ | 0:00 | |||||||
20) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:00 | ||||||||
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, utm.availability_arbitration |
||||||||||
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, utm.availability_arbitration |
||||||||||
21) ASTM SCD DSS: USS Availability Synchronization | ✅ | ✅ | 0:00 | |||||||
22) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | 0:00 | ||||||||
23) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | 0:00 | |||||||
24) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | 0:07 | |||||||
25) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:00 | ||||||||
26) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
27) ASTM SCD DSS: Interfaces authentication | ✅ | 0:01 | ||||||||
28) ASTM SCD DSS: Subscription Simple | ✅ | 0:00 | ||||||||
29) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | ||||||||
30) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | 0:00 | ||||||||
31) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | 0:00 | |||||||
32) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | 0:01 | |||||||
Skipped: ASTM UTM DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.utm.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster" |
||||||||||
33) OVN Request Optional Extension to ASTM F3548-21 | ✅ | 0:00 | ||||||||
34) ASTM SCD DSS: Report | ✅ | 0:00 | ||||||||
For each appropriate combination of flight planner(s) | 35) Solo happy path | 0:00 | ||||||||
36) Solo happy path | 0:00 | |||||||||
For each appropriate combination of flight planner(s) | 37) Validation of operational intents | ✅ | ✅ | 0:00 | ||||||
38) Validation of operational intents | ✅ | ✅ | 0:00 | |||||||
For each appropriate combination of flight planner(s) | → |
Skipped: All actions from action generator Test suite action to run ActionType.ActionGenerator action_generators.flight_planning.FlightPlannerCombinations could not find required resource ID "priority_preemption_flights" used to populate child resource ID "priority_preemption_flights" |
||||||||
For each appropriate combination of flight planner(s) | 39) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | 0:01 | |||||
40) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||
41) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||
42) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | 0:01 | ||||||
For each appropriate combination of flight planner(s) | 43) Data Validation of GET operational intents by USS | ✅ | ✅ | ✅ | 0:15 | |||||
44) Data Validation of GET operational intents by USS | ✅ | ✅ | ✅ | 0:15 | ||||||
For each appropriate combination of flight planner(s) | 45) Awareness of relevant operational intents | ✅ | ✅ | ✅ | 0:01 | |||||
46) Awareness of relevant operational intents | ✅ | ✅ | ✅ | 0:01 | ||||||
For each appropriate combination of flight planner(s) | → |
Skipped: All actions from action generator AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.conformance_monitoring_sa` which it requires to create operational intent references in an off-nominal state. Update `scopes_authorized` to include `utm.conformance_monitoring_sa` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, utm.availability_arbitration |
||||||||
For each appropriate combination of flight planner(s) |
Skipped: All actions from action generator AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.conformance_monitoring_sa` which it requires to create operational intent references in an off-nominal state. Update `scopes_authorized` to include `utm.conformance_monitoring_sa` to provide this authorization. 5 scopes currently declared as authorized for AuthAdapterResource: interuss.versioning.read_system_versions, interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, utm.availability_arbitration |
|||||||||
→ | 47) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | ✅ | 0:00 | |||
48) ASTM F3548-21 evaluate system versions | ✅ | ✅ | 0:00 | |||||||
49) ASTM F3548 UTM aggregate checks | ✅ | ✅ | 0:00 |