Test characteristic | Value |
---|---|
Test run identifier | TR-5a5e908 |
Start time | 2024-10-14 12:06:10 UTC |
End time | 2024-10-14 12:06:55 UTC |
Test baseline identifier | TB-826edd0 |
Environment identifier | TE-4872cfd |
Codebase version | interuss/monitoring/v0.0.0-2ca7dee |
Commit hash | 2ca7dee5c4f881fe08c6d4572a40c755b1d98ed6 |
conflicting_flights
(resources.flight_planning.FlightIntentsResource)id_generator
(resources.interuss.IDGeneratorResource)client_identity
utm_client_identity
resource
invalid_flight_intents
(resources.flight_planning.FlightIntentsResource)non_conflicting_flights
(resources.flight_planning.FlightIntentsResource)planning_area
(resources.astm.f3548.v21.PlanningAreaResource)problematically_big_area
(resources.VerticesResource)query_behavior
(resources.interuss.QueryBehaviorResource)system_identity
(resources.versioning.SystemIdentityResource)test_exclusions
(resources.dev.TestExclusionsResource)utm_client_identity
(resources.communications.ClientIdentityResource)auth_adapter
utm_auth
resource
dss
(resources.astm.f3548.v21.DSSInstanceResource)auth_adapter
utm_auth
resource
dss_instances
(resources.astm.f3548.v21.DSSInstancesResource)auth_adapter
utm_auth
resource
flight_planners
(resources.flight_planning.FlightPlannersResource)auth_adapter
utm_auth
resource
mock_uss
(resources.interuss.mock_uss.client.MockUSSResource)auth_adapter
utm_auth
resource
prod_env_version_providers
(resources.versioning.VersionProvidersResource)auth_adapter
utm_auth
resource
second_utm_auth
(resources.communications.AuthAdapterResource)test_env_version_providers
(resources.versioning.VersionProvidersResource)auth_adapter
utm_auth
resource
utm_auth
(resources.communications.AuthAdapterResource)Suite / action generator | Scenario | mock_uss | uss1_core | uss1_dss | uss2_core | uss2_dss | <None> | Time | ||
---|---|---|---|---|---|---|---|---|---|---|
ASTM F3548-21 | → | 1) Get system versions | ✅ | ✅ | 0:00 | |||||
2) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | ✅ | 0:00 | ||||
For each F3548 DSS instance | DSS testing for ASTM NetRID F3548-21 | 3) ASTM SCD DSS: Implicit Subscription handling | ✅ | ✅ | 0:00 | |||||
4) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:00 | ||||||||
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||||
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||||
Skipped: ASTM SCD DSS: USS Availability Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.availability_arbitration` which it requires to Set and read USS availability states. Update `scopes_authorized` to include `utm.availability_arbitration` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||||
5) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | ✅ | 0:00 | |||||||
6) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | 0:00 | |||||||
7) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | 0:07 | |||||||
8) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:01 | ||||||||
9) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
10) ASTM SCD DSS: Interfaces authentication | ✅ | 0:01 | ||||||||
11) ASTM SCD DSS: Subscription Simple | ✅ | 0:01 | ||||||||
12) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | ||||||||
13) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | ✅ | 0:00 | |||||||
14) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | 0:00 | |||||||
15) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | 0:00 | |||||||
Skipped: ASTM UTM DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.utm.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster" |
||||||||||
16) ASTM SCD DSS: Report | ✅ | 0:00 | ||||||||
DSS testing for ASTM NetRID F3548-21 | 17) ASTM SCD DSS: Implicit Subscription handling | ✅ | ✅ | 0:00 | ||||||
18) ASTM SCD DSS: Operational Intent Reference Simple | ✅ | 0:00 | ||||||||
Skipped: ASTM SCD DSS: Constraint Reference Simple AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||||
Skipped: ASTM SCD DSS: Constraint Reference Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.constraint_management` which it requires to create and delete constraint references. Update `scopes_authorized` to include `utm.constraint_management` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||||
Skipped: ASTM SCD DSS: USS Availability Synchronization AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.availability_arbitration` which it requires to Set and read USS availability states. Update `scopes_authorized` to include `utm.availability_arbitration` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||||
19) ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions | ✅ | 0:00 | ||||||||
20) ASTM SCD DSS: Subscription and entity deletion interaction | ✅ | ✅ | 0:00 | |||||||
21) ASTM SCD DSS: Subscription and entity interaction | ✅ | ✅ | 0:07 | |||||||
22) ASTM SCD DSS: Operational Intent Reference Key Validation | ✅ | 0:00 | ||||||||
23) ASTM SCD DSS: Operational Intent Reference Synchronization | ✅ | ✅ | 0:00 | |||||||
24) ASTM SCD DSS: Interfaces authentication | ✅ | 0:00 | ||||||||
25) ASTM SCD DSS: Subscription Simple | ✅ | 0:01 | ||||||||
26) ASTM SCD DSS: Subscription Validation | ✅ | 0:00 | ||||||||
27) ASTM F3548-21 UTM DSS Operational Intent Reference Access Control | ✅ | 0:00 | ||||||||
28) ASTM F3548-21 UTM DSS interoperability | ✅ | ✅ | 0:00 | |||||||
29) ASTM SCD DSS: Subscription Synchronization | ✅ | ✅ | 0:01 | |||||||
Skipped: ASTM UTM DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.utm.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster" |
||||||||||
30) ASTM SCD DSS: Report | ✅ | 0:00 | ||||||||
For each appropriate combination of flight planner(s) | 31) Solo happy path | 0:00 | ||||||||
32) Solo happy path | 0:00 | |||||||||
For each appropriate combination of flight planner(s) | 33) Validation of operational intents | ✅ | ✅ | 0:00 | ||||||
34) Validation of operational intents | ✅ | ✅ | 0:00 | |||||||
For each appropriate combination of flight planner(s) | → |
Skipped: All actions from action generator Test suite action to run ActionType.ActionGenerator action_generators.flight_planning.FlightPlannerCombinations could not find required resource ID "priority_preemption_flights" used to populate child resource ID "priority_preemption_flights" |
||||||||
For each appropriate combination of flight planner(s) | 35) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | 0:01 | |||||
36) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||
37) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | ✅ | 0:01 | |||||
38) Nominal planning: not permitted conflict with equal priority | ✅ | ✅ | ✅ | 0:01 | ||||||
For each appropriate combination of flight planner(s) | 39) Data Validation of GET operational intents by USS | ✅ | ✅ | ✅ | 0:08 | |||||
40) Data Validation of GET operational intents by USS | ✅ | ✅ | ✅ | 0:08 | ||||||
For each appropriate combination of flight planner(s) | 41) Awareness of relevant operational intents | ✅ | ✅ | ✅ | 0:01 | |||||
42) Awareness of relevant operational intents | ✅ | ✅ | ✅ | 0:01 | ||||||
For each appropriate combination of flight planner(s) | → |
Skipped: All actions from action generator AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.availability_arbitration` which it requires to declare virtual USS down in DSS. Update `scopes_authorized` to include `utm.availability_arbitration` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
||||||||
For each appropriate combination of flight planner(s) |
Skipped: All actions from action generator AuthAdapterResource provided to monitoring.uss_qualifier.resources.astm.f3548.v21.dss.DSSInstanceResource is not declared (in its resource specification) as authorized to obtain scope `utm.availability_arbitration` which it requires to declare virtual USS down in DSS. Update `scopes_authorized` to include `utm.availability_arbitration` to provide this authorization. 4 scopes currently declared as authorized for AuthAdapterResource: interuss.flight_planning.direct_automated_test, utm.strategic_coordination, interuss.flight_planning.plan, interuss.versioning.read_system_versions |
|||||||||
→ | 43) ASTM F3548 flight planners preparation | ✅ | ✅ | ✅ | ✅ | ✅ | 0:00 | |||
44) ASTM F3548-21 evaluate system versions | ✅ | ✅ | 0:00 | |||||||
45) ASTM F3548 UTM aggregate checks | ✅ | ✅ | 0:00 |