TR-fc6c0a9 sequence view

Test characteristic	Value
Test run identifier	TR-fc6c0a9
Start time	2024-10-14 12:06:02 UTC
End time	2024-10-14 12:08:58 UTC
Test baseline identifier	TB-bb098b4
Environment identifier	TE-87c2279
Codebase version	interuss/monitoring/v0.0.0-2ca7dee
Commit hash	2ca7dee5c4f881fe08c6d4572a40c755b1d98ed6

Resources configuration

Baseline
:
- kentland_flights_data (resources.netrid.FlightDataResource)
  :
  - Specification
    :
    
    kml_source
    :
    
    kml_file
    :
    
    path
    :
    file://./test_data/usa/kentland/rid.kml
    
    hash_sha512
    :
    57c6d08055d40196fc7ae28f9e386032a243377d2a3cc8d302529e8e284ef4423f6b2f7a98c3c52eb86a64cc3d7da472f349e27b491a3d2ef191e20ba61c6d45
    
    random_seed
    :
    12345
    
    reference_time
    :
    2022-01-01T00:00:00Z
    
    flight_start_delay
    :
    5s
- netrid_observation_evaluation_configuration (resources.netrid.EvaluationConfigurationResource)
  :
  - Specification
    :
    
    min_polling_interval
    :
    5s
    
    repeat_query_rect_period
    :
    3
    
    max_propagation_latency
    :
    10s
    
    min_query_diagonal
    :
    100
- utm_client_identity (resources.communications.ClientIdentityResource)
  :
  - Specification
    :
    
    whoami_audience
    :
    localhost
    
    whoami_scope
    :
    rid.display_provider
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- id_generator (resources.interuss.IDGeneratorResource)
  :
  - Specification
    :
  - Dependencies
    :
    
    client_identity
    :
    From utm_client_identity resource
- kentland_service_area (resources.netrid.ServiceAreaResource)
  :
  - Specification
    :
    
    base_url
    :
    https://testdummy.interuss.org/interuss/monitoring/uss_qualifier/configurations/dev/library/resources/kentland_service_area
    
    footprint
    :
    
    item_1
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.614
    
    item_2
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.614
    
    item_3
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.544
    
    item_4
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.544
    
    altitude_min
    :
    0.0
    
    altitude_max
    :
    3048.0
    
    reference_time
    :
    2023-01-10T00:00:00.123456+00:00
    
    time_start
    :
    2023-01-10T00:00:01.123456+00:00
    
    time_end
    :
    2023-01-10T01:00:01.123456+00:00
- au_problematically_big_area (resources.VerticesResource)
  :
  - Specification
    :
    
    vertices
    :
    
    item_1
    :
    
    lat
    :
    -23.0
    
    lng
    :
    130.0
    
    item_2
    :
    
    lat
    :
    -24.0
    
    lng
    :
    130.0
    
    item_3
    :
    
    lat
    :
    -24.0
    
    lng
    :
    132.0
    
    item_4
    :
    
    lat
    :
    -23.0
    
    lng
    :
    132.0
- test_exclusions (resources.dev.TestExclusionsResource)
  :
  - Specification
    :
    
    allow_private_addresses
    :
    True
    
    allow_cleartext_queries
    :
    True
Environment
:
- utm_auth (resources.communications.AuthAdapterResource)
  :
  - Specification
    :
    
    environment_variable_containing_auth_spec
    :
    AUTH_SPEC
    
    scopes_authorized
    :
    
    item_1
    :
    rid.inject_test_data
    
    item_2
    :
    dss.read.identification_service_areas
    
    item_3
    :
    rid.service_provider
    
    item_4
    :
    rid.display_provider
    
    item_5
    :
    dss.write.identification_service_areas
    
    item_6
    :
    dss.read.identification_service_areas
    
    item_7
    :
    interuss.flight_planning.direct_automated_test
    
    item_8
    :
    interuss.flight_planning.plan
    
    item_9
    :
    utm.inject_test_data
    
    item_10
    :
    utm.strategic_coordination
    
    item_11
    :
    utm.conformance_monitoring_sa
    
    item_12
    :
    utm.availability_arbitration
    
    item_13
    :
    utm.constraint_management
    
    item_14
    :
    interuss.versioning.read_system_versions
    
    item_15
    :
    interuss.geospatial_map.query
    
    item_16
    :
- netrid_service_providers_v22a (resources.netrid.NetRIDServiceProviders)
  :
  - Specification
    :
    
    service_providers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    injection_base_url
    :
    http://v22a.ridsp.uss1.localutm/ridsp/injection
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- netrid_observers_v22a (resources.netrid.NetRIDObserversResource)
  :
  - Specification
    :
    
    observers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    observation_base_url
    :
    http://v22a.riddp.uss1.localutm/riddp/observation
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- netrid_dss_instances_v22a (resources.astm.f3411.DSSInstancesResource)
  :
  - Specification
    :
    
    dss_instances
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss1.localutm/rid/v2
    
    item_2
    :
    
    participant_id
    :
    uss2
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss2.localutm/rid/v2
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource

Full configuration

v1
:
- test_run
  :
  - resources
    :
    
    resource_declarations
    :
    
    kentland_flights_data
    :
    
    resource_type
    :
    resources.netrid.FlightDataResource
    
    specification
    :
    
    kml_source
    :
    
    kml_file
    :
    
    path
    :
    file://./test_data/usa/kentland/rid.kml
    
    hash_sha512
    :
    57c6d08055d40196fc7ae28f9e386032a243377d2a3cc8d302529e8e284ef4423f6b2f7a98c3c52eb86a64cc3d7da472f349e27b491a3d2ef191e20ba61c6d45
    
    random_seed
    :
    12345
    
    reference_time
    :
    2022-01-01T00:00:00Z
    
    flight_start_delay
    :
    5s
    
    dependencies
    :
    
    netrid_observation_evaluation_configuration
    :
    
    resource_type
    :
    resources.netrid.EvaluationConfigurationResource
    
    specification
    :
    
    min_polling_interval
    :
    5s
    
    repeat_query_rect_period
    :
    3
    
    max_propagation_latency
    :
    10s
    
    min_query_diagonal
    :
    100
    
    dependencies
    :
    
    utm_client_identity
    :
    
    resource_type
    :
    resources.communications.ClientIdentityResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    whoami_audience
    :
    localhost
    
    whoami_scope
    :
    rid.display_provider
    
    id_generator
    :
    
    resource_type
    :
    resources.interuss.IDGeneratorResource
    
    dependencies
    :
    
    client_identity
    :
    utm_client_identity
    
    specification
    :
    
    kentland_service_area
    :
    
    resource_type
    :
    resources.netrid.ServiceAreaResource
    
    specification
    :
    
    base_url
    :
    https://testdummy.interuss.org/interuss/monitoring/uss_qualifier/configurations/dev/library/resources/kentland_service_area
    
    footprint
    :
    
    item_1
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.614
    
    item_2
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.614
    
    item_3
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.544
    
    item_4
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.544
    
    altitude_min
    :
    0.0
    
    altitude_max
    :
    3048.0
    
    reference_time
    :
    2023-01-10T00:00:00.123456+00:00
    
    time_start
    :
    2023-01-10T00:00:01.123456+00:00
    
    time_end
    :
    2023-01-10T01:00:01.123456+00:00
    
    dependencies
    :
    
    au_problematically_big_area
    :
    
    resource_type
    :
    resources.VerticesResource
    
    specification
    :
    
    vertices
    :
    
    item_1
    :
    
    lat
    :
    -23.0
    
    lng
    :
    130.0
    
    item_2
    :
    
    lat
    :
    -24.0
    
    lng
    :
    130.0
    
    item_3
    :
    
    lat
    :
    -24.0
    
    lng
    :
    132.0
    
    item_4
    :
    
    lat
    :
    -23.0
    
    lng
    :
    132.0
    
    dependencies
    :
    
    utm_auth
    :
    
    resource_type
    :
    resources.communications.AuthAdapterResource
    
    specification
    :
    
    environment_variable_containing_auth_spec
    :
    AUTH_SPEC
    
    scopes_authorized
    :
    
    item_1
    :
    rid.inject_test_data
    
    item_2
    :
    dss.read.identification_service_areas
    
    item_3
    :
    rid.service_provider
    
    item_4
    :
    rid.display_provider
    
    item_5
    :
    dss.write.identification_service_areas
    
    item_6
    :
    dss.read.identification_service_areas
    
    item_7
    :
    interuss.flight_planning.direct_automated_test
    
    item_8
    :
    interuss.flight_planning.plan
    
    item_9
    :
    utm.inject_test_data
    
    item_10
    :
    utm.strategic_coordination
    
    item_11
    :
    utm.conformance_monitoring_sa
    
    item_12
    :
    utm.availability_arbitration
    
    item_13
    :
    utm.constraint_management
    
    item_14
    :
    interuss.versioning.read_system_versions
    
    item_15
    :
    interuss.geospatial_map.query
    
    item_16
    :
    
    dependencies
    :
    
    netrid_service_providers_v22a
    :
    
    resource_type
    :
    resources.netrid.NetRIDServiceProviders
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    service_providers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    injection_base_url
    :
    http://v22a.ridsp.uss1.localutm/ridsp/injection
    
    netrid_observers_v22a
    :
    
    resource_type
    :
    resources.netrid.NetRIDObserversResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    observers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    observation_base_url
    :
    http://v22a.riddp.uss1.localutm/riddp/observation
    
    netrid_dss_instances_v22a
    :
    
    resource_type
    :
    resources.astm.f3411.DSSInstancesResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    dss_instances
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss1.localutm/rid/v2
    
    item_2
    :
    
    participant_id
    :
    uss2
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss2.localutm/rid/v2
    
    test_exclusions
    :
    
    resource_type
    :
    resources.dev.TestExclusionsResource
    
    specification
    :
    
    allow_private_addresses
    :
    True
    
    allow_cleartext_queries
    :
    True
    
    dependencies
    :
  - non_baseline_inputs
    :
    
    item_1
    :
    v1.test_run.resources.resource_declarations.utm_auth
    
    item_2
    :
    v1.test_run.resources.resource_declarations.netrid_service_providers_v22a
    
    item_3
    :
    v1.test_run.resources.resource_declarations.netrid_observers_v22a
    
    item_4
    :
    v1.test_run.resources.resource_declarations.netrid_dss_instances_v22a
  - action
    :
    
    test_suite
    :
    
    suite_type
    :
    suites.astm.netrid.f3411_22a
    
    resources
    :
    
    flights_data
    :
    kentland_flights_data
    
    service_providers
    :
    netrid_service_providers_v22a
    
    observers
    :
    netrid_observers_v22a
    
    evaluation_configuration
    :
    netrid_observation_evaluation_configuration
    
    dss_instances
    :
    netrid_dss_instances_v22a
    
    utm_client_identity
    :
    utm_client_identity
    
    id_generator
    :
    id_generator
    
    service_area
    :
    kentland_service_area
    
    problematically_big_area
    :
    au_problematically_big_area
    
    test_exclusions
    :
    test_exclusions
    
    on_failure
    :
    ReactionToFailure.Continue
  - execution
    :
    
    stop_fast
    :
    True
    
    stop_when_resource_not_created
    :
    False
    
    include_action_when
    :
    None
    
    skip_action_when
    :
    None
- artifacts
  :
  - raw_report
    :
    
    redact_access_tokens
    :
    True
    
    indent
    :
    None
  - tested_requirements
    :
    
    item_1
    :
    
    report_name
    :
    requirements
    
    requirement_collections
    :
    
    sp_dp_dss
    :
    
    requirement_sets
    :
    
    item_1
    :
    astm.f3411.v22a.service_provider#Mandatory requirements
    
    item_2
    :
    astm.f3411.v22a.display_provider#Mandatory requirements
    
    item_3
    :
    astm.f3411.v22a.dss_provider
    
    sp_dss
    :
    
    requirement_sets
    :
    
    item_1
    :
    astm.f3411.v22a.service_provider#Mandatory requirements
    
    item_2
    :
    astm.f3411.v22a.dss_provider
    
    participant_requirements
    :
    
    uss1
    :
    sp_dp_dss
    
    uss2
    :
    sp_dss
  - sequence_view
    :
    
    redact_access_tokens
    :
    True
    
    render_kml
    :
    True
  - report_html
    :
    None
  - templated_reports
    :
    None
- validation
  :
  - criteria
    :
    
    item_1
    :
    
    applicability
    :
    
    test_scenarios
    :
    
    pass_condition
    :
    
    each_element
    :
    
    has_execution_error
    :
    False
    
    item_2
    :
    
    applicability
    :
    
    failed_checks
    :
    
    has_severity
    :
    
    higher_than
    :
    Severity.Low
    
    pass_condition
    :
    
    elements
    :
    
    count
    :
    
    equal_to
    :
    0.0
    
    item_3
    :
    
    applicability
    :
    
    skipped_actions
    :
    
    pass_condition
    :
    
    elements
    :
    
    count
    :
    
    equal_to
    :
    2.0

Scenarios executed

Suite / action generator			Scenario	uss1	uss2	<None>	Time
ASTM F3411-22a	For each F3411 DSS instance	DSS testing for ASTM NetRID F3411-22a	1) ASTM NetRID DSS: Simple ISA	✅			0:00
			2) ASTM NetRID DSS: Submitted ISA Validations	✅			0:00
			3) ASTM NetRID DSS: ISA Expiry	✅			0:05
			4) ASTM NetRID DSS: ISA Subscription Interactions	✅			0:00
			5) ASTM NetRID DSS: Subscription Validation	✅			0:00
			6) ASTM NetRID DSS: Subscription Simple	✅			0:00
			7) ASTM F3411-22a NetRID DSS interoperability	✅	✅	🌐	0:11
			8) ASTM NetRID DSS: Token Validation	✅			0:00
			Skipped: ASTM NetRID DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.netrid.v22a.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster"
			9) ASTM NetRID DSS: Concurrent Requests	✅			0:21
		DSS testing for ASTM NetRID F3411-22a	10) ASTM NetRID DSS: Simple ISA		✅		0:00
			11) ASTM NetRID DSS: Submitted ISA Validations		✅		0:00
			12) ASTM NetRID DSS: ISA Expiry		✅		0:05
			13) ASTM NetRID DSS: ISA Subscription Interactions		✅		0:00
			14) ASTM NetRID DSS: Subscription Validation		✅		0:00
			15) ASTM NetRID DSS: Subscription Simple		✅		0:00
			16) ASTM F3411-22a NetRID DSS interoperability	✅	✅	🌐	0:11
			17) ASTM NetRID DSS: Token Validation		✅		0:00
			Skipped: ASTM NetRID DSS: Direct CRDB access Test suite action to run ActionType.TestScenario scenarios.astm.netrid.v22a.dss.CRDBAccess could not find required resource ID "dss_crdb_cluster" used to populate child resource ID "crdb_cluster"
			18) ASTM NetRID DSS: Concurrent Requests		✅		0:21
	→		19) ASTM NetRID nominal behavior	✅		✅	1:30
			20) ASTM NetRID SP clients misbehavior handling	✅		✅	0:10
			21) ASTM NetRID: Operator interactions				0:00
			22) ASTM F3411-22a NetRID aggregate checks	✅			0:00

Sequence view of uss_qualifier test run

Test run

Resources configuration

Full configuration

Scenarios executed