TR-d106d24 sequence view

Test characteristic	Value
Test run identifier	TR-d106d24
Start time	2025-06-19 12:04:55 UTC
End time	2025-06-19 12:09:28 UTC
Test baseline identifier	TB-07d898f
Environment identifier	TE-87c2279
Codebase version	interuss/monitoring/v0.0.0-f52c9a3
Commit hash	f52c9a3282aa03207c5036e19db346f51d240742

Resources configuration

Baseline
:
- kentland_flights_data (resources.netrid.FlightDataResource)
  :
  - Specification
    :
    
    kml_source
    :
    
    kml_file
    :
    
    path
    :
    file://./test_data/usa/kentland/rid.kml
    
    hash_sha512
    :
    57c6d08055d40196fc7ae28f9e386032a243377d2a3cc8d302529e8e284ef4423f6b2f7a98c3c52eb86a64cc3d7da472f349e27b491a3d2ef191e20ba61c6d45
    
    random_seed
    :
    12345
    
    reference_time
    :
    2022-01-01T00:00:00Z
    
    flight_start_delay
    :
    5s
- netrid_observation_evaluation_configuration (resources.netrid.EvaluationConfigurationResource)
  :
  - Specification
    :
    
    min_query_diagonal
    :
    100
    
    max_propagation_latency
    :
    10s
    
    repeat_query_rect_period
    :
    3
    
    min_polling_interval
    :
    5s
- utm_client_identity (resources.communications.ClientIdentityResource)
  :
  - Specification
    :
    
    whoami_audience
    :
    localhost
    
    whoami_scope
    :
    rid.display_provider
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- id_generator (resources.interuss.IDGeneratorResource)
  :
  - Specification
    :
  - Dependencies
    :
    
    client_identity
    :
    From utm_client_identity resource
- kentland_service_area (resources.netrid.ServiceAreaResource)
  :
  - Specification
    :
    
    base_url
    :
    https://testdummy.interuss.org/interuss/monitoring/uss_qualifier/configurations/dev/library/resources/kentland_service_area
    
    footprint
    :
    
    item_1
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.614
    
    item_2
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.614
    
    item_3
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.544
    
    item_4
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.544
    
    altitude_min
    :
    0.0
    
    altitude_max
    :
    3048.0
    
    reference_time
    :
    2023-01-10T00:00:00.123456+00:00
    
    time_start
    :
    2023-01-10T00:00:01.123456+00:00
    
    time_end
    :
    2023-01-10T01:00:01.123456+00:00
- kentland_planning_area (resources.PlanningAreaResource)
  :
  - Specification
    :
    
    base_url
    :
    https://testdummy.interuss.org/interuss/monitoring/uss_qualifier/configurations/dev/library/resources/kentland_planning_area
    
    volume
    :
    
    outline_polygon
    :
    
    vertices
    :
    
    item_1
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.614
    
    item_2
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.614
    
    item_3
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.544
    
    item_4
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.544
    
    altitude_lower
    :
    
    value
    :
    0.0
    
    reference
    :
    W84
    
    units
    :
    M
    
    altitude_upper
    :
    
    value
    :
    3048.0
    
    reference
    :
    W84
    
    units
    :
    M
    
    outline_circle
    :
    None
- au_problematically_big_area (resources.VerticesResource)
  :
  - Specification
    :
    
    vertices
    :
    
    item_1
    :
    
    lat
    :
    -23.0
    
    lng
    :
    130.0
    
    item_2
    :
    
    lat
    :
    -24.0
    
    lng
    :
    130.0
    
    item_3
    :
    
    lat
    :
    -24.0
    
    lng
    :
    132.0
    
    item_4
    :
    
    lat
    :
    -23.0
    
    lng
    :
    132.0
- mock_uss_instance_dp_v22a (resources.interuss.mock_uss.client.MockUSSResource)
  :
  - Specification
    :
    
    participant_id
    :
    mock_uss
    
    mock_uss_base_url
    :
    http://v22a.riddp.uss1.localutm
    
    timeout_seconds
    :
    None
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- mock_uss_instance_sp_v22a (resources.interuss.mock_uss.client.MockUSSResource)
  :
  - Specification
    :
    
    participant_id
    :
    mock_uss
    
    mock_uss_base_url
    :
    http://v22a.ridsp.uss1.localutm
    
    timeout_seconds
    :
    None
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- test_exclusions (resources.dev.TestExclusionsResource)
  :
  - Specification
    :
    
    allow_private_addresses
    :
    True
    
    allow_cleartext_queries
    :
    True
- uss_identification (resources.interuss.uss_identification.USSIdentificationResource)
  :
  - Specification
    :
    
    uss_identifiers
    :
    
    uss1
    :
    
    astm_url_regexes
    :
    
    item_1
    :
    http://[^/]*uss1\.localutm.*
    
    uss2
    :
    
    astm_url_regexes
    :
    
    item_1
    :
    http://[^/]*uss2\.localutm.*
    
    uss3
    :
    
    astm_url_regexes
    :
    
    item_1
    :
    http://[^/]*uss3\.localutm.*
Environment
:
- utm_auth (resources.communications.AuthAdapterResource)
  :
  - Specification
    :
    
    environment_variable_containing_auth_spec
    :
    AUTH_SPEC
    
    scopes_authorized
    :
    
    item_1
    :
    rid.inject_test_data
    
    item_2
    :
    dss.read.identification_service_areas
    
    item_3
    :
    rid.service_provider
    
    item_4
    :
    rid.display_provider
    
    item_5
    :
    dss.write.identification_service_areas
    
    item_6
    :
    dss.read.identification_service_areas
    
    item_7
    :
    interuss.flight_planning.direct_automated_test
    
    item_8
    :
    interuss.flight_planning.plan
    
    item_9
    :
    utm.inject_test_data
    
    item_10
    :
    utm.strategic_coordination
    
    item_11
    :
    utm.conformance_monitoring_sa
    
    item_12
    :
    utm.availability_arbitration
    
    item_13
    :
    utm.constraint_management
    
    item_14
    :
    interuss.versioning.read_system_versions
    
    item_15
    :
    interuss.geospatial_map.query
    
    item_16
    :
- netrid_service_providers_v22a (resources.netrid.NetRIDServiceProviders)
  :
  - Specification
    :
    
    service_providers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    injection_base_url
    :
    http://v22a.ridsp.uss1.localutm/ridsp/injection
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- netrid_observers_v22a (resources.netrid.NetRIDObserversResource)
  :
  - Specification
    :
    
    observers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    observation_base_url
    :
    http://v22a.riddp.uss1.localutm/riddp/observation
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource
- netrid_dss_instances_v22a (resources.astm.f3411.DSSInstancesResource)
  :
  - Specification
    :
    
    dss_instances
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss1.localutm/rid/v2
    
    item_2
    :
    
    participant_id
    :
    uss2
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss2.localutm/rid/v2
  - Dependencies
    :
    
    auth_adapter
    :
    From utm_auth resource

Full configuration

v1
:
- test_run
  :
  - resources
    :
    
    resource_declarations
    :
    
    kentland_flights_data
    :
    
    resource_type
    :
    resources.netrid.FlightDataResource
    
    specification
    :
    
    kml_source
    :
    
    kml_file
    :
    
    path
    :
    file://./test_data/usa/kentland/rid.kml
    
    hash_sha512
    :
    57c6d08055d40196fc7ae28f9e386032a243377d2a3cc8d302529e8e284ef4423f6b2f7a98c3c52eb86a64cc3d7da472f349e27b491a3d2ef191e20ba61c6d45
    
    random_seed
    :
    12345
    
    reference_time
    :
    2022-01-01T00:00:00Z
    
    flight_start_delay
    :
    5s
    
    dependencies
    :
    
    netrid_observation_evaluation_configuration
    :
    
    resource_type
    :
    resources.netrid.EvaluationConfigurationResource
    
    specification
    :
    
    min_query_diagonal
    :
    100
    
    max_propagation_latency
    :
    10s
    
    repeat_query_rect_period
    :
    3
    
    min_polling_interval
    :
    5s
    
    dependencies
    :
    
    utm_client_identity
    :
    
    resource_type
    :
    resources.communications.ClientIdentityResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    whoami_audience
    :
    localhost
    
    whoami_scope
    :
    rid.display_provider
    
    id_generator
    :
    
    resource_type
    :
    resources.interuss.IDGeneratorResource
    
    dependencies
    :
    
    client_identity
    :
    utm_client_identity
    
    specification
    :
    
    kentland_service_area
    :
    
    resource_type
    :
    resources.netrid.ServiceAreaResource
    
    specification
    :
    
    base_url
    :
    https://testdummy.interuss.org/interuss/monitoring/uss_qualifier/configurations/dev/library/resources/kentland_service_area
    
    footprint
    :
    
    item_1
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.614
    
    item_2
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.614
    
    item_3
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.544
    
    item_4
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.544
    
    altitude_min
    :
    0.0
    
    altitude_max
    :
    3048.0
    
    reference_time
    :
    2023-01-10T00:00:00.123456+00:00
    
    time_start
    :
    2023-01-10T00:00:01.123456+00:00
    
    time_end
    :
    2023-01-10T01:00:01.123456+00:00
    
    dependencies
    :
    
    kentland_planning_area
    :
    
    resource_type
    :
    resources.PlanningAreaResource
    
    specification
    :
    
    base_url
    :
    https://testdummy.interuss.org/interuss/monitoring/uss_qualifier/configurations/dev/library/resources/kentland_planning_area
    
    volume
    :
    
    outline_polygon
    :
    
    vertices
    :
    
    item_1
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.614
    
    item_2
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.614
    
    item_3
    :
    
    lat
    :
    37.2148
    
    lng
    :
    -80.544
    
    item_4
    :
    
    lat
    :
    37.1853
    
    lng
    :
    -80.544
    
    altitude_lower
    :
    
    value
    :
    0.0
    
    reference
    :
    W84
    
    units
    :
    M
    
    altitude_upper
    :
    
    value
    :
    3048.0
    
    reference
    :
    W84
    
    units
    :
    M
    
    outline_circle
    :
    None
    
    dependencies
    :
    
    au_problematically_big_area
    :
    
    resource_type
    :
    resources.VerticesResource
    
    specification
    :
    
    vertices
    :
    
    item_1
    :
    
    lat
    :
    -23.0
    
    lng
    :
    130.0
    
    item_2
    :
    
    lat
    :
    -24.0
    
    lng
    :
    130.0
    
    item_3
    :
    
    lat
    :
    -24.0
    
    lng
    :
    132.0
    
    item_4
    :
    
    lat
    :
    -23.0
    
    lng
    :
    132.0
    
    dependencies
    :
    
    utm_auth
    :
    
    resource_type
    :
    resources.communications.AuthAdapterResource
    
    specification
    :
    
    environment_variable_containing_auth_spec
    :
    AUTH_SPEC
    
    scopes_authorized
    :
    
    item_1
    :
    rid.inject_test_data
    
    item_2
    :
    dss.read.identification_service_areas
    
    item_3
    :
    rid.service_provider
    
    item_4
    :
    rid.display_provider
    
    item_5
    :
    dss.write.identification_service_areas
    
    item_6
    :
    dss.read.identification_service_areas
    
    item_7
    :
    interuss.flight_planning.direct_automated_test
    
    item_8
    :
    interuss.flight_planning.plan
    
    item_9
    :
    utm.inject_test_data
    
    item_10
    :
    utm.strategic_coordination
    
    item_11
    :
    utm.conformance_monitoring_sa
    
    item_12
    :
    utm.availability_arbitration
    
    item_13
    :
    utm.constraint_management
    
    item_14
    :
    interuss.versioning.read_system_versions
    
    item_15
    :
    interuss.geospatial_map.query
    
    item_16
    :
    
    dependencies
    :
    
    netrid_service_providers_v22a
    :
    
    resource_type
    :
    resources.netrid.NetRIDServiceProviders
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    service_providers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    injection_base_url
    :
    http://v22a.ridsp.uss1.localutm/ridsp/injection
    
    netrid_observers_v22a
    :
    
    resource_type
    :
    resources.netrid.NetRIDObserversResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    observers
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    observation_base_url
    :
    http://v22a.riddp.uss1.localutm/riddp/observation
    
    netrid_dss_instances_v22a
    :
    
    resource_type
    :
    resources.astm.f3411.DSSInstancesResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    dss_instances
    :
    
    item_1
    :
    
    participant_id
    :
    uss1
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss1.localutm/rid/v2
    
    item_2
    :
    
    participant_id
    :
    uss2
    
    rid_version
    :
    F3411-22a
    
    base_url
    :
    http://dss.uss2.localutm/rid/v2
    
    mock_uss_instance_dp_v22a
    :
    
    resource_type
    :
    resources.interuss.mock_uss.client.MockUSSResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    participant_id
    :
    mock_uss
    
    mock_uss_base_url
    :
    http://v22a.riddp.uss1.localutm
    
    timeout_seconds
    :
    None
    
    mock_uss_instance_sp_v22a
    :
    
    resource_type
    :
    resources.interuss.mock_uss.client.MockUSSResource
    
    dependencies
    :
    
    auth_adapter
    :
    utm_auth
    
    specification
    :
    
    participant_id
    :
    mock_uss
    
    mock_uss_base_url
    :
    http://v22a.ridsp.uss1.localutm
    
    timeout_seconds
    :
    None
    
    test_exclusions
    :
    
    resource_type
    :
    resources.dev.TestExclusionsResource
    
    specification
    :
    
    allow_private_addresses
    :
    True
    
    allow_cleartext_queries
    :
    True
    
    dependencies
    :
    
    uss_identification
    :
    
    resource_type
    :
    resources.interuss.uss_identification.USSIdentificationResource
    
    specification
    :
    
    uss_identifiers
    :
    
    uss1
    :
    
    astm_url_regexes
    :
    
    item_1
    :
    http://[^/]*uss1\.localutm.*
    
    uss2
    :
    
    astm_url_regexes
    :
    
    item_1
    :
    http://[^/]*uss2\.localutm.*
    
    uss3
    :
    
    astm_url_regexes
    :
    
    item_1
    :
    http://[^/]*uss3\.localutm.*
    
    dependencies
    :
  - non_baseline_inputs
    :
    
    item_1
    :
    v1.test_run.resources.resource_declarations.utm_auth
    
    item_2
    :
    v1.test_run.resources.resource_declarations.netrid_service_providers_v22a
    
    item_3
    :
    v1.test_run.resources.resource_declarations.netrid_observers_v22a
    
    item_4
    :
    v1.test_run.resources.resource_declarations.netrid_dss_instances_v22a
  - action
    :
    
    test_suite
    :
    
    suite_type
    :
    suites.astm.netrid.f3411_22a
    
    resources
    :
    
    flights_data
    :
    kentland_flights_data
    
    service_providers
    :
    netrid_service_providers_v22a
    
    observers
    :
    netrid_observers_v22a
    
    mock_uss_dp
    :
    mock_uss_instance_dp_v22a
    
    mock_uss_sp
    :
    mock_uss_instance_sp_v22a
    
    evaluation_configuration
    :
    netrid_observation_evaluation_configuration
    
    dss_instances
    :
    netrid_dss_instances_v22a
    
    utm_client_identity
    :
    utm_client_identity
    
    id_generator
    :
    id_generator
    
    service_area
    :
    kentland_service_area
    
    problematically_big_area
    :
    au_problematically_big_area
    
    planning_area
    :
    kentland_planning_area
    
    test_exclusions
    :
    test_exclusions
    
    uss_identification
    :
    uss_identification
    
    on_failure
    :
    ReactionToFailure.Continue
  - execution
    :
    
    stop_fast
    :
    True
    
    stop_when_resource_not_created
    :
    False
    
    include_action_when
    :
    None
    
    skip_action_when
    :
    None
- artifacts
  :
  - raw_report
    :
    
    redact_access_tokens
    :
    True
    
    indent
    :
    None
  - tested_requirements
    :
    
    item_1
    :
    
    report_name
    :
    requirements
    
    requirement_collections
    :
    
    sp_dp_dss
    :
    
    requirement_sets
    :
    
    item_1
    :
    astm.f3411.v22a.service_provider#Mandatory requirements
    
    item_2
    :
    astm.f3411.v22a.display_provider#Mandatory requirements
    
    item_3
    :
    astm.f3411.v22a.dss_provider
    
    sp_dss
    :
    
    requirement_sets
    :
    
    item_1
    :
    astm.f3411.v22a.service_provider#Mandatory requirements
    
    item_2
    :
    astm.f3411.v22a.dss_provider
    
    participant_requirements
    :
    
    uss1
    :
    sp_dp_dss
    
    uss2
    :
    sp_dss
  - sequence_view
    :
    
    render_kml
    :
    True
    
    redact_access_tokens
    :
    True
  - globally_expanded_report
    :
    None
  - templated_reports
    :
    None
  - report_html
    :
    None
- validation
  :
  - criteria
    :
    
    item_1
    :
    
    applicability
    :
    
    test_scenarios
    :
    
    pass_condition
    :
    
    each_element
    :
    
    has_execution_error
    :
    False
    
    item_2
    :
    
    applicability
    :
    
    failed_checks
    :
    
    has_severity
    :
    
    higher_than
    :
    Severity.Low
    
    pass_condition
    :
    
    elements
    :
    
    count
    :
    
    equal_to
    :
    0.0
    
    item_3
    :
    
    applicability
    :
    
    skipped_actions
    :
    
    pass_condition
    :
    
    elements
    :
    
    count
    :
    
    equal_to
    :
    2.0

Scenarios executed

Suite / action generator			Scenario	mock_uss	uss1	uss2	<None>	Time
ASTM F3411-22a	→		1) ASTM NetRID Service Provider operator notification under slow update rate		✅		✅	0:00
			2) ASTM NetRID Display Provider behavior	✅	✅			0:00
			3) ASTM NetRID networked UAS disconnection		✅		✅	1:25
			4) ASTM NetRID Service Provider operator notification on missing fields		✅		✅	0:06
	For each F3411 DSS instance	DSS testing for ASTM NetRID F3411-22a	5) ASTM NetRID DSS: Endpoint encryption					0:00
			6) ASTM NetRID DSS: Simple ISA		✅			0:00
			7) ASTM NetRID DSS: Submitted ISA Validations		✅		🌐	0:00
			8) ASTM NetRID DSS: ISA Expiry		✅			0:05
			9) ASTM NetRID DSS: ISA Subscription Interactions		✅			0:00
			10) ASTM NetRID DSS: Subscription Validation		✅			0:00
			11) ASTM NetRID DSS: Subscription Simple		✅			0:00
			12) ASTM F3411-22a NetRID DSS interoperability		✅	✅		0:10
			13) ASTM NetRID DSS: Token Validation		✅			0:00
			Skipped: ASTM NetRID DSS: Direct datastore access Test suite action to run ActionType.TestScenario scenarios.astm.netrid.v22a.dss.DatastoreAccess could not find required resource ID "dss_datastore_cluster" used to populate child resource ID "datastore_cluster"
			14) ASTM NetRID DSS: Concurrent Requests		✅			0:19
		DSS testing for ASTM NetRID F3411-22a	15) ASTM NetRID DSS: Endpoint encryption					0:00
			16) ASTM NetRID DSS: Simple ISA			✅		0:00
			17) ASTM NetRID DSS: Submitted ISA Validations			✅	🌐	0:00
			18) ASTM NetRID DSS: ISA Expiry			✅		0:05
			19) ASTM NetRID DSS: ISA Subscription Interactions			✅		0:00
			20) ASTM NetRID DSS: Subscription Validation			✅		0:00
			21) ASTM NetRID DSS: Subscription Simple			✅		0:00
			22) ASTM F3411-22a NetRID DSS interoperability		✅	✅		0:10
			23) ASTM NetRID DSS: Token Validation			✅		0:00
			Skipped: ASTM NetRID DSS: Direct datastore access Test suite action to run ActionType.TestScenario scenarios.astm.netrid.v22a.dss.DatastoreAccess could not find required resource ID "dss_datastore_cluster" used to populate child resource ID "datastore_cluster"
			24) ASTM NetRID DSS: Concurrent Requests			✅		0:19
	→		25) ASTM NetRID Service Provider notification behavior	✅	✅		✅	0:00
			26) ASTM NetRID nominal behavior		✅		✅	1:40
			27) ASTM NetRID SP clients misbehavior handling		✅		✅	0:11
			28) ASTM NetRID: Operator interactions					0:00
			29) ASTM F3411-22a NetRID aggregate checks		✅			0:00

Sequence view of uss_qualifier test run

Test run

Resources configuration

Full configuration

Scenarios executed