uss2 tested requirements

Test run

Test characteristic Value
Participant uss2
Other participants uss1, mock_uss
Test run identifier TR-28cc17a
Start time 2024-12-19 16:17:39 UTC
End time 2024-12-19 16:20:23 UTC
Test baseline identifier TB-a563b09
Environment identifier TE-b8a3fae
Requirement verification status Not fully verified
Artifact generated by interuss/monitoring/v0.0.0-9848684 with test run artifact configuration

Tested requirements

Requirements: all_astm_dss_requirements
Package Requirement Result Scenario Case Step Check
astm
.f3411
.v19		 DSS0010 Pass ASTM NetRID DSS: Token Validation Token validation Token validation Missing token prevents creating an ISA
Pass Missing token prevents reading an ISA
Pass Missing token prevents mutating an ISA
Pass Missing token cannot search for ISAs
Pass Missing token prevents ISA deletion
DSS0020 Not tested ASTM NetRID DSS: Endpoint encryption Validate endpoint encryption Attempt GET on a known valid path via HTTP HTTP GET fails or redirects to HTTPS
Not tested Attempt GET on a known valid path via HTTPS HTTPS GET succeeds
DSS0030,a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S5 ISA response code (2x)
Pass ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA start time matches (2x)
Pass ISA end time matches (2x)
Pass ISA URL matches (2x)
Not tested ISA version changed
Pass S1 ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Not tested ISA version changed
Pass S10 ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Not tested ISA version changed
Pass S12 ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Not tested ISA version changed
Not tested S11 ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested S15 ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Pass ASTM NetRID DSS: Concurrent Requests Concurrent Requests Create ISA concurrently ISA response format (100x)
Pass ISA ID matches (100x)
Pass ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Pass Concurrent ISAs creation
Not tested ISA response code
Not tested ISA version changed
Pass Get ISAs concurrently ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Pass Search Available ISAs ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Pass Delete ISAs concurrently ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Not tested Search Deleted ISAs ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Pass ASTM NetRID DSS: ISA Expiry ISA Expiry ISA Expiry Create short-lived ISA
Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Create an ISA
Pass Mutate the ISA
Pass Response to the mutation of the ISA contains subscription ID
Pass Subscription to an ISA has its notification index incremented after mutation
Pass Subscription to an ISA has its notification index incremented after deletion
Pass New subscription within ISA is mutated to ISA boundary Create an ISA
Pass Mutate the ISA
Pass Response to the mutation of the ISA contains subscription ID
Pass Subscription to an ISA has its notification index incremented after mutation
Pass Subscription to an ISA has its notification index incremented after deletion
Pass ASTM NetRID DSS: Simple ISA Create and check ISA Create ISA ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Pass ISA created
Not tested ISA version changed
Pass Update and search ISA Update ISA ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Pass ISA updated
Not tested ISA version changed
Not tested Search by earliest time (included) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by earliest time (excluded) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by latest time (included) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by latest time (excluded) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by area only ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Delete ISA Delete ISA ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search ISA ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Pass ASTM NetRID DSS: Submitted ISA Validations ISA Validation ISA Validation ISA huge area
Pass ISA empty vertices
Pass ISA start time in the past
Pass ISA start time after end time
Pass ISA vertices are valid
Pass ISA missing outline
Pass ISA missing volume
Not tested ISA missing extents
Pass ASTM NetRID DSS: Token Validation Token validation Token validation Read scope cannot create an ISA
Pass Fake token prevents creating an ISA
Pass ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Pass Correct token and scope can create ISA
Pass Read scope cannot mutate an ISA
Pass Fake token cannot mutate an ISA
Not tested ISA version changed
DSS0030,b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S11 ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA version matches (2x)
Pass S15 ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA version matches (2x)
Pass ASTM NetRID DSS: Concurrent Requests Concurrent Requests Delete ISAs concurrently ISA response format (100x)
Pass ISA ID matches (100x)
Pass ISA version matches (100x)
Pass ISAs deletion query success
Pass ASTM NetRID DSS: ISA Expiry Cleanup Cleanup Removed pre-existing ISA
Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Response to the deletion of the ISA contains subscription ID
Pass New subscription within ISA is mutated to ISA boundary Response to the deletion of the ISA contains subscription ID
Pass ASTM NetRID DSS: Simple ISA Delete ISA Delete with wrong version Delete request rejected
Pass Delete with empty version Delete request rejected
Pass Delete ISA ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA version matches (2x)
Pass ISA deleted
Pass ASTM NetRID DSS: Token Validation Token validation Token validation Read scope cannot delete an ISA
Pass Fake token cannot delete an ISA
Pass Correct token and scope can delete ISA
DSS0030,c Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Create a subscription within the ISA footprint
Pass Subscription for the ISA's area mentions the ISA
Pass Newly created subscription has a notification_index of 0
Pass New subscription within ISA is mutated to ISA boundary Create a subscription within the ISA footprint
Pass Mutate the subscription towards the ISA boundary
Pass Subscription for the ISA's area mentions the ISA
Pass Mutated subscription has a notification_index of 0
Not tested Subscription that only barely overlaps the ISA contains the ISA
Pass ASTM NetRID DSS: Subscription Simple Subscription Simple Create subscription validation Create subscription (4x)
Pass Response to subscription creation contains a subscription (4x)
Pass Returned subscription has an ID (4x)
Pass Returned subscription ID is correct (4x)
Pass Returned subscription has an owner (4x)
Pass Returned subscription owner is correct (4x)
Pass Returned subscription has an ISA URL (4x)
Pass Returned ISA URL has correct base URL (4x)
Pass Returned subscription has a start time (4x)
Pass Returned subscription has a version (4x)
Pass Generated subscription version has proper format (4x)
Pass Returned notification index is 0 if present (4x)
Pass Returned end time is correct (2x)
Pass Returned start time is correct (2x)
Pass Mutate Subscription Subscription can be mutated (8x)
Pass Response to subscription mutation contains a subscription (8x)
Pass Returned subscription has an ID (8x)
Pass Returned subscription ID is correct (8x)
Pass Returned subscription has an owner (8x)
Pass Returned subscription owner is correct (8x)
Pass Returned subscription has an ISA URL (8x)
Pass Returned ISA URL has correct base URL (8x)
Pass Returned subscription has a start time (8x)
Pass Returned start time is correct (8x)
Pass Returned end time is correct (8x)
Pass Returned subscription has a version (8x)
Pass Generated subscription version has proper format (8x)
Pass Mutated subscription version is updated (8x)
Pass Query Existing Subscription Returned subscription has an ID (8x)
Pass Returned subscription ID is correct (8x)
Pass Returned subscription has an owner (8x)
Pass Returned subscription owner is correct (8x)
Pass Returned subscription has an ISA URL (8x)
Pass Returned ISA URL has correct base URL (8x)
Pass Returned subscription has a start time (8x)
Pass Returned start time is correct (8x)
Pass Returned end time is correct (8x)
Pass Returned subscription has a version (8x)
Pass Generated subscription version has proper format (8x)
Pass Non-mutated subscription keeps the same version (8x)
Pass Delete Subscription Returned subscription has an ID (4x)
Pass Returned subscription ID is correct (4x)
Pass Returned subscription has an owner (4x)
Pass Returned subscription owner is correct (4x)
Pass Returned subscription has an ISA URL (4x)
Pass Returned ISA URL has correct base URL (4x)
Pass Returned subscription has a start time (4x)
Pass Returned start time is correct (4x)
Pass Returned end time is correct (4x)
Pass Returned subscription has a version (4x)
Pass Generated subscription version has proper format (4x)
Pass Non-mutated subscription keeps the same version (4x)
Pass ASTM NetRID DSS: Subscription Validation Subscription duration limitations Try to extend subscription Valid subscription created
Pass Subscription quantity limitations Create maximum number of subscriptions Create up to the maximum allowed number of subscriptions in an area
DSS0030,d Not tested ASTM NetRID DSS: Concurrent Requests Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: ISA Expiry Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Delete the ISA
Pass Subscription can be deleted
Pass New subscription within ISA is mutated to ISA boundary Delete the ISA
Pass Subscription can be deleted
Not tested Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: Simple ISA Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: Submitted ISA Validations Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Pass ASTM NetRID DSS: Subscription Simple Subscription Simple Delete Subscription Missing version prevents deletion (4x)
Pass Incorrect version prevents deletion (4x)
Pass Subscription can be deleted (4x)
Not tested Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Pass ASTM NetRID DSS: Subscription Validation Subscription duration limitations Remove subscription Subscription deleted
Pass Subscription quantity limitations Clean up subscriptions Subscription can be deleted (10x)
Not tested Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: Token Validation Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
DSS0030,e Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[n] search returned with proper response
Not tested ASTM NetRID DSS: Concurrent Requests Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: ISA Expiry Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: ISA Subscription Interactions Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: Simple ISA Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: Submitted ISA Validations Setup Ensure clean workspace Subscription can be queried by ID
Pass ASTM NetRID DSS: Subscription Simple Setup Ensure clean workspace Subscription can be queried by ID (4x)
Pass Subscription Simple Query Existing Subscription Get Subscription by ID (4x)
Pass Returned notification index is equal to or greater than 0 (8x)
Pass Delete Subscription Returned notification index is equal to or greater than 0 (4x)
Pass Query Deleted Subscription Query by subscription ID should fail (4x)
Not tested Mutate Subscription Returned notification index is equal to or greater than 0
Pass Cleanup Cleanup Subscription can be queried by ID (4x)
Not tested ASTM NetRID DSS: Subscription Validation Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: Token Validation Setup Ensure clean workspace Subscription can be queried by ID
DSS0030,f Not tested ASTM NetRID DSS: Concurrent Requests Setup Ensure clean workspace Successful subscription search query
Not tested ASTM NetRID DSS: ISA Expiry Setup Ensure clean workspace Successful subscription search query
Pass ASTM NetRID DSS: ISA Subscription Interactions Setup Ensure clean workspace Successful subscription search query (2x)
Pass Cleanup Cleanup Successful subscription search query (2x)
Not tested ASTM NetRID DSS: Simple ISA Setup Ensure clean workspace Successful subscription search query
Not tested ASTM NetRID DSS: Submitted ISA Validations Setup Ensure clean workspace Successful subscription search query
Pass ASTM NetRID DSS: Subscription Simple Setup Ensure clean workspace Successful subscription search query
Pass Subscription Simple Query Existing Subscription Search for all subscriptions in ISA area
Pass Created Subscription is in search results (4x)
Pass No huge search area allowed
Pass Query Deleted Subscription Search for all subscriptions in ISA area
Pass Deleted subscription should not be present in search results
Pass Search area that represents a loop is not allowed
Pass ASTM NetRID DSS: Subscription Validation Setup Ensure clean workspace Successful subscription search query
Pass Subscription quantity limitations Clean up subscriptions Successful subscription search query
Pass Cleanup Cleanup Successful subscription search query
Not tested ASTM NetRID DSS: Token Validation Setup Ensure clean workspace Successful subscription search query
DSS0040 Not tested Not implemented
DSS0050 Pass ASTM NetRID DSS: Subscription Validation Subscription quantity limitations Exceed maximum number of subscriptions Enforce maximum number of subscriptions for an area
DSS0060 Pass ASTM NetRID DSS: Subscription Simple Subscription Simple Create subscription validation Returned subscription has an end time (4x)
Pass Mutate Subscription Returned subscription has an end time (8x)
Pass Query Existing Subscription Returned subscription has an end time (8x)
Pass Delete Subscription Returned subscription has an end time (4x)
Pass ASTM NetRID DSS: Subscription Validation Subscription duration limitations Try to create too-long subscription Too-long subscription creation rejected
Pass Try to extend subscription Subscription duration limited during update
DSS0070 Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] returned with proper response (2x)
Pass S4 Can query all Subscriptions in area from all DSSs (2x)
Pass S7 404 with proper response (2x)
Pass S8 No Subscription[i] 1≤i≤n returned with proper response (2x)
Pass S9 service_areas does not include ISA from S1 (2x)
Pass S13 No Subscription[i] 1≤i≤n returned with proper response (2x)
Pass S16 service_areas does not include ISA from S12 (2x)
DSS0110 Not tested ASTM NetRID DSS: Direct CRDB access Verify security interoperability Attempt to connect in insecure mode Node runs in secure mode
DSS0120 Not tested ASTM NetRID DSS: Direct CRDB access Verify security interoperability Attempt to connect in insecure mode Node runs in secure mode
Not tested Attempt to connect with legacy encryption protocol Node rejects legacy encryption protocols
DSS0130,1 Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] cell ID is properly synchronized with all DSS
DSS0130,2,a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] ID is properly synchronized with all DSS
DSS0130,2,b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] owner is properly synchronized with all DSS
DSS0130,2,c Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] URL is properly synchronized with all DSS
DSS0130,2,d Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] start/end times are properly synchronized with all DSS
DSS0130,2,e Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S5 ISA modification on secondary DSS triggers subscription notification requests (2x)
DSS0130,2,f Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] notification count is properly synchronized with all DSS
DSS0130,3,a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 ID of ISA from S1 is properly synchronized with all DSS
Pass S5 Can get ISA from primary DSS
DSS0130,3,b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 Owner of ISA from S1 is properly synchronized with all DSS
DSS0130,3,c Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 URL of ISA from S1 is properly synchronized with all DSS
DSS0130,3,d Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 Start/end times of ISA from S1 are properly synchronized with all DSS
DSS0130,3,e Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 service_areas includes ISA from S1 (2x)
DSS0130,A2-6-1,1a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S1 ISA[P] created with proper response
Pass S10 ISA[P] created with proper response
Pass S12 ISA[P] created with proper response
DSS0130,A2-6-1,1b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S5 Can modify ISA on secondary DSS
Pass Can modify ISA in primary DSS
DSS0130,A2-6-1,1c Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 service_areas includes ISA from S1 (2x)
Pass S9 Subscription[n] created with proper response (2x)
DSS0130,A2-6-1,1d Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S9 service_areas does not include ISA from S1 (2x)
DSS0130,A2-6-1,2a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S11 ISA[P] deleted with proper response
Pass S15 ISA[P] deleted with proper response
Pass Cleanup Cleanup ISA deleted with proper response (3x)
DSS0130,A2-6-1,2b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S16 service_areas does not include ISA from S12 (2x)
DSS0130,A2-6-1,3a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S2 Subscription[n] created with proper response (2x)
Pass S16 Subscription[n] created with proper response (2x)
DSS0130,A2-6-1,3b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S10 All Subscription[i] 1≤i≤n returned in subscribers
DSS0130,A2-6-1,3c Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S5 ISA modification on secondary DSS triggers subscription notification requests (2x)
Pass ISA modification on primary DSS triggers subscription notification requests
Pass S11 All Subscription[i] 1≤i≤n returned in subscribers
DSS0130,A2-6-1,3d Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S13 No Subscription[i] 1≤i≤n returned with proper response (2x)
Pass S12 None of Subscription[i] 1≤i≤n returned in subscribers
Pass S15 None of Subscription[i] 1≤i≤n returned in subscribers with proper response
Not tested S14 404 with proper response
DSS0130,A2-6-1,4a Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S6 Subscription[n] deleted with proper response (2x)
Pass S17 Subscription[n] deleted with proper response (2x)
Pass Cleanup Cleanup Subscription can be queried by ID (6x)
Pass Subscription can be deleted (2x)
DSS0130,A2-6-1,4b Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S7 404 with proper response (2x)
Pass S8 No Subscription[i] 1≤i≤n returned with proper response (2x)
DSS0130,A2-6-1,5 Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[P] returned with proper response (2x)
DSS0130,A2-6-1,6 Pass ASTM F3411-19 NetRID DSS interoperability Interoperability sequence S3 Subscription[n] search returned with proper response
Pass S4 Can query all Subscriptions in area from all DSSs (2x)
Pass S8 Subscriptions queried successfully (2x)
Pass S13 Subscriptions queried successfully (2x)
DSS0210 Pass ASTM F3411-19 NetRID DSS interoperability Prerequisites Test environment requirements DSS instance is reachable (2x)
Not tested DSS instance is publicly addressable
astm
.f3411
.v22a		 DSS0010 Pass ASTM NetRID DSS: Token Validation Token validation Token validation Missing token prevents creating an ISA
Pass Missing token prevents reading an ISA
Pass Missing token prevents mutating an ISA
Pass Missing token cannot search for ISAs
Pass Missing token prevents ISA deletion
DSS0020 Not tested ASTM NetRID DSS: Endpoint encryption Validate endpoint encryption Attempt GET on a known valid path via HTTP HTTP GET fails or redirects to HTTPS
Not tested Attempt GET on a known valid path via HTTPS HTTPS GET succeeds
DSS0030,a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S5 ISA response code (2x)
Pass ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA start time matches (2x)
Pass ISA end time matches (2x)
Pass ISA URL matches (2x)
Not tested ISA version changed
Pass S1 ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Not tested ISA version changed
Pass S10 ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Not tested ISA version changed
Pass S12 ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Not tested ISA version changed
Not tested S11 ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested S15 ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Pass ASTM NetRID DSS: Concurrent Requests Concurrent Requests Create ISA concurrently ISA response format (100x)
Pass ISA ID matches (100x)
Pass ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Pass Concurrent ISAs creation
Not tested ISA response code
Not tested ISA version changed
Pass Get ISAs concurrently ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Pass Search Available ISAs ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Pass Delete ISAs concurrently ISA start time matches (100x)
Pass ISA end time matches (100x)
Pass ISA URL matches (100x)
Not tested Search Deleted ISAs ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Pass ASTM NetRID DSS: ISA Expiry ISA Expiry ISA Expiry Create short-lived ISA
Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Create an ISA
Pass Mutate the ISA
Pass Response to the mutation of the ISA contains subscription ID
Pass Subscription to an ISA has its notification index incremented after mutation
Pass Subscription to an ISA has its notification index incremented after deletion
Pass New subscription within ISA is mutated to ISA boundary Create an ISA
Pass Mutate the ISA
Pass Response to the mutation of the ISA contains subscription ID
Pass Subscription to an ISA has its notification index incremented after mutation
Pass Subscription to an ISA has its notification index incremented after deletion
Pass ASTM NetRID DSS: Simple ISA Create and check ISA Create ISA ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Pass ISA created
Not tested ISA version changed
Pass Update and search ISA Update ISA ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Pass ISA updated
Not tested ISA version changed
Not tested Search by earliest time (included) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by earliest time (excluded) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by latest time (included) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by latest time (excluded) ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search by area only ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Delete ISA Delete ISA ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Not tested Search ISA ISA start time matches
Not tested ISA end time matches
Not tested ISA URL matches
Pass ASTM NetRID DSS: Submitted ISA Validations ISA Validation ISA Validation ISA huge area
Pass ISA empty vertices
Pass ISA start time in the past
Pass ISA start time after end time
Pass ISA vertices are valid
Pass ISA missing outline
Pass ISA missing volume
Not tested ISA missing extents
Pass ASTM NetRID DSS: Token Validation Token validation Token validation Read scope cannot create an ISA
Pass Fake token prevents creating an ISA
Pass ISA response code
Pass ISA response format
Pass ISA ID matches
Pass ISA start time matches
Pass ISA end time matches
Pass ISA URL matches
Pass Correct token and scope can create ISA
Pass Read scope cannot mutate an ISA
Pass Fake token cannot mutate an ISA
Not tested ISA version changed
DSS0030,b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S11 ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA version matches (2x)
Pass S15 ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA version matches (2x)
Pass ASTM NetRID DSS: Concurrent Requests Concurrent Requests Delete ISAs concurrently ISA response format (100x)
Pass ISA ID matches (100x)
Pass ISA version matches (100x)
Pass ISAs deletion query success
Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Response to the deletion of the ISA contains subscription ID
Pass New subscription within ISA is mutated to ISA boundary Response to the deletion of the ISA contains subscription ID
Pass ASTM NetRID DSS: Simple ISA Delete ISA Delete with wrong version Delete request rejected
Pass Delete with empty version Delete request rejected
Pass Delete ISA ISA response format (2x)
Pass ISA ID matches (2x)
Pass ISA version matches (2x)
Pass ISA deleted
Pass ASTM NetRID DSS: Token Validation Token validation Token validation Read scope cannot delete an ISA
Pass Fake token cannot delete an ISA
Pass Correct token and scope can delete ISA
DSS0030,c Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Create a subscription within the ISA footprint
Pass Subscription for the ISA's area mentions the ISA
Pass Newly created subscription has a notification_index of 0
Pass New subscription within ISA is mutated to ISA boundary Create a subscription within the ISA footprint
Pass Mutate the subscription towards the ISA boundary
Pass Subscription for the ISA's area mentions the ISA
Pass Mutated subscription has a notification_index of 0
Not tested Subscription that only barely overlaps the ISA contains the ISA
Pass ASTM NetRID DSS: Subscription Simple Subscription Simple Create subscription validation Create subscription (4x)
Pass Response to subscription creation contains a subscription (4x)
Pass Returned subscription has an ID (4x)
Pass Returned subscription ID is correct (4x)
Pass Returned subscription has an owner (4x)
Pass Returned subscription owner is correct (4x)
Pass Returned subscription has an ISA URL (4x)
Pass Returned ISA URL has correct base URL (4x)
Pass Returned subscription has a start time (4x)
Pass Returned subscription has a version (4x)
Pass Generated subscription version has proper format (4x)
Pass Returned notification index is 0 if present (4x)
Pass Returned end time is correct (2x)
Pass Returned start time is correct (2x)
Pass Mutate Subscription Subscription can be mutated (8x)
Pass Response to subscription mutation contains a subscription (8x)
Pass Returned subscription has an ID (8x)
Pass Returned subscription ID is correct (8x)
Pass Returned subscription has an owner (8x)
Pass Returned subscription owner is correct (8x)
Pass Returned subscription has an ISA URL (8x)
Pass Returned ISA URL has correct base URL (8x)
Pass Returned subscription has a start time (8x)
Pass Returned start time is correct (8x)
Pass Returned end time is correct (8x)
Pass Returned subscription has a version (8x)
Pass Generated subscription version has proper format (8x)
Pass Mutated subscription version is updated (8x)
Pass Query Existing Subscription Returned subscription has an ID (8x)
Pass Returned subscription ID is correct (8x)
Pass Returned subscription has an owner (8x)
Pass Returned subscription owner is correct (8x)
Pass Returned subscription has an ISA URL (8x)
Pass Returned ISA URL has correct base URL (8x)
Pass Returned subscription has a start time (8x)
Pass Returned start time is correct (8x)
Pass Returned end time is correct (8x)
Pass Returned subscription has a version (8x)
Pass Generated subscription version has proper format (8x)
Pass Non-mutated subscription keeps the same version (8x)
Pass Delete Subscription Returned subscription has an ID (4x)
Pass Returned subscription ID is correct (4x)
Pass Returned subscription has an owner (4x)
Pass Returned subscription owner is correct (4x)
Pass Returned subscription has an ISA URL (4x)
Pass Returned ISA URL has correct base URL (4x)
Pass Returned subscription has a start time (4x)
Pass Returned start time is correct (4x)
Pass Returned end time is correct (4x)
Pass Returned subscription has a version (4x)
Pass Generated subscription version has proper format (4x)
Pass Non-mutated subscription keeps the same version (4x)
Pass ASTM NetRID DSS: Subscription Validation Subscription duration limitations Try to extend subscription Valid subscription created
Pass Subscription quantity limitations Create maximum number of subscriptions Create up to the maximum allowed number of subscriptions in an area
DSS0030,d Not tested ASTM NetRID DSS: Concurrent Requests Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: ISA Expiry Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Pass ASTM NetRID DSS: ISA Subscription Interactions ISA Subscription Interactions New Subscription within ISA Delete the ISA
Pass Subscription can be deleted
Pass New subscription within ISA is mutated to ISA boundary Delete the ISA
Pass Subscription can be deleted
Not tested Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: Simple ISA Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: Submitted ISA Validations Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Pass ASTM NetRID DSS: Subscription Simple Subscription Simple Delete Subscription Missing version prevents deletion (4x)
Pass Incorrect version prevents deletion (4x)
Pass Subscription can be deleted (4x)
Not tested Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Pass ASTM NetRID DSS: Subscription Validation Subscription duration limitations Remove subscription Subscription deleted
Pass Subscription quantity limitations Clean up subscriptions Subscription can be deleted (10x)
Not tested Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
Not tested ASTM NetRID DSS: Token Validation Setup Ensure clean workspace Removed pre-existing ISA
Not tested Subscription can be deleted
DSS0030,e Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[n] search returned with proper response
Not tested ASTM NetRID DSS: Concurrent Requests Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: ISA Expiry Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: ISA Subscription Interactions Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: Simple ISA Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: Submitted ISA Validations Setup Ensure clean workspace Subscription can be queried by ID
Pass ASTM NetRID DSS: Subscription Simple Setup Ensure clean workspace Subscription can be queried by ID (4x)
Pass Subscription Simple Query Existing Subscription Get Subscription by ID (4x)
Pass Returned notification index is equal to or greater than 0 (8x)
Pass Delete Subscription Returned notification index is equal to or greater than 0 (4x)
Pass Query Deleted Subscription Query by subscription ID should fail (4x)
Not tested Mutate Subscription Returned notification index is equal to or greater than 0
Pass Cleanup Cleanup Subscription can be queried by ID (4x)
Not tested ASTM NetRID DSS: Subscription Validation Setup Ensure clean workspace Subscription can be queried by ID
Not tested ASTM NetRID DSS: Token Validation Setup Ensure clean workspace Subscription can be queried by ID
DSS0030,f Not tested ASTM NetRID DSS: Concurrent Requests Setup Ensure clean workspace Successful subscription search query
Not tested ASTM NetRID DSS: ISA Expiry Setup Ensure clean workspace Successful subscription search query
Pass ASTM NetRID DSS: ISA Subscription Interactions Setup Ensure clean workspace Successful subscription search query (2x)
Pass Cleanup Cleanup Successful subscription search query (2x)
Not tested ASTM NetRID DSS: Simple ISA Setup Ensure clean workspace Successful subscription search query
Not tested ASTM NetRID DSS: Submitted ISA Validations Setup Ensure clean workspace Successful subscription search query
Pass ASTM NetRID DSS: Subscription Simple Setup Ensure clean workspace Successful subscription search query
Pass Subscription Simple Query Existing Subscription Search for all subscriptions in ISA area
Pass Created Subscription is in search results (4x)
Pass No huge search area allowed
Pass Query Deleted Subscription Search for all subscriptions in ISA area
Pass Deleted subscription should not be present in search results
Pass Search area that represents a loop is not allowed
Pass ASTM NetRID DSS: Subscription Validation Setup Ensure clean workspace Successful subscription search query
Pass Subscription quantity limitations Clean up subscriptions Successful subscription search query
Pass Cleanup Cleanup Successful subscription search query
Not tested ASTM NetRID DSS: Token Validation Setup Ensure clean workspace Successful subscription search query
DSS0040 Not tested Not implemented
DSS0050 Pass ASTM NetRID DSS: Subscription Validation Subscription quantity limitations Exceed maximum number of subscriptions Enforce maximum number of subscriptions for an area
DSS0060 Pass ASTM NetRID DSS: Subscription Simple Subscription Simple Create subscription validation Returned subscription has an end time (4x)
Pass Mutate Subscription Returned subscription has an end time (8x)
Pass Query Existing Subscription Returned subscription has an end time (8x)
Pass Delete Subscription Returned subscription has an end time (4x)
Pass ASTM NetRID DSS: Subscription Validation Subscription duration limitations Try to create too-long subscription Too-long subscription creation rejected
Pass Try to extend subscription Subscription duration limited during update
DSS0070 Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] returned with proper response (2x)
Pass S4 Can query all Subscriptions in area from all DSSs (2x)
Pass S7 404 with proper response (2x)
Pass S8 No Subscription[i] 1≤i≤n returned with proper response (2x)
Pass S9 service_areas does not include ISA from S1 (2x)
Pass S13 No Subscription[i] 1≤i≤n returned with proper response (2x)
Pass S16 service_areas does not include ISA from S12 (2x)
DSS0110 Not tested ASTM NetRID DSS: Direct CRDB access Verify security interoperability Attempt to connect in insecure mode Node runs in secure mode
DSS0120 Not tested ASTM NetRID DSS: Direct CRDB access Verify security interoperability Attempt to connect in insecure mode Node runs in secure mode
Not tested Attempt to connect with legacy encryption protocol Node rejects legacy encryption protocols
DSS0130,1 Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] cell ID is properly synchronized with all DSS
DSS0130,2,a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] ID is properly synchronized with all DSS
DSS0130,2,b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] owner is properly synchronized with all DSS
DSS0130,2,c Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] URL is properly synchronized with all DSS
DSS0130,2,d Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] start/end times are properly synchronized with all DSS
DSS0130,2,e Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S5 ISA modification on secondary DSS triggers subscription notification requests (2x)
DSS0130,2,f Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] notification count is properly synchronized with all DSS
DSS0130,3,a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 ID of ISA from S1 is properly synchronized with all DSS
Pass S5 Can get ISA from primary DSS
DSS0130,3,b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 Owner of ISA from S1 is properly synchronized with all DSS
DSS0130,3,c Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 URL of ISA from S1 is properly synchronized with all DSS
DSS0130,3,d Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 Start/end times of ISA from S1 are properly synchronized with all DSS
DSS0130,3,e Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 service_areas includes ISA from S1 (2x)
DSS0130,A2-6-1,1a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S1 ISA[P] created with proper response
Pass S10 ISA[P] created with proper response
Pass S12 ISA[P] created with proper response
DSS0130,A2-6-1,1b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S5 Can modify ISA on secondary DSS
Pass Can modify ISA in primary DSS
DSS0130,A2-6-1,1c Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 service_areas includes ISA from S1 (2x)
Pass S9 Subscription[n] created with proper response (2x)
DSS0130,A2-6-1,1d Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S9 service_areas does not include ISA from S1 (2x)
DSS0130,A2-6-1,2a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S11 ISA[P] deleted with proper response
Pass S15 ISA[P] deleted with proper response
Pass Cleanup Cleanup ISA deleted with proper response (3x)
DSS0130,A2-6-1,2b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S16 service_areas does not include ISA from S12 (2x)
DSS0130,A2-6-1,3a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S2 Subscription[n] created with proper response (2x)
Pass S16 Subscription[n] created with proper response (2x)
DSS0130,A2-6-1,3b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S10 All Subscription[i] 1≤i≤n returned in subscribers
DSS0130,A2-6-1,3c Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S5 ISA modification on secondary DSS triggers subscription notification requests (2x)
Pass ISA modification on primary DSS triggers subscription notification requests
Pass S11 All Subscription[i] 1≤i≤n returned in subscribers
DSS0130,A2-6-1,3d Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S13 No Subscription[i] 1≤i≤n returned with proper response (2x)
Pass S12 None of Subscription[i] 1≤i≤n returned in subscribers
Pass S15 None of Subscription[i] 1≤i≤n returned in subscribers with proper response
Not tested S14 404 with proper response
DSS0130,A2-6-1,4a Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S6 Subscription[n] deleted with proper response (2x)
Pass S17 Subscription[n] deleted with proper response (2x)
Pass Cleanup Cleanup Subscription can be queried by ID (6x)
Pass Subscription can be deleted (2x)
DSS0130,A2-6-1,4b Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S7 404 with proper response (2x)
Pass S8 No Subscription[i] 1≤i≤n returned with proper response (2x)
DSS0130,A2-6-1,5 Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[P] returned with proper response (2x)
DSS0130,A2-6-1,6 Pass ASTM F3411-22a NetRID DSS interoperability Interoperability sequence S3 Subscription[n] search returned with proper response
Pass S4 Can query all Subscriptions in area from all DSSs (2x)
Pass S8 Subscriptions queried successfully (2x)
Pass S13 Subscriptions queried successfully (2x)
DSS0210 Pass ASTM F3411-22a NetRID DSS interoperability Prerequisites Test environment requirements DSS instance is reachable (2x)
Not tested DSS instance is publicly addressable
astm
.f3548
.v21		 DSS0005,1 Pass ASTM F3548-21 UTM DSS Operational Intent Reference Access Control Setup Ensure clean workspace Operational intent references can be queried by ID (2x)
Not tested Operational intent reference removed
Pass Create operational intent references with different credentials Can create an operational intent with valid credentials (2x)
Pass Attempt unauthorized operational intent reference modification Attempt unauthorized operational intent reference modification Operational intent references can be queried directly by their ID
Pass Cleanup Cleanup Operational intent references can be queried by ID (2x)
Pass Operational intent reference removed
Pass ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions Setup Ensure clean workspace Operational intent references can be queried by ID
Not tested Operational intent reference removed
Pass Attempt unauthorized state creation Attempt direct creation with unauthorized state Direct Nonconforming state creation is forbidden
Pass Direct Contingent state creation is forbidden
Pass Attempt unauthorized state transitions Create an Accepted OIR Creation of an Accepted OIR is allowed
Pass Transition the OIR to Activated Transition from Accepted to Activated is allowed
Pass Transition the OIR to Ended Transition from Activated to Ended is allowed
Pass Attempt transition of an ended operational intent reference to an unauthorized state Transition from Ended to Nonconforming is forbidden
Pass Transition from Ended to Contingent is forbidden
Pass Cleanup Cleanup Operational intent references can be queried by ID
Pass Operational intent reference removed
Pass ASTM SCD DSS: Implicit Subscription handling Setup Ensure clean workspace Operational intent references can be queried by ID (3x)
Not tested Operational intent reference removed
Pass Single OIR implicit subscription is removed upon OIR deletion Create an OIR with implicit subscription Create operational intent reference query succeeds
Pass An implicit subscription was created and can be queried
Pass Implicit subscription has correct temporal parameters
Pass Delete the OIR with implicit subscription Delete operational intent reference query succeeds
Pass The implicit subscription was removed
Pass After removal of the only created OIR, subscriptions should be as before its creation
Not tested Delete operational intent reference response format conforms to spec
Not tested Delete operational intent reference response content is correct
Pass Implicit subscriptions always properly cover their OIR Create an OIR with implicit subscription Create operational intent reference query succeeds
Pass An implicit subscription was created and can be queried
Pass Implicit subscription has correct temporal parameters
Pass Create an overlapping OIR without any subscription Create operational intent reference query succeeds
Pass No implicit subscription was attached
Pass New OIR creation response contains previous implicit subscription to notify
Pass Mutate OIR with implicit subscription to not overlap anymore Mutate operational intent reference query succeeds
Pass The implicit subscription can be queried
Pass Implicit subscription has correct temporal parameters
Pass Non-mutated implicit subscription is deleted
Not tested Mutate operational intent reference response format conforms to spec
Not tested Mutate operational intent reference response content is correct
Pass Create an OIR overlapping with the second OIR but not the first Create operational intent reference query succeeds
Pass No implicit subscription was attached
Pass Within a temporal frame not overlapping a newly created implicit subscription, subscriptions should be the same as at the start of the test case
Pass Implicit subscriptions are properly deleted when required by OIR mutation Ensure clean workspace Operational intent reference removed (3x)
Pass Operational intent references can be queried by ID (3x)
Pass Create two OIRs with implicit subscription Create operational intent reference query succeeds (2x)
Pass An implicit subscription was created and can be queried (2x)
Pass Implicit subscription has correct temporal parameters (2x)
Pass Update OIR with implicit subscription to use explicit subscription Mutate operational intent reference query succeeds
Pass Previously attached implicit subscription was deleted
Pass Update OIR with implicit subscription to use no subscription Mutate operational intent reference query succeeds
Pass Previously attached implicit subscription was deleted
Pass Implicit subscriptions are expanded as needed Ensure clean workspace Operational intent reference removed (2x)
Pass Operational intent references can be queried by ID (3x)
Pass Create an OIR with implicit subscription Create operational intent reference query succeeds
Pass An implicit subscription was created and can be queried
Pass Implicit subscription has correct temporal parameters
Pass Expand the OIR while keeping the same implicit subscription Mutate operational intent reference query succeeds
Pass The implicit subscription can be queried
Pass Implicit subscription has wide enough temporal parameters
Pass Cleanup Cleanup Operational intent reference removed
Pass Operational intent references can be queried by ID (3x)
Pass ASTM SCD DSS: Interfaces authentication Setup Ensure clean workspace Operational intent references can be queried by ID
Not tested Operational intent reference removed
Pass Endpoint authorization Operational intents endpoints authentication Unauthorized requests return the proper error message body (20x)
Pass Create operational intent reference with valid credentials
Pass Create operational intent reference response format conforms to spec
Pass Get operational intent reference with valid credentials
Pass Mutate operational intent reference with valid credentials
Pass Mutate operational intent reference response format conforms to spec
Pass Delete operational intent reference with valid credentials
Pass Search operational intent references with valid credentials
Pass Cleanup Cleanup Operational intent references can be queried by ID
Pass ASTM SCD DSS: Operational Intent Reference Key Validation Setup Ensure clean workspace Operational intent references can be queried by ID (3x)
Not tested Operational intent reference removed
Pass Key validation on creation Create first OIR First operational intent reference in area creation query succeeds
Pass Create second non-overlapping OIR Second, non-overlapping operational intent reference creation succeeds
Pass Attempt OIR creation overlapping with first OIR Create operational intent reference with missing OVN fails
Pass Failure response due to conflict has proper format
Pass Failure response due to conflict contains conflicting OIRs
Pass Attempt OIR creation overlapping with second OIR Create operational intent reference with missing OVN fails
Pass Failure response due to conflict has proper format
Pass Failure response due to conflict contains conflicting OIRs
Pass Attempt OIR creation overlapping with both OIRs Create operational intent reference with missing OVN fails
Pass Failure response due to conflict has proper format
Pass Failure response due to conflict contains conflicting OIRs
Pass Attempt valid OIR creation overlapping with both OIRs Create operational intent reference with proper OVNs succeeds
Pass Key validation on mutation Attempt mutation with both OVNs missing Mutate operational intent reference with missing OVN fails
Pass Failure response due to conflict has proper format
Pass Failure response due to conflict contains conflicting OIRs
Pass Attempt mutation with first OVN missing Mutate operational intent reference with missing OVN fails
Pass Failure response due to conflict has proper format
Pass Failure response due to conflict contains conflicting OIRs
Pass Attempt mutation to overlap with the first OIR Mutate operational intent reference with missing OVN fails
Pass Failure response due to conflict has proper format
Pass Failure response due to conflict contains conflicting OIRs
Pass Cleanup Cleanup Operational intent reference removed (3x)
Pass Operational intent references can be queried by ID (3x)
Pass ASTM SCD DSS: Operational Intent Reference Simple Setup Ensure clean workspace Operational intent references can be queried by ID
Not tested Operational intent reference removed
Pass Create an operational intent reference Create operational intent reference query succeeds
Pass Deletion requires correct OVN Attempt deletion with missing OVN Request to delete OIR with empty OVN fails
Pass Attempt deletion with incorrect OVN Request to delete OIR with incorrect OVN fails
Pass Mutation requires correct OVN Attempt mutation with missing OVN Request to mutate OIR with empty OVN fails
Pass Attempt mutation with incorrect OVN Request to mutate OIR with incorrect OVN fails
Pass Cleanup Cleanup Operational intent reference removed
Pass Operational intent references can be queried by ID
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Get operational intent reference by ID (2x)
Pass Search for newly created OIR Successful operational intent reference search query (2x)
Pass Retrieve updated OIR Get operational intent reference by ID (2x)
Pass Search for updated OIR Successful operational intent reference search query (2x)
Pass Query deleted OIR Get operational intent reference by ID (2x)
Pass Successful operational intent reference search query (2x)
Pass Create OIR validation Create operational intent reference query succeeds
Pass Create operational intent reference response format conforms to spec
Pass Returned operational intent reference ID is correct
Pass Returned operational intent reference has a manager
Pass Returned operational intent reference manager is correct
Pass Returned operational intent reference has an USS base URL
Pass Returned operational intent reference base URL is correct
Pass Returned operational intent reference has a start time
Pass Returned operational intent reference has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Create operational intent reference response content is correct
Not tested Returned operational intent reference state is correct
Not tested Returned operational intent reference has a version
Pass Mutate OIR Mutate operational intent reference query succeeds
Pass Mutate operational intent reference response format conforms to spec
Pass Returned operational intent reference ID is correct
Pass Returned operational intent reference has a manager
Pass Returned operational intent reference manager is correct
Pass Returned operational intent reference has an USS base URL
Pass Returned operational intent reference base URL is correct
Pass Returned operational intent reference has a start time
Pass Returned operational intent reference has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Mutated operational intent reference OVN is updated
Pass Mutated operational intent reference version is updated
Pass Mutate operational intent reference response content is correct
Not tested Returned operational intent reference state is correct
Not tested Returned operational intent reference has a version
Pass Delete OIR Delete operational intent reference query succeeds
Pass Delete operational intent reference response format conforms to spec
Pass Returned operational intent reference ID is correct
Pass Returned operational intent reference has a manager
Pass Returned operational intent reference manager is correct
Pass Returned operational intent reference has an USS base URL
Pass Returned operational intent reference base URL is correct
Pass Returned operational intent reference has a start time
Pass Returned operational intent reference has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Non-mutated operational intent reference keeps the same OVN
Pass Non-mutated operational intent reference keeps the same version
Pass Delete operational intent reference response content is correct
Not tested Returned operational intent reference state is correct
Not tested Returned operational intent reference has a version
Pass Setup Ensure clean workspace Operational intent references can be queried by ID
Not tested Operational intent reference removed
Pass Cleanup Cleanup Operational intent references can be queried by ID
Pass ASTM SCD DSS: Subscription and entity deletion interaction OIR creation and modification does not trigger relevant notifications after subscription deletion Create an OIR at every DSS in sequence Create operational intent reference query succeeds (3x)
Pass Modify an OIR at every DSS in sequence Mutate operational intent reference query succeeds (3x)
Pass Setup Ensure clean workspace Operational intent references can be queried by ID (3x)
Not tested Operational intent reference removed
Pass Cleanup Cleanup Operational intent reference removed (3x)
Pass Operational intent references can be queried by ID (3x)
Pass ASTM SCD DSS: Subscription and entity interaction OIR creation and modification trigger relevant notifications Create an OIR at every DSS in sequence Create operational intent reference query succeeds (3x)
Pass Modify an OIR at every DSS in sequence Mutate operational intent reference query succeeds (3x)
Pass Setup Ensure clean workspace Operational intent references can be queried by ID (3x)
Not tested Operational intent reference removed
Pass Cleanup Cleanup Operational intent reference removed (3x)
Pass Operational intent references can be queried by ID (3x)
Pass OVN Request Optional Extension to ASTM F3548-21 Setup Ensure clean workspace Operational intent references can be queried by ID
Not tested Operational intent reference removed
Pass Request for OIR OVN with valid suffix Create OIR with OVN suffix request Create operational intent reference query succeeds
Pass Activate OIR with OVN suffix request Mutate operational intent reference query succeeds
Pass Cleanup Cleanup Operational intent references can be queried by ID
Pass Operational intent reference removed
DSS0005,2 Pass ASTM F3548-21 UTM DSS Operational Intent Reference Access Control Setup Ensure clean workspace Operational intent references can be searched for (3x)
Pass Cleanup Cleanup Operational intent references can be searched for
Pass ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions Setup Ensure clean workspace Operational intent references can be searched for (2x)
Pass ASTM SCD DSS: Implicit Subscription handling Setup Ensure clean workspace Operational intent references can be searched for
Pass Implicit subscriptions are properly deleted when required by OIR mutation Ensure clean workspace Operational intent references can be searched for
Pass Implicit subscriptions are expanded as needed Ensure clean workspace Operational intent references can be searched for
Pass Cleanup Cleanup Operational intent references can be searched for
Not tested ASTM SCD DSS: Interfaces authentication Setup Ensure clean workspace Operational intent references can be searched for
Pass ASTM SCD DSS: Operational Intent Reference Key Validation Setup Ensure clean workspace Operational intent references can be searched for
Pass Cleanup Cleanup Operational intent references can be searched for
Pass ASTM SCD DSS: Operational Intent Reference Simple Setup Ensure clean workspace Operational intent references can be searched for
Pass Cleanup Cleanup Operational intent references can be searched for
Pass ASTM SCD DSS: Operational Intent Reference Synchronization Setup Ensure clean workspace Operational intent references can be searched for
Pass Cleanup Cleanup Operational intent references can be searched for
Pass ASTM SCD DSS: Subscription and entity deletion interaction Setup Ensure clean workspace Operational intent references can be searched for
Pass Cleanup Cleanup Operational intent references can be searched for
Pass ASTM SCD DSS: Subscription and entity interaction Setup Ensure clean workspace Operational intent references can be searched for
Pass Cleanup Cleanup Operational intent references can be searched for
Pass OVN Request Optional Extension to ASTM F3548-21 Setup Ensure clean workspace Operational intent references can be searched for
DSS0005,3 Pass ASTM SCD DSS: Constraint Reference Simple Setup Ensure clean workspace Constraint references can be queried by ID
Not tested Constraint reference removed
Pass Create a constraint reference Create constraint reference query succeeds
Pass Deletion requires correct OVN Attempt deletion with missing OVN Request to delete CR with empty OVN fails
Pass Attempt deletion with incorrect OVN Request to delete CR with incorrect OVN fails
Pass Mutation requires correct OVN Attempt mutation with missing OVN Request to mutate CR with empty OVN fails
Pass Attempt mutation with incorrect OVN Request to mutate CR with incorrect OVN fails
Pass Cleanup Cleanup Constraint reference removed
Pass Constraint references can be queried by ID
Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Get constraint reference by ID (2x)
Pass Get constraint reference response format conforms to spec (3x)
Pass Returned constraint reference ID is correct (3x)
Pass Returned constraint reference has a manager (3x)
Pass Returned constraint reference manager is correct (3x)
Pass Returned constraint reference has an USS base URL (3x)
Pass Returned constraint reference base URL is correct (3x)
Pass Returned constraint reference has a start time (3x)
Pass Returned constraint reference has an end time (3x)
Pass Returned start time is correct (3x)
Pass Returned end time is correct (3x)
Pass Returned constraint reference has an OVN (3x)
Pass Non-mutated constraint reference keeps the same OVN (3x)
Pass Non-mutated constraint reference keeps the same version (3x)
Pass Get constraint reference response content is correct (2x)
Not tested Returned constraint reference has a version
Pass Search for newly created CR Returned constraint reference ID is correct (3x)
Pass Returned constraint reference has a manager (3x)
Pass Returned constraint reference manager is correct (3x)
Pass Returned constraint reference has an USS base URL (3x)
Pass Returned constraint reference base URL is correct (3x)
Pass Returned constraint reference has a start time (3x)
Pass Returned constraint reference has an end time (3x)
Pass Returned start time is correct (3x)
Pass Returned end time is correct (3x)
Pass Returned constraint reference has an OVN (3x)
Pass Non-mutated constraint reference keeps the same OVN (3x)
Pass Non-mutated constraint reference keeps the same version (3x)
Not tested Returned constraint reference has a version
Pass Retrieve updated CR Get constraint reference by ID (2x)
Pass Get constraint reference response format conforms to spec (3x)
Pass Returned constraint reference ID is correct (3x)
Pass Returned constraint reference has a manager (3x)
Pass Returned constraint reference manager is correct (3x)
Pass Returned constraint reference has an USS base URL (3x)
Pass Returned constraint reference base URL is correct (3x)
Pass Returned constraint reference has a start time (3x)
Pass Returned constraint reference has an end time (3x)
Pass Returned start time is correct (3x)
Pass Returned end time is correct (3x)
Pass Returned constraint reference has an OVN (3x)
Pass Non-mutated constraint reference keeps the same OVN (3x)
Pass Non-mutated constraint reference keeps the same version (3x)
Pass Get constraint reference response content is correct (2x)
Not tested Returned constraint reference has a version
Pass Search for updated CR Returned constraint reference ID is correct (3x)
Pass Returned constraint reference has a manager (3x)
Pass Returned constraint reference manager is correct (3x)
Pass Returned constraint reference has an USS base URL (3x)
Pass Returned constraint reference base URL is correct (3x)
Pass Returned constraint reference has a start time (3x)
Pass Returned constraint reference has an end time (3x)
Pass Returned start time is correct (3x)
Pass Returned end time is correct (3x)
Pass Returned constraint reference has an OVN (3x)
Pass Non-mutated constraint reference keeps the same OVN (3x)
Pass Non-mutated constraint reference keeps the same version (3x)
Not tested Returned constraint reference has a version
Pass Query deleted CR Get constraint reference by ID (2x)
Not tested Get constraint reference response format conforms to spec
Not tested Get constraint reference response content is correct
Pass Create CR validation Create constraint reference query succeeds
Pass Create constraint reference response format conforms to spec
Pass Returned constraint reference ID is correct
Pass Returned constraint reference has a manager
Pass Returned constraint reference manager is correct
Pass Returned constraint reference has an USS base URL
Pass Returned constraint reference base URL is correct
Pass Returned constraint reference has a start time
Pass Returned constraint reference has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Returned constraint reference has an OVN
Pass Create constraint reference response content is correct
Not tested Returned constraint reference has a version
Pass Mutate CR Mutate constraint reference query succeeds
Pass Mutate constraint reference response format conforms to spec
Pass Returned constraint reference ID is correct
Pass Returned constraint reference has a manager
Pass Returned constraint reference manager is correct
Pass Returned constraint reference has an USS base URL
Pass Returned constraint reference base URL is correct
Pass Returned constraint reference has a start time
Pass Returned constraint reference has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Returned constraint reference has an OVN
Pass Mutated constraint reference OVN is updated
Pass Mutated constraint reference version is updated
Pass Mutate constraint reference response content is correct
Not tested Returned constraint reference has a version
Pass Delete CR Delete constraint reference query succeeds
Pass Delete constraint reference response format conforms to spec
Pass Returned constraint reference ID is correct
Pass Returned constraint reference has a manager
Pass Returned constraint reference manager is correct
Pass Returned constraint reference has an USS base URL
Pass Returned constraint reference base URL is correct
Pass Returned constraint reference has a start time
Pass Returned constraint reference has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Returned constraint reference has an OVN
Pass Non-mutated constraint reference keeps the same OVN
Pass Non-mutated constraint reference keeps the same version
Pass Delete constraint reference response content is correct
Not tested Returned constraint reference has a version
Pass Setup Ensure clean workspace Constraint references can be queried by ID
Not tested Constraint reference removed
Pass Cleanup Cleanup Constraint references can be queried by ID
Pass ASTM SCD DSS: Interfaces authentication Setup Ensure clean workspace Constraint references can be queried by ID
Not tested Constraint reference removed
Pass Endpoint authorization Constraint reference endpoints authentication Unauthorized requests return the proper error message body (20x)
Pass Create constraint reference with valid credentials
Pass Create constraint reference response format conforms to spec
Pass Get constraint reference with valid credentials
Pass Get constraint reference response format conforms to spec
Pass Mutate constraint reference with valid credentials
Pass Mutate constraint reference response format conforms to spec
Pass Delete constraint reference with valid credentials
Pass Delete constraint reference response format conforms to spec
Pass Cleanup Cleanup Constraint references can be queried by ID
DSS0005,4 Pass ASTM SCD DSS: Constraint Reference Simple Setup Ensure clean workspace Constraint references can be searched for
Pass Cleanup Cleanup Constraint references can be searched for
Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Search for newly created CR Successful constraint reference search query (2x)
Pass Search constraint reference response format conforms to spec (3x)
Pass Expected constraint reference is in search results (3x)
Pass Search constraint reference response content is correct (2x)
Pass Search for updated CR Successful constraint reference search query (2x)
Pass Search constraint reference response format conforms to spec (3x)
Pass Expected constraint reference is in search results (3x)
Pass Search constraint reference response content is correct (2x)
Pass Query deleted CR Successful constraint reference search query (2x)
Pass Setup Ensure clean workspace Constraint references can be searched for
Pass Cleanup Cleanup Constraint references can be searched for
Pass ASTM SCD DSS: Interfaces authentication Endpoint authorization Constraint reference endpoints authentication Search constraint references with valid credentials
Pass Search constraint reference response format conforms to spec
Not tested Setup Ensure clean workspace Constraint references can be searched for
DSS0005,5 Pass ASTM SCD DSS: Implicit Subscription handling Setup Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID
Not tested Subscription can be deleted
Pass Single OIR implicit subscription is removed upon OIR deletion Delete the OIR with implicit subscription After removal of the only created OIR, subscriptions should be as before its creation
Pass Implicit subscriptions always properly cover their OIR Create an overlapping OIR without any subscription New OIR creation response contains previous implicit subscription to notify
Pass Mutate OIR with implicit subscription to not overlap anymore The implicit subscription can be queried
Pass Non-mutated implicit subscription is deleted
Pass Create an OIR overlapping with the second OIR but not the first Within a temporal frame not overlapping a newly created implicit subscription, subscriptions should be the same as at the start of the test case
Pass Implicit subscriptions are properly deleted when required by OIR mutation Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID
Not tested Subscription can be deleted
Pass Create a subscription Create subscription query succeeds
Pass Implicit subscriptions are expanded as needed Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID (2x)
Pass Subscription can be deleted
Pass Expand the OIR while keeping the same implicit subscription The implicit subscription can be queried
Pass Cleanup Cleanup Successful subscription search query
Pass Subscription can be queried by ID
Pass ASTM SCD DSS: Interfaces authentication Setup Ensure clean workspace Subscription can be queried by ID
Pass Successful subscription search query
Not tested Subscription can be deleted
Pass Endpoint authorization Subscription endpoints authentication Unauthorized requests return the proper error message body (24x)
Pass Create subscription with valid credentials
Pass Get subscription with valid credentials
Pass Mutate subscription with valid credentials
Pass Delete subscription with valid credentials (2x)
Pass Search subscriptions with valid credentials
Pass Cleanup Cleanup Subscription can be queried by ID
Pass ASTM SCD DSS: Subscription Simple Setup Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID (4x)
Not tested Subscription can be deleted
Pass Subscription Simple Create subscription validation Create subscription query succeeds (4x)
Pass Create subscription response format conforms to spec (4x)
Pass Returned subscription ID is correct (4x)
Pass Returned subscription has an USS base URL (4x)
Pass Returned USS base URL has correct base URL (4x)
Pass Returned subscription has a start time (4x)
Pass Returned subscription has an end time (4x)
Pass Returned subscription has a version (4x)
Pass Non-implicit subscription has implicit flag set to false (4x)
Pass Operational intents notification flag is as requested (4x)
Pass Constraints notification flag is as requested (4x)
Pass New subscription has a notification index of 0 (4x)
Pass Create subscription response content is correct (4x)
Pass Returned end time is correct (2x)
Pass Returned start time is correct (2x)
Not tested Returned notification index is equal to or greater than 0
Pass Attempt Subscription mutation with incorrect version Mutation with empty version fails
Pass Mutation with incorrect version fails
Pass Mutate Subscription Mutate subscription query succeeds (8x)
Pass Mutate subscription response format conforms to spec (8x)
Pass Returned subscription ID is correct (8x)
Pass Returned subscription has an USS base URL (8x)
Pass Returned USS base URL has correct base URL (8x)
Pass Returned subscription has a start time (8x)
Pass Returned subscription has an end time (8x)
Pass Returned start time is correct (8x)
Pass Returned end time is correct (8x)
Pass Returned subscription has a version (8x)
Pass Mutated subscription version is updated (8x)
Pass Non-implicit subscription has implicit flag set to false (8x)
Pass Operational intents notification flag is as requested (8x)
Pass Constraints notification flag is as requested (8x)
Pass Returned notification index is equal to or greater than 0 (8x)
Pass Mutate subscription response is correct (8x)
Not tested New subscription has a notification index of 0
Pass Query Existing Subscription Get subscription query succeeds (4x)
Pass Get subscription response format conforms to spec (4x)
Pass Returned subscription ID is correct (8x)
Pass Returned subscription has an USS base URL (8x)
Pass Returned USS base URL has correct base URL (8x)
Pass Returned subscription has a start time (8x)
Pass Returned subscription has an end time (8x)
Pass Returned start time is correct (8x)
Pass Returned end time is correct (8x)
Pass Returned subscription has a version (8x)
Pass Non-mutated subscription keeps the same version (8x)
Pass Non-implicit subscription has implicit flag set to false (8x)
Pass Operational intents notification flag is as requested (8x)
Pass Constraints notification flag is as requested (8x)
Pass Returned notification index is equal to or greater than 0 (8x)
Pass Get subscription response is correct (4x)
Pass Search for all subscriptions in planning area query succeeds
Pass Search subscriptions response format conforms to spec (4x)
Pass Created Subscription is in search results (4x)
Pass Search for all subscriptions in planning area response is correct (4x)
Pass No huge search area allowed
Not tested New subscription has a notification index of 0
Pass Delete Subscription Missing version prevents deletion (4x)
Pass Incorrect version prevents deletion (4x)
Pass Delete subscription query succeeds (4x)
Pass Delete subscription response format conforms to spec (4x)
Pass Returned subscription ID is correct (4x)
Pass Returned subscription has an USS base URL (4x)
Pass Returned USS base URL has correct base URL (4x)
Pass Returned subscription has a start time (4x)
Pass Returned subscription has an end time (4x)
Pass Returned start time is correct (4x)
Pass Returned end time is correct (4x)
Pass Returned subscription has a version (4x)
Pass Non-mutated subscription keeps the same version (4x)
Pass Non-implicit subscription has implicit flag set to false (4x)
Pass Operational intents notification flag is as requested (4x)
Pass Constraints notification flag is as requested (4x)
Pass Returned notification index is equal to or greater than 0 (4x)
Pass Delete subscription response is correct (4x)
Not tested Subscription can be deleted
Not tested New subscription has a notification index of 0
Pass Query Deleted Subscription Query by subscription ID should fail (4x)
Pass Search for all subscriptions in planning area query succeeds
Pass Deleted subscription should not be present in search results
Pass Cleanup Cleanup Subscription can be queried by ID (4x)
Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Get subscription response format conforms to spec (2x)
Pass Successful subscription search query (4x)
Not tested Get Subscription by ID
Not tested Created Subscription is in search results
Not tested Returned subscription ID is correct
Not tested New subscription has a notification index of 0
Not tested Returned notification index is equal to or greater than 0
Not tested Returned subscription has an USS base URL
Not tested Returned USS base URL has correct base URL
Not tested Returned subscription has a start time
Not tested Returned start time is correct
Not tested Returned subscription has an end time
Not tested Returned end time is correct
Not tested Returned subscription has a version
Not tested Non-implicit subscription has implicit flag set to false
Not tested Operational intents notification flag is as requested
Not tested Constraints notification flag is as requested
Not tested Non-mutated subscription keeps the same version
Pass Query updated subscription Get subscription response format conforms to spec (2x)
Pass Successful subscription search query (4x)
Not tested Get Subscription by ID
Not tested Created Subscription is in search results
Not tested Returned subscription ID is correct
Not tested New subscription has a notification index of 0
Not tested Returned notification index is equal to or greater than 0
Not tested Returned subscription has an USS base URL
Not tested Returned USS base URL has correct base URL
Not tested Returned subscription has a start time
Not tested Returned start time is correct
Not tested Returned subscription has an end time
Not tested Returned end time is correct
Not tested Returned subscription has a version
Not tested Non-implicit subscription has implicit flag set to false
Not tested Operational intents notification flag is as requested
Not tested Constraints notification flag is as requested
Not tested Non-mutated subscription keeps the same version
Pass Verify mutation on all secondaries Get subscription response format conforms to spec (4x)
Pass Successful subscription search query (8x)
Not tested Get Subscription by ID
Not tested Created Subscription is in search results
Not tested Returned subscription ID is correct
Not tested New subscription has a notification index of 0
Not tested Returned notification index is equal to or greater than 0
Not tested Returned subscription has an USS base URL
Not tested Returned USS base URL has correct base URL
Not tested Returned subscription has a start time
Not tested Returned start time is correct
Not tested Returned subscription has an end time
Not tested Returned end time is correct
Not tested Returned subscription has a version
Not tested Non-implicit subscription has implicit flag set to false
Not tested Operational intents notification flag is as requested
Not tested Constraints notification flag is as requested
Not tested Non-mutated subscription keeps the same version
Pass Delete subscriptions on secondaries Subscription can be deleted (2x)
Pass Delete subscription response format conforms to spec (2x)
Pass Returned subscription ID is correct (2x)
Pass Returned subscription has an USS base URL (2x)
Pass Returned USS base URL has correct base URL (2x)
Pass Returned subscription has a start time (2x)
Pass Returned subscription has an end time (2x)
Pass Returned start time is correct (2x)
Pass Returned end time is correct (2x)
Pass Returned subscription has a version (2x)
Pass Non-mutated subscription keeps the same version (2x)
Pass Non-implicit subscription has implicit flag set to false (2x)
Pass Operational intents notification flag is as requested (2x)
Pass Constraints notification flag is as requested (2x)
Pass Returned notification index is equal to or greater than 0 (2x)
Pass Delete subscription response content is correct (2x)
Not tested New subscription has a notification index of 0
Pass Create subscription validation Create subscription query succeeds (3x)
Pass Create subscription response format conforms to spec (3x)
Pass Returned subscription ID is correct (3x)
Pass Returned subscription has an USS base URL (3x)
Pass Returned USS base URL has correct base URL (3x)
Pass Returned subscription has a start time (3x)
Pass Returned subscription has an end time (3x)
Pass Returned start time is correct (3x)
Pass Returned end time is correct (3x)
Pass Returned subscription has a version (3x)
Pass Non-implicit subscription has implicit flag set to false (3x)
Pass Operational intents notification flag is as requested (3x)
Pass Constraints notification flag is as requested (3x)
Pass New subscription has a notification index of 0 (3x)
Pass Create subscription response content is correct (3x)
Not tested Returned notification index is equal to or greater than 0
Pass Mutate subscription broadcast Subscription can be mutated
Pass Mutate subscription response format conforms to spec
Pass Returned subscription ID is correct
Pass Returned subscription has an USS base URL
Pass Returned USS base URL has correct base URL
Pass Returned subscription has a start time
Pass Returned subscription has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Returned subscription has a version
Pass Mutated subscription version is updated
Pass Non-implicit subscription has implicit flag set to false
Pass Operational intents notification flag is as requested
Pass Constraints notification flag is as requested
Pass Returned notification index is equal to or greater than 0
Pass Mutate subscription response content is correct
Not tested New subscription has a notification index of 0
Pass Create subscription with different credentials Create subscription query succeeds
Pass Mutate subscription on secondaries Subscription can be mutated on secondary DSS (2x)
Pass Mutate subscription response format conforms to spec (2x)
Pass Returned subscription ID is correct (2x)
Pass Returned subscription has an USS base URL (2x)
Pass Returned USS base URL has correct base URL (2x)
Pass Returned subscription has a start time (2x)
Pass Returned subscription has an end time (2x)
Pass Returned start time is correct (2x)
Pass Returned end time is correct (2x)
Pass Returned subscription has a version (2x)
Pass Mutated subscription version is updated (2x)
Pass Non-implicit subscription has implicit flag set to false (2x)
Pass Operational intents notification flag is as requested (2x)
Pass Constraints notification flag is as requested (2x)
Pass Returned notification index is equal to or greater than 0 (2x)
Pass Mutate subscription response content is correct (2x)
Not tested Subscription returned by a secondary DSS is valid and correct
Not tested Subscription can be mutated
Not tested New subscription has a notification index of 0
Pass Delete subscription on primary Subscription can be deleted
Pass Delete subscription response format conforms to spec
Pass Returned subscription ID is correct
Pass Returned subscription has an USS base URL
Pass Returned USS base URL has correct base URL
Pass Returned subscription has a start time
Pass Returned subscription has an end time
Pass Returned start time is correct
Pass Returned end time is correct
Pass Returned subscription has a version
Pass Non-mutated subscription keeps the same version
Pass Non-implicit subscription has implicit flag set to false
Pass Operational intents notification flag is as requested
Pass Constraints notification flag is as requested
Pass Returned notification index is equal to or greater than 0
Pass Delete subscription response content is correct
Not tested New subscription has a notification index of 0
Pass Setup Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID (4x)
Not tested Subscription can be deleted
Pass Cleanup Cleanup Subscription can be queried by ID (4x)
Pass Subscription can be deleted
Pass ASTM SCD DSS: Subscription Validation Setup Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID
Not tested Subscription can be deleted
Pass Subscription Validation Subscription duration limitations Accept a subscription of maximal duration
Pass Cleanup Cleanup Subscription can be queried by ID
Pass Subscription can be deleted
Pass ASTM SCD DSS: Subscription and entity deletion interaction Subscription deletion is reflected on all DSS instances Delete a subscription at every DSS in sequence Get Subscription by ID (6x)
Pass Subscription can be deleted (3x)
Pass Create a subscription at every DSS in sequence Create subscription query succeeds (3x)
Pass Setup Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID (3x)
Not tested Subscription can be deleted
Pass Cleanup Cleanup Successful subscription search query
Pass Subscription can be queried by ID (3x)
Pass ASTM SCD DSS: Subscription and entity interaction Subscription creation returns relevant OIRs Create a subscription at every DSS in sequence Get Subscription by ID (6x)
Pass Create subscription query succeeds (3x)
Pass Expiration of subscriptions removes them Expire explicit subscriptions at every DSS in sequence Subscription can be mutated (3x)
Pass Successful subscription search query (6x)
Pass Setup Ensure clean workspace Successful subscription search query
Pass Subscription can be queried by ID (4x)
Not tested Subscription can be deleted
Pass OIR creation and modification trigger relevant notifications Create background subscription Create subscription query succeeds
Pass Cleanup Cleanup Successful subscription search query
Pass Subscription can be queried by ID (5x)
Pass Subscription can be deleted (4x)
DSS0010 Not tested Not implemented
DSS0015 Pass ASTM SCD DSS: Subscription Validation Subscription Validation Subscription duration limitations Don't create a too long subscription
Pass Don't mutate a subscription to be too long
DSS0020 Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Constraint reference can be found at every DSS (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Newly created CR can be consistently retrieved from all DSS instances (3x)
Not tested Propagated constraint reference general area is synchronized
Pass Search for newly created CR Propagated constraint reference general area is synchronized (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Newly created CR can be consistently searched for from all DSS instances (3x)
Not tested Constraint reference can be found at every DSS
Pass Retrieve updated CR Constraint reference can be found at every DSS (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Updated CR can be consistently retrieved from all DSS instances (3x)
Not tested Propagated constraint reference general area is synchronized
Pass Search for updated CR Propagated constraint reference general area is synchronized (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Updated CR can be consistently searched for from all DSS instances (3x)
Not tested Constraint reference can be found at every DSS
Pass Query deleted CR Deleted CR cannot be retrieved from all DSS instances (3x)
Pass Deleted CR cannot be searched for from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Operational intent reference can be found at every DSS (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Newly created OIR can be consistently retrieved from all DSS instances (3x)
Not tested Propagated operational intent reference general area is synchronized
Pass Search for newly created OIR Propagated operational intent reference general area is synchronized (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Newly created OIR can be consistently searched for from all DSS instances (3x)
Not tested Operational intent reference can be found at every DSS
Pass Retrieve updated OIR Operational intent reference can be found at every DSS (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Not tested Propagated operational intent reference general area is synchronized
Pass Search for updated OIR Propagated operational intent reference general area is synchronized (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Not tested Operational intent reference can be found at every DSS
Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Subscription can be found at every DSS (3x)
Pass Propagated subscription contains the correct USS base URL (3x)
Pass Propagated subscription contains the correct start time (3x)
Pass Propagated subscription contains the correct end time (3x)
Pass Propagated subscription contains the correct version (3x)
Pass Propagated subscription contains the correct notification flags (3x)
Pass Propagated subscription contains the correct implicit flag (3x)
Pass Propagated subscription contains expected notification count (3x)
Pass Secondary DSS returns the subscription in searches for area that contains it (3x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (3x)
Pass Query updated subscription Subscription can be found at every DSS (3x)
Pass Propagated subscription contains the correct USS base URL (3x)
Pass Propagated subscription contains the correct start time (3x)
Pass Propagated subscription contains the correct end time (3x)
Pass Propagated subscription contains the correct version (3x)
Pass Propagated subscription contains the correct notification flags (3x)
Pass Propagated subscription contains the correct implicit flag (3x)
Pass Propagated subscription contains expected notification count (3x)
Pass Secondary DSS returns the subscription in searches for area that contains it (3x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (3x)
Pass Verify mutation on all secondaries Subscription can be found at every DSS (6x)
Pass Propagated subscription contains the correct USS base URL (6x)
Pass Propagated subscription contains the correct start time (6x)
Pass Propagated subscription contains the correct end time (6x)
Pass Propagated subscription contains the correct version (6x)
Pass Propagated subscription contains the correct notification flags (6x)
Pass Propagated subscription contains the correct implicit flag (6x)
Pass Propagated subscription contains expected notification count (6x)
Pass Secondary DSS returns the subscription in searches for area that contains it (6x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (6x)
Pass Query deleted subscription DSS should not return the deleted subscription (3x)
Pass Delete subscriptions on secondaries DSS should not return the deleted subscription (9x)
Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Check Down USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Check Unknown USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
DSS0100,1 Pass ASTM SCD DSS: Interfaces authentication Setup Ensure clean workspace USS Availability can be requested
Pass USS Availability can be updated
Pass Endpoint authorization Availability endpoints authentication Unauthorized requests return the proper error message body (8x)
Pass Read availability with valid credentials (5x)
Pass USS Availability Get response format conforms to spec
Pass Set availability with valid credentials
Pass USS Availability Set response format conforms to spec
Pass Cleanup Cleanup USS Availability can be requested
Pass USS Availability can be updated
Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability can be requested (3x)
Not tested USS Availability can be set to Unknown
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability can be requested (2x)
Pass Check Down USS availability broadcast USS Availability can be requested (2x)
Pass Check Unknown USS availability broadcast USS Availability can be requested (2x)
Pass Update USS availability on primary DSS to Normal USS Availability can be updated
Pass Update USS Availability on primary DSS to Down USS Availability can be updated
Pass Update USS availability on primary DSS to Unknown USS Availability can be updated
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability can be requested (2x)
Pass Main DSS instance reports Unknown availability
Pass Availability version for an unknown USS should be empty
Pass Cleanup Cleanup USS Availability can be requested
DSS0100,2 Pass ASTM SCD DSS: Report DSS Report Make valid DSS report DSS report successfully submitted
Pass DSS returned a valid report ID
DSS0200 Not tested ASTM UTM DSS: Direct CRDB access Verify security interoperability Attempt to connect in insecure mode Node runs in secure mode
DSS0205 Not tested ASTM UTM DSS: Direct CRDB access Verify security interoperability Attempt to connect in insecure mode Node runs in secure mode
Not tested Attempt to connect with legacy encryption protocol Node rejects legacy encryption protocols
DSS0210,1a Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Subscription can be found at every DSS (3x)
Pass Query updated subscription Subscription can be found at every DSS (3x)
Pass Verify mutation on all secondaries Subscription can be found at every DSS (6x)
Pass Query deleted subscription DSS should not return the deleted subscription (3x)
Pass Delete subscriptions on secondaries DSS should not return the deleted subscription (9x)
DSS0210,1b Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Verify manager synchronization Subscription deletion with different non-managing credentials on secondary DSS fails (2x)
Pass Mutate subscription on secondaries Subscription can be mutated on secondary DSS (2x)
DSS0210,1c Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Propagated subscription contains the correct USS base URL (3x)
Pass Query updated subscription Propagated subscription contains the correct USS base URL (3x)
Pass Verify mutation on all secondaries Propagated subscription contains the correct USS base URL (6x)
DSS0210,1d Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Secondary DSS returns the subscription in searches for area that contains it (3x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (3x)
Pass Query updated subscription Secondary DSS returns the subscription in searches for area that contains it (3x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (3x)
Pass Verify mutation on all secondaries Secondary DSS returns the subscription in searches for area that contains it (6x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (6x)
DSS0210,1e Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Propagated subscription contains the correct start time (3x)
Pass Propagated subscription contains the correct end time (3x)
Pass Query updated subscription Propagated subscription contains the correct start time (3x)
Pass Propagated subscription contains the correct end time (3x)
Pass Verify mutation on all secondaries Propagated subscription contains the correct start time (6x)
Pass Propagated subscription contains the correct end time (6x)
DSS0210,1f Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Propagated subscription contains the correct version (3x)
Pass Query updated subscription Propagated subscription contains the correct version (3x)
Pass Verify mutation on all secondaries Propagated subscription contains the correct version (6x)
DSS0210,1g Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Propagated subscription contains the correct notification flags (3x)
Pass Query updated subscription Propagated subscription contains the correct notification flags (3x)
Pass Verify mutation on all secondaries Propagated subscription contains the correct notification flags (6x)
DSS0210,1h Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Propagated subscription contains the correct implicit flag (3x)
Pass Query updated subscription Propagated subscription contains the correct implicit flag (3x)
Pass Verify mutation on all secondaries Propagated subscription contains the correct implicit flag (6x)
DSS0210,1i Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Propagated subscription contains expected notification count (3x)
Pass Query updated subscription Propagated subscription contains expected notification count (3x)
Pass Verify mutation on all secondaries Propagated subscription contains expected notification count (6x)
DSS0210,2a Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Constraint reference can be found at every DSS (3x)
Pass Retrieve updated CR Constraint reference can be found at every DSS (3x)
Pass Query deleted CR Deleted CR cannot be retrieved from all DSS instances (3x)
Pass Deleted CR cannot be searched for from all DSS instances (3x)
Not tested Search for newly created CR Constraint reference can be found at every DSS
Not tested Search for updated CR Constraint reference can be found at every DSS
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Operational intent reference can be found at every DSS (3x)
Pass Retrieve updated OIR Operational intent reference can be found at every DSS (3x)
Pass Query deleted OIR Deleted OIR cannot be retrieved from all DSS instances (3x)
Pass Deleted OIR cannot be searched for from all DSS instances (3x)
Not tested Search for newly created OIR Operational intent reference can be found at every DSS
Not tested Search for updated OIR Operational intent reference can be found at every DSS
DSS0210,2b Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Propagated constraint reference contains the correct manager (3x)
Pass Search for newly created CR Propagated constraint reference contains the correct manager (3x)
Pass Retrieve updated CR Propagated constraint reference contains the correct manager (3x)
Pass Search for updated CR Propagated constraint reference contains the correct manager (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Propagated operational intent reference contains the correct manager (3x)
Pass Search for newly created OIR Propagated operational intent reference contains the correct manager (3x)
Pass Retrieve updated OIR Propagated operational intent reference contains the correct manager (3x)
Pass Search for updated OIR Propagated operational intent reference contains the correct manager (3x)
DSS0210,2c Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Propagated constraint reference contains the correct USS base URL (3x)
Pass Search for newly created CR Propagated constraint reference contains the correct USS base URL (3x)
Pass Retrieve updated CR Propagated constraint reference contains the correct USS base URL (3x)
Pass Search for updated CR Propagated constraint reference contains the correct USS base URL (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Propagated operational intent reference contains the correct USS base URL (3x)
Pass Search for newly created OIR Propagated operational intent reference contains the correct USS base URL (3x)
Pass Retrieve updated OIR Propagated operational intent reference contains the correct USS base URL (3x)
Pass Search for updated OIR Propagated operational intent reference contains the correct USS base URL (3x)
DSS0210,2d Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Propagated operational intent reference contains the correct state (3x)
Pass Search for newly created OIR Propagated operational intent reference contains the correct state (3x)
Pass Retrieve updated OIR Propagated operational intent reference contains the correct state (3x)
Pass Search for updated OIR Propagated operational intent reference contains the correct state (3x)
DSS0210,2e Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Search for newly created CR Propagated constraint reference general area is synchronized (3x)
Pass Search for updated CR Propagated constraint reference general area is synchronized (3x)
Not tested Retrieve newly created CR Propagated constraint reference general area is synchronized
Not tested Retrieve updated CR Propagated constraint reference general area is synchronized
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Search for newly created OIR Propagated operational intent reference general area is synchronized (3x)
Pass Search for updated OIR Propagated operational intent reference general area is synchronized (3x)
Not tested Retrieve newly created OIR Propagated operational intent reference general area is synchronized
Not tested Retrieve updated OIR Propagated operational intent reference general area is synchronized
DSS0210,2f Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Search for newly created CR Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Retrieve updated CR Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Search for updated CR Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Search for newly created OIR Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Retrieve updated OIR Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Search for updated OIR Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
DSS0210,3a Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability is consistent across every DSS instance (3x)
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass Check Down USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass Check Unknown USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability is consistent across every DSS instance (3x)
DSS0210,3b Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability is consistent across every DSS instance (3x)
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass Check Down USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass Check Unknown USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability is consistent across every DSS instance (3x)
DSS0210,3c Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability version is consistent across every DSS instance (3x)
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability version is consistent across every DSS instance (3x)
Pass Check Down USS availability broadcast USS Availability version is consistent across every DSS instance (3x)
Pass Check Unknown USS availability broadcast USS Availability version is consistent across every DSS instance (3x)
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability version is consistent across every DSS instance (3x)
DSS0210,A2-7-2,1a Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Newly created CR can be consistently retrieved from all DSS instances (3x)
Pass Search for newly created CR Newly created CR can be consistently searched for from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Newly created OIR can be consistently retrieved from all DSS instances (3x)
Pass Search for newly created OIR Newly created OIR can be consistently searched for from all DSS instances (3x)
DSS0210,A2-7-2,1b Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve updated CR Updated CR can be consistently retrieved from all DSS instances (3x)
Pass Search for updated CR Updated CR can be consistently searched for from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve updated OIR Updated OIR can be consistently retrieved from all DSS instances (3x)
Pass Search for updated OIR Updated OIR can be consistently searched for from all DSS instances (3x)
DSS0210,A2-7-2,1c Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Search for newly created OIR Newly created OIR can be consistently searched for from all DSS instances (3x)
Pass Search for updated OIR Updated OIR can be consistently searched for from all DSS instances (3x)
DSS0210,A2-7-2,1d Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve updated CR Updated CR can be consistently retrieved from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Newly created OIR can be consistently retrieved from all DSS instances (3x)
Pass Retrieve updated OIR Updated OIR can be consistently retrieved from all DSS instances (3x)
DSS0210,A2-7-2,1e Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Search for newly created CR Newly created CR can be consistently searched for from all DSS instances (3x)
Pass Search for updated CR Updated CR can be consistently searched for from all DSS instances (3x)
DSS0210,A2-7-2,1f Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Newly created CR can be consistently retrieved from all DSS instances (3x)
DSS0210,A2-7-2,2a Pass ASTM SCD DSS: Operational Intent Reference Key Validation Key validation on creation Attempt OIR creation overlapping with first OIR Create operational intent reference with missing OVN fails
Pass Attempt OIR creation overlapping with second OIR Create operational intent reference with missing OVN fails
Pass Attempt OIR creation overlapping with both OIRs Create operational intent reference with missing OVN fails
DSS0210,A2-7-2,2b Pass ASTM SCD DSS: Operational Intent Reference Key Validation Key validation on mutation Attempt mutation with both OVNs missing Mutate operational intent reference with missing OVN fails
Pass Attempt mutation with first OVN missing Mutate operational intent reference with missing OVN fails
Pass Attempt mutation to overlap with the first OIR Mutate operational intent reference with missing OVN fails
DSS0210,A2-7-2,3a Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Query deleted CR Deleted CR cannot be searched for from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Query deleted OIR Deleted OIR cannot be searched for from all DSS instances (3x)
DSS0210,A2-7-2,3b Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Query deleted CR Deleted CR cannot be retrieved from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Query deleted OIR Deleted OIR cannot be retrieved from all DSS instances (3x)
DSS0210,A2-7-2,3c Not tested Not implemented
DSS0210,A2-7-2,3d Not tested Not implemented
DSS0210,A2-7-2,4a Pass ASTM SCD DSS: Subscription and entity interaction Subscription creation returns relevant OIRs Create a subscription at every DSS in sequence Subscription may be retrieved from all other DSS instances (10x)
Pass DSS response contains the expected OIRs (3x)
DSS0210,A2-7-2,4b Pass ASTM SCD DSS: Subscription and entity interaction OIR creation and modification trigger relevant notifications Create an OIR at every DSS in sequence DSS returns the implicit subscriptions from intersecting OIRs (6x)
Pass DSS response contains the expected background subscription (3x)
DSS0210,A2-7-2,4c Pass ASTM SCD DSS: Subscription and entity interaction OIR creation and modification trigger relevant notifications Modify an OIR at every DSS in sequence DSS returns the implicit subscriptions from intersecting OIRs (6x)
Pass DSS response contains the expected background subscription (3x)
DSS0210,A2-7-2,4d Pass ASTM SCD DSS: Subscription and entity interaction Expiration of subscriptions removes them Expire explicit subscriptions at every DSS in sequence Subscription does not exist on all other DSS instances (10x)
DSS0210,A2-7-2,5a Pass ASTM SCD DSS: Subscription and entity deletion interaction Subscription deletion is reflected on all DSS instances Delete a subscription at every DSS in sequence Subscription does not exist on all other DSS instances (10x)
DSS0210,A2-7-2,5b Pass ASTM SCD DSS: Subscription and entity deletion interaction OIR creation and modification does not trigger relevant notifications after subscription deletion Create an OIR at every DSS in sequence DSS response does not contain the deleted subscriptions (3x)
DSS0210,A2-7-2,5c Pass ASTM SCD DSS: Subscription and entity deletion interaction OIR creation and modification does not trigger relevant notifications after subscription deletion Modify an OIR at every DSS in sequence DSS response does not contain the deleted subscriptions (3x)
DSS0210,A2-7-2,6 Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Check Down USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Check Unknown USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
DSS0210,A2-7-2,7 Pass ASTM SCD DSS: Interfaces authentication Endpoint authorization Subscription endpoints authentication Create subscription with missing credentials
Pass Create subscription with invalid credentials
Pass Create subscription with missing scope
Pass Create subscription with incorrect scope
Pass Get subscription with missing credentials
Pass Get subscription with invalid credentials
Pass Get subscription with missing scope
Pass Get subscription with incorrect scope
Pass Mutate subscription with missing credentials
Pass Mutate subscription with invalid credentials
Pass Mutate subscription with missing scope
Pass Mutate subscription with incorrect scope
Pass Delete subscription with missing credentials
Pass Delete subscription with invalid credentials
Pass Delete subscription with missing scope
Pass Delete subscription with incorrect scope
Pass Search subscriptions with missing credentials
Pass Search subscriptions with invalid credentials
Pass Search subscriptions with missing scope
Pass Search subscriptions with incorrect scope
Pass Operational intents endpoints authentication Create operational intent reference with missing credentials
Pass Create operational intent reference with invalid credentials
Pass Create operational intent reference with missing scope
Pass Create operational intent reference with incorrect scope
Pass Get operational intent reference with missing credentials
Pass Get operational intent reference with invalid credentials
Pass Get operational intent reference with missing scope
Pass Get operational intent reference with incorrect scope
Pass Mutate operational intent reference with missing credentials
Pass Mutate operational intent reference with invalid credentials
Pass Mutate operational intent reference with missing scope
Pass Mutate operational intent reference with incorrect scope
Pass Delete operational intent reference with missing credentials
Pass Delete operational intent reference with invalid credentials
Pass Delete operational intent reference with missing scope
Pass Delete operational intent reference with incorrect scope
Pass Search operational intent references with missing credentials
Pass Search operational intent references with invalid credentials
Pass Search operational intent references with missing scope
Pass Search operational intent references with incorrect scope
Pass Availability endpoints authentication Read availability with missing credentials
Pass Read availability with invalid credentials
Pass Read availability with missing scope
Pass Read availability with incorrect scope
Pass Set availability with missing credentials
Pass Set availability with invalid credentials
Pass Set availability with missing scope
Pass Set availability with incorrect scope
Pass Constraint reference endpoints authentication Create constraint reference with missing credentials
Pass Create constraint reference with invalid credentials
Pass Create constraint reference with missing scope
Pass Create constraint reference with incorrect scope
Pass Get constraint reference with missing credentials
Pass Get constraint reference with invalid credentials
Pass Get constraint reference with missing scope
Pass Get constraint reference with incorrect scope
Pass Mutate constraint reference with missing credentials
Pass Mutate constraint reference with invalid credentials
Pass Mutate constraint reference with missing scope
Pass Mutate constraint reference with incorrect scope
Pass Delete constraint reference with missing credentials
Pass Delete constraint reference with invalid credentials
Pass Delete constraint reference with missing scope
Pass Delete constraint reference with incorrect scope
Pass Search constraint references with missing credentials
Pass Search constraint references with invalid credentials
Pass Search constraint references with missing scope
Pass Search constraint references with incorrect scope
DSS0215 Pass ASTM SCD DSS: Constraint Reference Synchronization CR synchronization Retrieve newly created CR Constraint reference can be found at every DSS (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Newly created CR can be consistently retrieved from all DSS instances (3x)
Not tested Propagated constraint reference general area is synchronized
Pass Search for newly created CR Propagated constraint reference general area is synchronized (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Newly created CR can be consistently searched for from all DSS instances (3x)
Not tested Constraint reference can be found at every DSS
Pass Retrieve updated CR Constraint reference can be found at every DSS (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Updated CR can be consistently retrieved from all DSS instances (3x)
Not tested Propagated constraint reference general area is synchronized
Pass Search for updated CR Propagated constraint reference general area is synchronized (3x)
Pass Propagated constraint reference contains the correct manager (3x)
Pass Propagated constraint reference contains the correct USS base URL (3x)
Pass Propagated constraint reference contains the correct start time (3x)
Pass Propagated constraint reference contains the correct end time (3x)
Pass Updated CR can be consistently searched for from all DSS instances (3x)
Not tested Constraint reference can be found at every DSS
Pass Query deleted CR Deleted CR cannot be retrieved from all DSS instances (3x)
Pass Deleted CR cannot be searched for from all DSS instances (3x)
Pass ASTM SCD DSS: Operational Intent Reference Synchronization OIR synchronization Retrieve newly created OIR Operational intent reference can be found at every DSS (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Newly created OIR can be consistently retrieved from all DSS instances (3x)
Not tested Propagated operational intent reference general area is synchronized
Pass Search for newly created OIR Propagated operational intent reference general area is synchronized (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Pass Newly created OIR can be consistently searched for from all DSS instances (3x)
Not tested Operational intent reference can be found at every DSS
Pass Retrieve updated OIR Operational intent reference can be found at every DSS (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Not tested Propagated operational intent reference general area is synchronized
Pass Search for updated OIR Propagated operational intent reference general area is synchronized (3x)
Pass Propagated operational intent reference contains the correct manager (3x)
Pass Propagated operational intent reference contains the correct USS base URL (3x)
Pass Propagated operational intent reference contains the correct state (3x)
Pass Propagated operational intent reference contains the correct start time (3x)
Pass Propagated operational intent reference contains the correct end time (3x)
Not tested Operational intent reference can be found at every DSS
Pass ASTM SCD DSS: Subscription Synchronization Subscription Synchronization Query newly created subscription Subscription can be found at every DSS (3x)
Pass Propagated subscription contains the correct USS base URL (3x)
Pass Propagated subscription contains the correct start time (3x)
Pass Propagated subscription contains the correct end time (3x)
Pass Propagated subscription contains the correct version (3x)
Pass Propagated subscription contains the correct notification flags (3x)
Pass Propagated subscription contains the correct implicit flag (3x)
Pass Propagated subscription contains expected notification count (3x)
Pass Secondary DSS returns the subscription in searches for area that contains it (3x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (3x)
Pass Query updated subscription Subscription can be found at every DSS (3x)
Pass Propagated subscription contains the correct USS base URL (3x)
Pass Propagated subscription contains the correct start time (3x)
Pass Propagated subscription contains the correct end time (3x)
Pass Propagated subscription contains the correct version (3x)
Pass Propagated subscription contains the correct notification flags (3x)
Pass Propagated subscription contains the correct implicit flag (3x)
Pass Propagated subscription contains expected notification count (3x)
Pass Secondary DSS returns the subscription in searches for area that contains it (3x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (3x)
Pass Verify mutation on all secondaries Subscription can be found at every DSS (6x)
Pass Propagated subscription contains the correct USS base URL (6x)
Pass Propagated subscription contains the correct start time (6x)
Pass Propagated subscription contains the correct end time (6x)
Pass Propagated subscription contains the correct version (6x)
Pass Propagated subscription contains the correct notification flags (6x)
Pass Propagated subscription contains the correct implicit flag (6x)
Pass Propagated subscription contains expected notification count (6x)
Pass Secondary DSS returns the subscription in searches for area that contains it (6x)
Pass Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription (6x)
Pass Query deleted subscription DSS should not return the deleted subscription (3x)
Pass Delete subscriptions on secondaries DSS should not return the deleted subscription (9x)
Pass ASTM SCD DSS: USS Availability Synchronization Setup Ensure test USS has Unknown availability USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass USS Availability synchronization Check Normal USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Check Down USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Check Unknown USS availability broadcast USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
Pass Unknown USS state is reported as Unknown Query all DSS instances with an unknown USS identifier USS Availability is consistent across every DSS instance (3x)
Pass USS Availability version is consistent across every DSS instance (3x)
DSS0300 Pass ASTM F3548-21 UTM DSS interoperability Prerequisites Test environment requirements DSS instance is reachable (2x)
Not tested DSS instance is publicly addressable