astm .f3411 .v22a |
DSS0010 |
Pass |
ASTM NetRID DSS: Token Validation
|
Token validation
|
Token validation
|
Missing token prevents creating an ISA
|
Pass |
Missing token prevents reading an ISA
|
Pass |
Missing token prevents mutating an ISA
|
Pass |
Missing token cannot search for ISAs
|
Pass |
Missing token prevents ISA deletion
|
DSS0020 |
Not tested |
ASTM NetRID DSS: Endpoint encryption
|
Validate endpoint encryption
|
Attempt GET on a known valid path via HTTP
|
HTTP GET fails or redirects to HTTPS
|
Not tested |
Attempt GET on a known valid path via HTTPS
|
HTTPS GET succeeds
|
DSS0030,a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S5
|
ISA response code
(2x)
|
Pass |
ISA response format
(2x)
|
Pass |
ISA ID matches
(2x)
|
Pass |
ISA start time matches
(2x)
|
Pass |
ISA end time matches
(2x)
|
Pass |
ISA URL matches
(2x)
|
Not tested |
ISA version changed
|
Pass |
S1
|
ISA response code
|
Pass |
ISA response format
|
Pass |
ISA ID matches
|
Pass |
ISA start time matches
|
Pass |
ISA end time matches
|
Pass |
ISA URL matches
|
Not tested |
ISA version changed
|
Pass |
S10
|
ISA response code
|
Pass |
ISA response format
|
Pass |
ISA ID matches
|
Pass |
ISA start time matches
|
Pass |
ISA end time matches
|
Pass |
ISA URL matches
|
Not tested |
ISA version changed
|
Pass |
S12
|
ISA response code
|
Pass |
ISA response format
|
Pass |
ISA ID matches
|
Pass |
ISA start time matches
|
Pass |
ISA end time matches
|
Pass |
ISA URL matches
|
Not tested |
ISA version changed
|
Not tested |
S11
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
S15
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Pass |
ASTM NetRID DSS: Concurrent Requests
|
Concurrent Requests
|
Create ISA concurrently
|
ISA response format
(100x)
|
Pass |
ISA ID matches
(100x)
|
Pass |
ISA start time matches
(100x)
|
Pass |
ISA end time matches
(100x)
|
Pass |
ISA URL matches
(100x)
|
Pass |
Concurrent ISAs creation
|
Not tested |
ISA response code
|
Not tested |
ISA version changed
|
Pass |
Get ISAs concurrently
|
ISA start time matches
(100x)
|
Pass |
ISA end time matches
(100x)
|
Pass |
ISA URL matches
(100x)
|
Pass |
Search Available ISAs
|
ISA start time matches
(100x)
|
Pass |
ISA end time matches
(100x)
|
Pass |
ISA URL matches
(100x)
|
Pass |
Delete ISAs concurrently
|
ISA start time matches
(100x)
|
Pass |
ISA end time matches
(100x)
|
Pass |
ISA URL matches
(100x)
|
Not tested |
Search Deleted ISAs
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Pass |
ASTM NetRID DSS: ISA Expiry
|
ISA Expiry
|
ISA Expiry
|
Create short-lived ISA
|
Pass |
ASTM NetRID DSS: ISA Subscription Interactions
|
ISA Subscription Interactions
|
New Subscription within ISA
|
Create an ISA
|
Pass |
Mutate the ISA
|
Pass |
Response to the mutation of the ISA contains subscription ID
|
Pass |
Subscription to an ISA has its notification index incremented after mutation
|
Pass |
Subscription to an ISA has its notification index incremented after deletion
|
Pass |
New subscription within ISA is mutated to ISA boundary
|
Create an ISA
|
Pass |
Mutate the ISA
|
Pass |
Response to the mutation of the ISA contains subscription ID
|
Pass |
Subscription to an ISA has its notification index incremented after mutation
|
Pass |
Subscription to an ISA has its notification index incremented after deletion
|
Pass |
ASTM NetRID DSS: Simple ISA
|
Create and check ISA
|
Create ISA
|
ISA response code
|
Pass |
ISA response format
|
Pass |
ISA ID matches
|
Pass |
ISA start time matches
|
Pass |
ISA end time matches
|
Pass |
ISA URL matches
|
Pass |
ISA created
|
Not tested |
ISA version changed
|
Pass |
Update and search ISA
|
Update ISA
|
ISA response code
|
Pass |
ISA response format
|
Pass |
ISA ID matches
|
Pass |
ISA start time matches
|
Pass |
ISA end time matches
|
Pass |
ISA URL matches
|
Pass |
ISA updated
|
Not tested |
ISA version changed
|
Not tested |
Search by earliest time (included)
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
Search by earliest time (excluded)
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
Search by latest time (included)
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
Search by latest time (excluded)
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
Search by area only
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
Delete ISA
|
Delete ISA
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Not tested |
Search ISA
|
ISA start time matches
|
Not tested |
ISA end time matches
|
Not tested |
ISA URL matches
|
Pass |
ASTM NetRID DSS: Submitted ISA Validations
|
ISA Validation
|
ISA Validation
|
ISA huge area
|
Pass |
ISA empty vertices
|
Pass |
ISA start time in the past
|
Pass |
ISA start time after end time
|
Pass |
ISA vertices are valid
|
Pass |
ISA missing outline
|
Pass |
ISA missing volume
|
Not tested |
ISA missing extents
|
Pass |
ASTM NetRID DSS: Token Validation
|
Token validation
|
Token validation
|
Read scope cannot create an ISA
|
Pass |
Fake token prevents creating an ISA
|
Pass |
ISA response code
|
Pass |
ISA response format
|
Pass |
ISA ID matches
|
Pass |
ISA start time matches
|
Pass |
ISA end time matches
|
Pass |
ISA URL matches
|
Pass |
Correct token and scope can create ISA
|
Pass |
Read scope cannot mutate an ISA
|
Pass |
Fake token cannot mutate an ISA
|
Not tested |
ISA version changed
|
DSS0030,b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S11
|
ISA response format
(2x)
|
Pass |
ISA ID matches
(2x)
|
Pass |
ISA version matches
(2x)
|
Pass |
S15
|
ISA response format
(2x)
|
Pass |
ISA ID matches
(2x)
|
Pass |
ISA version matches
(2x)
|
Pass |
ASTM NetRID DSS: Concurrent Requests
|
Concurrent Requests
|
Delete ISAs concurrently
|
ISA response format
(100x)
|
Pass |
ISA ID matches
(100x)
|
Pass |
ISA version matches
(100x)
|
Pass |
ISAs deletion query success
|
Pass |
ASTM NetRID DSS: ISA Subscription Interactions
|
ISA Subscription Interactions
|
New Subscription within ISA
|
Response to the deletion of the ISA contains subscription ID
|
Pass |
New subscription within ISA is mutated to ISA boundary
|
Response to the deletion of the ISA contains subscription ID
|
Pass |
ASTM NetRID DSS: Simple ISA
|
Delete ISA
|
Delete with wrong version
|
Delete request rejected
|
Pass |
Delete with empty version
|
Delete request rejected
|
Pass |
Delete ISA
|
ISA response format
(2x)
|
Pass |
ISA ID matches
(2x)
|
Pass |
ISA version matches
(2x)
|
Pass |
ISA deleted
|
Pass |
ASTM NetRID DSS: Token Validation
|
Token validation
|
Token validation
|
Read scope cannot delete an ISA
|
Pass |
Fake token cannot delete an ISA
|
Pass |
Correct token and scope can delete ISA
|
DSS0030,c |
Pass |
ASTM NetRID DSS: ISA Subscription Interactions
|
ISA Subscription Interactions
|
New Subscription within ISA
|
Create a subscription within the ISA footprint
|
Pass |
Subscription for the ISA's area mentions the ISA
|
Pass |
Newly created subscription has a notification_index of 0
|
Pass |
New subscription within ISA is mutated to ISA boundary
|
Create a subscription within the ISA footprint
|
Pass |
Mutate the subscription towards the ISA boundary
|
Pass |
Subscription for the ISA's area mentions the ISA
|
Pass |
Mutated subscription has a notification_index of 0
|
Not tested |
Subscription that only barely overlaps the ISA contains the ISA
|
Pass |
ASTM NetRID DSS: Subscription Simple
|
Subscription Simple
|
Create subscription validation
|
Create subscription
(4x)
|
Pass |
Response to subscription creation contains a subscription
(4x)
|
Pass |
Returned subscription has an ID
(4x)
|
Pass |
Returned subscription ID is correct
(4x)
|
Pass |
Returned subscription has an owner
(4x)
|
Pass |
Returned subscription owner is correct
(4x)
|
Pass |
Returned subscription has an ISA URL
(4x)
|
Pass |
Returned ISA URL has correct base URL
(4x)
|
Pass |
Returned subscription has a start time
(4x)
|
Pass |
Returned subscription has a version
(4x)
|
Pass |
Generated subscription version has proper format
(4x)
|
Pass |
Returned notification index is 0 if present
(4x)
|
Pass |
Returned end time is correct
(2x)
|
Pass |
Returned start time is correct
(2x)
|
Pass |
Mutate Subscription
|
Subscription can be mutated
(8x)
|
Pass |
Response to subscription mutation contains a subscription
(8x)
|
Pass |
Returned subscription has an ID
(8x)
|
Pass |
Returned subscription ID is correct
(8x)
|
Pass |
Returned subscription has an owner
(8x)
|
Pass |
Returned subscription owner is correct
(8x)
|
Pass |
Returned subscription has an ISA URL
(8x)
|
Pass |
Returned ISA URL has correct base URL
(8x)
|
Pass |
Returned subscription has a start time
(8x)
|
Pass |
Returned start time is correct
(8x)
|
Pass |
Returned end time is correct
(8x)
|
Pass |
Returned subscription has a version
(8x)
|
Pass |
Generated subscription version has proper format
(8x)
|
Pass |
Mutated subscription version is updated
(8x)
|
Pass |
Query Existing Subscription
|
Returned subscription has an ID
(8x)
|
Pass |
Returned subscription ID is correct
(8x)
|
Pass |
Returned subscription has an owner
(8x)
|
Pass |
Returned subscription owner is correct
(8x)
|
Pass |
Returned subscription has an ISA URL
(8x)
|
Pass |
Returned ISA URL has correct base URL
(8x)
|
Pass |
Returned subscription has a start time
(8x)
|
Pass |
Returned start time is correct
(8x)
|
Pass |
Returned end time is correct
(8x)
|
Pass |
Returned subscription has a version
(8x)
|
Pass |
Generated subscription version has proper format
(8x)
|
Pass |
Non-mutated subscription keeps the same version
(8x)
|
Pass |
Delete Subscription
|
Returned subscription has an ID
(4x)
|
Pass |
Returned subscription ID is correct
(4x)
|
Pass |
Returned subscription has an owner
(4x)
|
Pass |
Returned subscription owner is correct
(4x)
|
Pass |
Returned subscription has an ISA URL
(4x)
|
Pass |
Returned ISA URL has correct base URL
(4x)
|
Pass |
Returned subscription has a start time
(4x)
|
Pass |
Returned start time is correct
(4x)
|
Pass |
Returned end time is correct
(4x)
|
Pass |
Returned subscription has a version
(4x)
|
Pass |
Generated subscription version has proper format
(4x)
|
Pass |
Non-mutated subscription keeps the same version
(4x)
|
Pass |
ASTM NetRID DSS: Subscription Validation
|
Subscription duration limitations
|
Try to extend subscription
|
Valid subscription created
|
Pass |
Subscription quantity limitations
|
Create maximum number of subscriptions
|
Create up to the maximum allowed number of subscriptions in an area
|
DSS0030,d |
Not tested |
ASTM NetRID DSS: Concurrent Requests
|
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Not tested |
ASTM NetRID DSS: ISA Expiry
|
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Pass |
ASTM NetRID DSS: ISA Subscription Interactions
|
ISA Subscription Interactions
|
New Subscription within ISA
|
Delete the ISA
|
Pass |
Subscription can be deleted
|
Pass |
New subscription within ISA is mutated to ISA boundary
|
Delete the ISA
|
Pass |
Subscription can be deleted
|
Not tested |
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Not tested |
ASTM NetRID DSS: Simple ISA
|
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Not tested |
ASTM NetRID DSS: Submitted ISA Validations
|
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Pass |
ASTM NetRID DSS: Subscription Simple
|
Subscription Simple
|
Delete Subscription
|
Missing version prevents deletion
(4x)
|
Pass |
Incorrect version prevents deletion
(4x)
|
Pass |
Subscription can be deleted
(4x)
|
Not tested |
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Pass |
ASTM NetRID DSS: Subscription Validation
|
Subscription duration limitations
|
Remove subscription
|
Subscription deleted
|
Pass |
Subscription quantity limitations
|
Clean up subscriptions
|
Subscription can be deleted
(10x)
|
Not tested |
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
Not tested |
ASTM NetRID DSS: Token Validation
|
Setup
|
Ensure clean workspace
|
Removed pre-existing ISA
|
Not tested |
Subscription can be deleted
|
DSS0030,e |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[n] search returned with proper response
|
Not tested |
ASTM NetRID DSS: Concurrent Requests
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Not tested |
ASTM NetRID DSS: ISA Expiry
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Not tested |
ASTM NetRID DSS: ISA Subscription Interactions
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Not tested |
ASTM NetRID DSS: Simple ISA
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Not tested |
ASTM NetRID DSS: Submitted ISA Validations
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Pass |
ASTM NetRID DSS: Subscription Simple
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
(4x)
|
Pass |
Subscription Simple
|
Query Existing Subscription
|
Get Subscription by ID
(4x)
|
Pass |
Returned notification index is equal to or greater than 0
(8x)
|
Pass |
Delete Subscription
|
Returned notification index is equal to or greater than 0
(4x)
|
Pass |
Query Deleted Subscription
|
Query by subscription ID should fail
(4x)
|
Not tested |
Mutate Subscription
|
Returned notification index is equal to or greater than 0
|
Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
(4x)
|
Not tested |
ASTM NetRID DSS: Subscription Validation
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Not tested |
ASTM NetRID DSS: Token Validation
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
DSS0030,f |
Not tested |
ASTM NetRID DSS: Concurrent Requests
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Not tested |
ASTM NetRID DSS: ISA Expiry
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
ASTM NetRID DSS: ISA Subscription Interactions
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
(2x)
|
Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
(2x)
|
Not tested |
ASTM NetRID DSS: Simple ISA
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Not tested |
ASTM NetRID DSS: Submitted ISA Validations
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
ASTM NetRID DSS: Subscription Simple
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription Simple
|
Query Existing Subscription
|
Search for all subscriptions in ISA area
|
Pass |
Created Subscription is in search results
(4x)
|
Pass |
No huge search area allowed
|
Pass |
Query Deleted Subscription
|
Search for all subscriptions in ISA area
|
Pass |
Deleted subscription should not be present in search results
|
Pass |
Search area that represents a loop is not allowed
|
Pass |
ASTM NetRID DSS: Subscription Validation
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription quantity limitations
|
Clean up subscriptions
|
Successful subscription search query
|
Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
Not tested |
ASTM NetRID DSS: Token Validation
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
DSS0040 |
Not tested |
Not implemented |
DSS0050 |
Pass |
ASTM NetRID DSS: Subscription Validation
|
Subscription quantity limitations
|
Exceed maximum number of subscriptions
|
Enforce maximum number of subscriptions for an area
|
DSS0060 |
Pass |
ASTM NetRID DSS: Subscription Simple
|
Subscription Simple
|
Create subscription validation
|
Returned subscription has an end time
(4x)
|
Pass |
Mutate Subscription
|
Returned subscription has an end time
(8x)
|
Pass |
Query Existing Subscription
|
Returned subscription has an end time
(8x)
|
Pass |
Delete Subscription
|
Returned subscription has an end time
(4x)
|
Pass |
ASTM NetRID DSS: Subscription Validation
|
Subscription duration limitations
|
Try to create too-long subscription
|
Too-long subscription creation rejected
|
Pass |
Try to extend subscription
|
Subscription duration limited during update
|
DSS0070 |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] returned with proper response
(2x)
|
Pass |
S4
|
Can query all Subscriptions in area from all DSSs
(2x)
|
Pass |
S7
|
404 with proper response
(2x)
|
Pass |
S8
|
No Subscription[i] 1≤i≤n returned with proper response
(2x)
|
Pass |
S9
|
service_areas does not include ISA from S1
(2x)
|
Pass |
S13
|
No Subscription[i] 1≤i≤n returned with proper response
(2x)
|
Pass |
S16
|
service_areas does not include ISA from S12
(2x)
|
DSS0110 |
Not tested |
ASTM NetRID DSS: Direct CRDB access
|
Verify security interoperability
|
Attempt to connect in insecure mode
|
Node runs in secure mode
|
DSS0120 |
Not tested |
ASTM NetRID DSS: Direct CRDB access
|
Verify security interoperability
|
Attempt to connect in insecure mode
|
Node runs in secure mode
|
Not tested |
Attempt to connect with legacy encryption protocol
|
Node rejects legacy encryption protocols
|
DSS0130,1 |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] cell ID is properly synchronized with all DSS
|
DSS0130,2,a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] ID is properly synchronized with all DSS
|
DSS0130,2,b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] owner is properly synchronized with all DSS
|
DSS0130,2,c |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] URL is properly synchronized with all DSS
|
DSS0130,2,d |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] start/end times are properly synchronized with all DSS
|
DSS0130,2,e |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S5
|
ISA modification on secondary DSS triggers subscription notification requests
(2x)
|
DSS0130,2,f |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] notification count is properly synchronized with all DSS
|
DSS0130,3,a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
ID of ISA from S1 is properly synchronized with all DSS
|
Pass |
S5
|
Can get ISA from primary DSS
|
DSS0130,3,b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
Owner of ISA from S1 is properly synchronized with all DSS
|
DSS0130,3,c |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
URL of ISA from S1 is properly synchronized with all DSS
|
DSS0130,3,d |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
Start/end times of ISA from S1 are properly synchronized with all DSS
|
DSS0130,3,e |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
service_areas includes ISA from S1
(2x)
|
DSS0130,A2-6-1,1a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S1
|
ISA[P] created with proper response
|
Pass |
S10
|
ISA[P] created with proper response
|
Pass |
S12
|
ISA[P] created with proper response
|
DSS0130,A2-6-1,1b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S5
|
Can modify ISA on secondary DSS
|
Pass |
Can modify ISA in primary DSS
|
DSS0130,A2-6-1,1c |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
service_areas includes ISA from S1
(2x)
|
Pass |
S9
|
Subscription[n] created with proper response
(2x)
|
DSS0130,A2-6-1,1d |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S9
|
service_areas does not include ISA from S1
(2x)
|
DSS0130,A2-6-1,2a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S11
|
ISA[P] deleted with proper response
|
Pass |
S15
|
ISA[P] deleted with proper response
|
Pass |
Cleanup
|
Cleanup
|
ISA deleted with proper response
(3x)
|
DSS0130,A2-6-1,2b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S16
|
service_areas does not include ISA from S12
(2x)
|
DSS0130,A2-6-1,3a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S2
|
Subscription[n] created with proper response
(2x)
|
Pass |
S16
|
Subscription[n] created with proper response
(2x)
|
DSS0130,A2-6-1,3b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S10
|
All Subscription[i] 1≤i≤n returned in subscribers
|
DSS0130,A2-6-1,3c |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S5
|
ISA modification on secondary DSS triggers subscription notification requests
(2x)
|
Pass |
ISA modification on primary DSS triggers subscription notification requests
|
Pass |
S11
|
All Subscription[i] 1≤i≤n returned in subscribers
|
DSS0130,A2-6-1,3d |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S13
|
No Subscription[i] 1≤i≤n returned with proper response
(2x)
|
Pass |
S12
|
None of Subscription[i] 1≤i≤n returned in subscribers
|
Pass |
S15
|
None of Subscription[i] 1≤i≤n returned in subscribers with proper response
|
Not tested |
S14
|
404 with proper response
|
DSS0130,A2-6-1,4a |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S6
|
Subscription[n] deleted with proper response
(2x)
|
Pass |
S17
|
Subscription[n] deleted with proper response
(2x)
|
Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
(6x)
|
Pass |
Subscription can be deleted
(2x)
|
DSS0130,A2-6-1,4b |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S7
|
404 with proper response
(2x)
|
Pass |
S8
|
No Subscription[i] 1≤i≤n returned with proper response
(2x)
|
DSS0130,A2-6-1,5 |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[P] returned with proper response
(2x)
|
DSS0130,A2-6-1,6 |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Interoperability sequence
|
S3
|
Subscription[n] search returned with proper response
|
Pass |
S4
|
Can query all Subscriptions in area from all DSSs
(2x)
|
Pass |
S8
|
Subscriptions queried successfully
(2x)
|
Pass |
S13
|
Subscriptions queried successfully
(2x)
|
DSS0210 |
Pass |
ASTM F3411-22a NetRID DSS interoperability
|
Prerequisites
|
Test environment requirements
|
DSS instance is reachable
(2x)
|
Not tested |
DSS instance is publicly addressable
|
NET0010 |
Not tested |
Not implemented |
NET0020 |
Not tested |
Not implemented |
NET0030 |
Not tested |
ASTM NetRID: Operator interactions
|
In-flight notifications
|
Poll Service Provider
|
Missing data operator notification
|
NET0040 |
Not tested |
ASTM NetRID: Operator interactions
|
In-flight notifications
|
Poll Service Provider
|
Insufficient telemetry operator notification
|
NET0210 |
Not tested |
ASTM NetRID SP clients misbehavior handling
|
Unauthenticated requests
|
Unauthenticated requests
|
Missing credentials
|
NET0220 |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Verify https is in use
|
Verify https is in use
|
All interactions happen over https
|
NET0230 |
Not tested |
Not implemented |
NET0240 |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Mock USS interactions evaluation
|
Evaluate mock USS interactions
|
No large Display Provider queries
|
NET0250 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Area too large
|
NET0260,NearRealTime |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Lingering flight
|
Not tested |
Observer polling
|
Lingering flight
|
NET0260,NetSpDataResponseTime95thPercentile |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Performance of Service Providers requests
|
Performance of /flights?view requests
|
95th percentile response time
|
NET0260,NetSpDataResponseTime99thPercentile |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Performance of Service Providers requests
|
Performance of /flights?view requests
|
99th percentile response time
|
NET0260,Table1,1 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
UAS ID presence in flight details
|
NET0260,Table1,1a |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
UAS ID (Serial Number format) consistency with Common Dictionary
|
NET0260,Table1,2 |
Not tested |
Not implemented |
NET0260,Table1,4 |
Not tested |
Not implemented |
NET0260,Table1,5 |
Not tested |
Not implemented |
NET0260,Table1,6 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider timestamp accuracy is correct
|
NET0260,Table1,7 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Operational Status consistency with Common Dictionary
|
NET0260,Table1,9 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Operator ID consistency with Common Dictionary
|
NET0260,Table1,10 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Missing flight
|
Not tested |
Observer polling
|
Missing flight
|
NET0260,Table1,11 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Missing flight
|
Not tested |
Observer polling
|
Missing flight
|
NET0260,Table1,12 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider altitude
|
NET0260,Table1,14 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider height
|
NET0260,Table1,16 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider geodetic altitude accuracy
|
NET0260,Table1,17 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider horizontal accuracy
|
NET0260,Table1,18 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider speed accuracy
|
NET0260,Table1,19 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider track
|
NET0260,Table1,20 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider speed
|
NET0260,Table1,21 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Service Provider vertical speed
|
NET0260,Table1,23 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Operator Location consistency with Common Dictionary
|
NET0260,Table1,24 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Operator Location consistency with Common Dictionary
|
NET0270 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Recent positions timestamps
|
Not tested |
Recent positions for aircraft crossing the requested area boundary show only one position before or after crossing
|
NET0290 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Telemetry being used when present
|
NET0320 |
Not tested |
Not implemented |
NET0340 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Flights data format
|
NET0410 |
Not tested |
Not implemented |
NET0420 |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Performance of Display Providers requests
|
Performance of /display_data requests
|
Performance of /display_data initial requests
|
NET0430 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Area too large
|
NET0440 |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Performance of Display Providers requests
|
Performance of /display_data requests
|
Performance of /display_data subsequent requests
|
NET0450 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Operational Status is consistent with injected one
|
Not tested |
Observer polling
|
Correct up-to-date altitude if present
|
Not tested |
Observed timestamp is consistent with injected one
|
Not tested |
Observed Position is consistent with injected one
|
Not tested |
Height is consistent with injected one
|
Not tested |
Observed track is consistent with injected one
|
Not tested |
Observed speed is consistent with injected one
|
Not tested |
UAS ID is consistent with injected one
|
Not tested |
Operator ID is consistent with injected one
|
Not tested |
Operator Location is consistent with injected one
|
Not tested |
Operator Altitude is consistent with injected one
|
Not tested |
Operator Altitude Type is consistent with injected one
|
NET0460 |
Not tested |
ASTM F3411-22a NetRID aggregate checks
|
Performance of Display Providers requests
|
Performance of /display_data/ requests
|
Performance of /display_data/ requests
|
NET0470,Table1,1a |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
UAS ID (Serial Number format) consistency with Common Dictionary
|
NET0470,Table1,5 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Timestamp consistency with Common Dictionary
|
NET0470,Table1,7 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Operational Status consistency with Common Dictionary
|
NET0470,Table1,9 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Operator ID consistency with Common Dictionary
|
NET0470,Table1,10 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Current Position consistency with Common Dictionary
|
NET0470,Table1,11 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Current Position consistency with Common Dictionary
|
NET0470,Table1,14 |
Not tested |
Not implemented |
NET0470,Table1,15 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Height Type consistency with Common Dictionary
|
NET0470,Table1,19 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Track Direction consistency with Common Dictionary
|
NET0470,Table1,20 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Speed consistency with Common Dictionary
|
NET0470,Table1,23 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Operator Location consistency with Common Dictionary
|
NET0470,Table1,24 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Operator Location consistency with Common Dictionary
|
NET0480 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Minimal obfuscation distance of multiple flights clusters
|
Not tested |
Clustering count
|
Not tested |
Minimal display area of clusters
|
NET0490 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Observer polling
|
Minimal obfuscation distance of individual flights
|
Not tested |
Individual flights obfuscation
|
NET0500 |
Not tested |
ASTM NetRID SP clients misbehavior handling
|
Unauthenticated requests
|
Injection
|
Successful injection
|
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Injection
|
Successful injection
|
NET0610 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Missing flight
|
Not tested |
Observer polling
|
Missing flight
|
Not tested |
ASTM NetRID: Operator interactions
|
Failed ISA
|
Inject flight
|
Flight failed
|
NET0620 |
Not tested |
ASTM NetRID: Operator interactions
|
Failed ISA
|
Enumerate operator notifications
|
Operator notified of discoverability failure
|
NET0630 |
Not tested |
Not implemented |
NET0710,1 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Missing flight
|
Not tested |
Flights data format
|
Not tested |
Service Provider timestamp accuracy is present
|
Not tested |
Observer polling
|
Missing flight
|
NET0710,2 |
Not tested |
ASTM NetRID nominal behavior
|
Nominal flight
|
Service Provider polling
|
Successful flight details query
|
Not tested |
Flight details data format
|
NET0720 |
Not tested |
Not implemented |
NET0730 |
Not tested |
ASTM NetRID DSS: Concurrent Requests
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: ISA Expiry
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: ISA Subscription Interactions
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ISA Subscription Interactions
|
New Subscription within ISA
|
Notified subscriber
|
Not tested |
New subscription within ISA is mutated to ISA boundary
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: Simple ISA
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: Submitted ISA Validations
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: Subscription Simple
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: Subscription Validation
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
ASTM NetRID DSS: Token Validation
|
Setup
|
Ensure clean workspace
|
Notified subscriber
|
Not tested |
Token validation
|
Token validation
|
Notified subscriber
|
NET0740 |
Not tested |
Not implemented |
astm .f3548 .v21 |
DSS0005,1 |
Not tested |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Clear area validation
|
DSS responses
|
Not tested |
uss_qualifier preparation
|
Remove uss_qualifier op intents
|
Operational intent references can be queried by ID
|
Not tested |
Operational intent reference removed
|
Not tested |
Clear area validation
|
DSS responses
|
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(2x)
|
Not tested |
Operational intent reference removed
|
Pass |
Create operational intent references with different credentials
|
Can create an operational intent with valid credentials
(2x)
|
Pass |
Attempt unauthorized operational intent reference modification
|
Attempt unauthorized operational intent reference modification
|
Operational intent references can be queried directly by their ID
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
(2x)
|
Pass |
Operational intent reference removed
|
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
Not tested |
Operational intent reference removed
|
Pass |
Attempt unauthorized state creation
|
Attempt direct creation with unauthorized state
|
Direct Nonconforming state creation is forbidden
|
Pass |
Direct Contingent state creation is forbidden
|
Pass |
Attempt unauthorized state transitions
|
Create an Accepted OIR
|
Creation of an Accepted OIR is allowed
|
Pass |
Transition the OIR to Activated
|
Transition from Accepted to Activated is allowed
|
Pass |
Transition the OIR to Ended
|
Transition from Activated to Ended is allowed
|
Pass |
Attempt transition of an ended operational intent reference to an unauthorized state
|
Transition from Ended to Nonconforming is forbidden
|
Pass |
Transition from Ended to Contingent is forbidden
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
Pass |
Operational intent reference removed
|
Pass |
ASTM SCD DSS: Implicit Subscription handling
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
Not tested |
Operational intent reference removed
|
Pass |
Single OIR implicit subscription is removed upon OIR deletion
|
Create an OIR with implicit subscription
|
Create operational intent reference query succeeds
|
Pass |
An implicit subscription was created and can be queried
|
Pass |
Implicit subscription has correct temporal parameters
|
Pass |
Delete the OIR with implicit subscription
|
Delete operational intent reference query succeeds
|
Pass |
The implicit subscription was removed
|
Pass |
After removal of the only created OIR, subscriptions should be as before its creation
|
Not tested |
Delete operational intent reference response format conforms to spec
|
Not tested |
Delete operational intent reference response content is correct
|
Pass |
Implicit subscriptions always properly cover their OIR
|
Create an OIR with implicit subscription
|
Create operational intent reference query succeeds
|
Pass |
An implicit subscription was created and can be queried
|
Pass |
Implicit subscription has correct temporal parameters
|
Pass |
Create an overlapping OIR without any subscription
|
Create operational intent reference query succeeds
|
Pass |
No implicit subscription was attached
|
Pass |
New OIR creation response contains previous implicit subscription to notify
|
Pass |
Mutate OIR with implicit subscription to not overlap anymore
|
Mutate operational intent reference query succeeds
|
Pass |
The implicit subscription can be queried
|
Pass |
Implicit subscription has correct temporal parameters
|
Pass |
Non-mutated implicit subscription is deleted
|
Not tested |
Mutate operational intent reference response format conforms to spec
|
Not tested |
Mutate operational intent reference response content is correct
|
Pass |
Create an OIR overlapping with the second OIR but not the first
|
Create operational intent reference query succeeds
|
Pass |
No implicit subscription was attached
|
Pass |
Within a temporal frame not overlapping a newly created implicit subscription, subscriptions should be the same as at the start of the test case
|
Pass |
Implicit subscriptions are properly deleted when required by OIR mutation
|
Ensure clean workspace
|
Operational intent reference removed
(3x)
|
Pass |
Operational intent references can be queried by ID
(3x)
|
Pass |
Create two OIRs with implicit subscription
|
Create operational intent reference query succeeds
(2x)
|
Pass |
An implicit subscription was created and can be queried
(2x)
|
Pass |
Implicit subscription has correct temporal parameters
(2x)
|
Pass |
Update OIR with implicit subscription to use explicit subscription
|
Mutate operational intent reference query succeeds
|
Pass |
Previously attached implicit subscription was deleted
|
Pass |
Update OIR with implicit subscription to use no subscription
|
Mutate operational intent reference query succeeds
|
Pass |
Previously attached implicit subscription was deleted
|
Pass |
Implicit subscriptions are expanded as needed
|
Ensure clean workspace
|
Operational intent reference removed
(2x)
|
Pass |
Operational intent references can be queried by ID
(3x)
|
Pass |
Create an OIR with implicit subscription
|
Create operational intent reference query succeeds
|
Pass |
An implicit subscription was created and can be queried
|
Pass |
Implicit subscription has correct temporal parameters
|
Pass |
Expand the OIR while keeping the same implicit subscription
|
Mutate operational intent reference query succeeds
|
Pass |
The implicit subscription can be queried
|
Pass |
Implicit subscription has wide enough temporal parameters
|
Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
|
Pass |
Operational intent references can be queried by ID
(3x)
|
Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
Not tested |
Operational intent reference removed
|
Pass |
Endpoint authorization
|
Operational intents endpoints authentication
|
Unauthorized requests return the proper error message body
(20x)
|
Pass |
Create operational intent reference with valid credentials
|
Pass |
Create operational intent reference response format conforms to spec
|
Pass |
Get operational intent reference with valid credentials
|
Pass |
Mutate operational intent reference with valid credentials
|
Pass |
Mutate operational intent reference response format conforms to spec
|
Pass |
Delete operational intent reference with valid credentials
|
Pass |
Search operational intent references with valid credentials
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
Not tested |
Operational intent reference removed
|
Pass |
Key validation on creation
|
Create first OIR
|
First operational intent reference in area creation query succeeds
|
Pass |
Create second non-overlapping OIR
|
Second, non-overlapping operational intent reference creation succeeds
|
Pass |
Attempt OIR creation overlapping with first OIR
|
Create operational intent reference with missing OVN fails
|
Pass |
Failure response due to conflict has proper format
|
Pass |
Failure response due to conflict contains conflicting OIRs
|
Pass |
Attempt OIR creation overlapping with second OIR
|
Create operational intent reference with missing OVN fails
|
Pass |
Failure response due to conflict has proper format
|
Pass |
Failure response due to conflict contains conflicting OIRs
|
Pass |
Attempt OIR creation overlapping with both OIRs
|
Create operational intent reference with missing OVN fails
|
Pass |
Failure response due to conflict has proper format
|
Pass |
Failure response due to conflict contains conflicting OIRs
|
Pass |
Attempt valid OIR creation overlapping with both OIRs
|
Create operational intent reference with proper OVNs succeeds
|
Pass |
Key validation on mutation
|
Attempt mutation with both OVNs missing
|
Mutate operational intent reference with missing OVN fails
|
Pass |
Failure response due to conflict has proper format
|
Pass |
Failure response due to conflict contains conflicting OIRs
|
Pass |
Attempt mutation with first OVN missing
|
Mutate operational intent reference with missing OVN fails
|
Pass |
Failure response due to conflict has proper format
|
Pass |
Failure response due to conflict contains conflicting OIRs
|
Pass |
Attempt mutation to overlap with the first OIR
|
Mutate operational intent reference with missing OVN fails
|
Pass |
Failure response due to conflict has proper format
|
Pass |
Failure response due to conflict contains conflicting OIRs
|
Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
(3x)
|
Pass |
Operational intent references can be queried by ID
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Simple
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
Not tested |
Operational intent reference removed
|
Pass |
Create an operational intent reference
|
Create operational intent reference query succeeds
|
Pass |
Deletion requires correct OVN
|
Attempt deletion with missing OVN
|
Request to delete OIR with empty OVN fails
|
Pass |
Attempt deletion with incorrect OVN
|
Request to delete OIR with incorrect OVN fails
|
Pass |
Mutation requires correct OVN
|
Attempt mutation with missing OVN
|
Request to mutate OIR with empty OVN fails
|
Pass |
Attempt mutation with incorrect OVN
|
Request to mutate OIR with incorrect OVN fails
|
Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
|
Pass |
Operational intent references can be queried by ID
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Get operational intent reference by ID
(2x)
|
Pass |
Search for newly created OIR
|
Successful operational intent reference search query
(2x)
|
Pass |
Retrieve updated OIR
|
Get operational intent reference by ID
(2x)
|
Pass |
Search for updated OIR
|
Successful operational intent reference search query
(2x)
|
Pass |
Query deleted OIR
|
Get operational intent reference by ID
(2x)
|
Pass |
Successful operational intent reference search query
(2x)
|
Pass |
Create OIR validation
|
Create operational intent reference query succeeds
|
Pass |
Create operational intent reference response format conforms to spec
|
Pass |
Returned operational intent reference ID is correct
|
Pass |
Returned operational intent reference has a manager
|
Pass |
Returned operational intent reference manager is correct
|
Pass |
Returned operational intent reference has an USS base URL
|
Pass |
Returned operational intent reference base URL is correct
|
Pass |
Returned operational intent reference has a start time
|
Pass |
Returned operational intent reference has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Create operational intent reference response content is correct
|
Not tested |
Returned operational intent reference state is correct
|
Not tested |
Returned operational intent reference has a version
|
Pass |
Mutate OIR
|
Mutate operational intent reference query succeeds
|
Pass |
Mutate operational intent reference response format conforms to spec
|
Pass |
Returned operational intent reference ID is correct
|
Pass |
Returned operational intent reference has a manager
|
Pass |
Returned operational intent reference manager is correct
|
Pass |
Returned operational intent reference has an USS base URL
|
Pass |
Returned operational intent reference base URL is correct
|
Pass |
Returned operational intent reference has a start time
|
Pass |
Returned operational intent reference has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Mutated operational intent reference OVN is updated
|
Pass |
Mutated operational intent reference version is updated
|
Pass |
Mutate operational intent reference response content is correct
|
Not tested |
Returned operational intent reference state is correct
|
Not tested |
Returned operational intent reference has a version
|
Pass |
Delete OIR
|
Delete operational intent reference query succeeds
|
Pass |
Delete operational intent reference response format conforms to spec
|
Pass |
Returned operational intent reference ID is correct
|
Pass |
Returned operational intent reference has a manager
|
Pass |
Returned operational intent reference manager is correct
|
Pass |
Returned operational intent reference has an USS base URL
|
Pass |
Returned operational intent reference base URL is correct
|
Pass |
Returned operational intent reference has a start time
|
Pass |
Returned operational intent reference has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Non-mutated operational intent reference keeps the same OVN
|
Pass |
Non-mutated operational intent reference keeps the same version
|
Pass |
Delete operational intent reference response content is correct
|
Not tested |
Returned operational intent reference state is correct
|
Not tested |
Returned operational intent reference has a version
|
Pass |
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
Not tested |
Operational intent reference removed
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
OIR creation and modification does not trigger relevant notifications after subscription deletion
|
Create an OIR at every DSS in sequence
|
Create operational intent reference query succeeds
(3x)
|
Pass |
Modify an OIR at every DSS in sequence
|
Mutate operational intent reference query succeeds
(3x)
|
Pass |
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
Not tested |
Operational intent reference removed
|
Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
(3x)
|
Pass |
Operational intent references can be queried by ID
(3x)
|
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
OIR creation and modification trigger relevant notifications
|
Create an OIR at every DSS in sequence
|
Create operational intent reference query succeeds
(3x)
|
Pass |
Modify an OIR at every DSS in sequence
|
Mutate operational intent reference query succeeds
(3x)
|
Pass |
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
Not tested |
Operational intent reference removed
|
Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
(3x)
|
Pass |
Operational intent references can be queried by ID
(3x)
|
Not tested |
Nominal planning: not permitted conflict with equal priority
|
Prerequisites check
|
Verify area is clear
|
DSS responses
|
Pass |
OVN Request Optional Extension to ASTM F3548-21
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
Not tested |
Operational intent reference removed
|
Pass |
Request for OIR OVN with valid suffix
|
Create OIR with OVN suffix request
|
Create operational intent reference query succeeds
|
Pass |
Activate OIR with OVN suffix request
|
Mutate operational intent reference query succeeds
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
Pass |
Operational intent reference removed
|
Not tested |
Off-Nominal planning: down USS
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
|
Not tested |
Verify area is clear
|
DSS responses
|
Not tested |
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Virtual USS creates conflicting operational intent
|
Operational intent successfully created
|
Not tested |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
|
Not tested |
Verify area is clear
|
DSS responses
|
Not tested |
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Virtual USS creates conflicting operational intent
|
Operational intent successfully created
|
Not tested |
Virtual USS activates conflicting operational intent
|
Operational intent successfully activated
|
Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Virtual USS transitions to Nonconforming conflicting operational intent
|
Operational intent successfully transitioned to Nonconforming
|
Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Virtual USS transitions to Contingent conflicting operational intent
|
Operational intent successfully transitioned to Contingent
|
Not tested |
Solo happy path
|
Prerequisites check
|
Verify area is clear
|
DSS responses
|
DSS0005,2 |
Not tested |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Clear area validation
|
DSS responses
|
Not tested |
uss_qualifier preparation
|
Remove uss_qualifier op intents
|
Operational intent references can be searched for
|
Not tested |
Clear area validation
|
DSS responses
|
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
(3x)
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
(2x)
|
Pass |
ASTM SCD DSS: Implicit Subscription handling
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Implicit subscriptions are properly deleted when required by OIR mutation
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Implicit subscriptions are expanded as needed
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Not tested |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Pass |
ASTM SCD DSS: Operational Intent Reference Simple
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
Not tested |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
DSS responses
|
Not tested |
Mock_uss plans Flight 2
|
DSS responses
|
Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
DSS responses
|
Not tested |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
mock_uss plans flight 2
|
DSS responses
|
Not tested |
tested_uss plans flight 1
|
DSS responses
|
Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
DSS responses
|
Not tested |
tested_uss attempts to plan flight 1, expect failure
|
DSS responses
|
Not tested |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
DSS responses
|
Not tested |
Attempt to plan Flight 1
|
DSS responses
|
Not tested |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
DSS responses
|
Not tested |
Plan Flight 2
|
DSS responses
|
Not tested |
Attempt to modify planned Flight 1 in conflict
|
DSS responses
|
Not tested |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
DSS responses
|
Not tested |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
DSS responses
|
Not tested |
Plan Flight 2
|
DSS responses
|
Not tested |
Activate Flight 2
|
DSS responses
|
Not tested |
Modify activated Flight 1 in conflict with activated Flight 2
|
DSS responses
|
Not tested |
Attempt to modify activated flight in conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
DSS responses
|
Not tested |
Attempt to modify activated Flight 1 in conflict
|
DSS responses
|
Not tested |
Nominal planning: not permitted conflict with equal priority
|
Prerequisites check
|
Verify area is clear
|
DSS responses
|
Not tested |
Attempt to plan flight into conflict
|
Plan Flight 2
|
DSS responses
|
Not tested |
Activate Flight 2
|
DSS responses
|
Not tested |
Attempt to plan Flight 1
|
DSS responses
|
Not tested |
Attempt to activate flight into conflict
|
Attempt to directly activate conflicting Flight 1
|
DSS responses
|
Not tested |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
DSS responses
|
Not tested |
Attempt to modify planned Flight 1c into conflict
|
DSS responses
|
Not tested |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
DSS responses
|
Not tested |
Attempt to modify activated Flight 1c into conflict
|
DSS responses
|
Not tested |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
DSS responses
|
Not tested |
Plan Flight 2m
|
DSS responses
|
Not tested |
Declare Flight 2 non-conforming
|
DSS responses
|
Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
DSS responses
|
Pass |
OVN Request Optional Extension to ASTM F3548-21
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
Not tested |
Off-Nominal planning: down USS
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
|
Not tested |
Verify area is clear
|
DSS responses
|
Not tested |
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
DSS responses
|
Not tested |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
|
Not tested |
Verify area is clear
|
DSS responses
|
Not tested |
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Tested USS attempts to plan high-priority Flight 2
|
DSS responses
|
Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Tested USS attempts to plan high-priority Flight 2
|
DSS responses
|
Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Tested USS attempts to plan high-priority Flight 2
|
DSS responses
|
Not tested |
Solo happy path
|
Prerequisites check
|
Verify area is clear
|
DSS responses
|
Not tested |
Solo happy path
|
Plan Flight 1
|
DSS responses
|
Not tested |
Activate Flight 1
|
DSS responses
|
Not tested |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Too Far Away Flight
|
DSS responses
|
Not tested |
Attempt to plan Recently Ended Flight
|
DSS responses
|
Not tested |
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
DSS responses
|
Not tested |
Remove Valid Flight
|
DSS responses
|
Not tested |
Validate precision of intersection computations
|
Attempt to plan Tiny Overlap Conflict Flight
|
DSS responses
|
DSS0005,3 |
Pass |
ASTM SCD DSS: Constraint Reference Simple
|
Setup
|
Ensure clean workspace
|
Constraint references can be queried by ID
|
Not tested |
Constraint reference removed
|
Pass |
Create a constraint reference
|
Create constraint reference query succeeds
|
Pass |
Deletion requires correct OVN
|
Attempt deletion with missing OVN
|
Request to delete CR with empty OVN fails
|
Pass |
Attempt deletion with incorrect OVN
|
Request to delete CR with incorrect OVN fails
|
Pass |
Mutation requires correct OVN
|
Attempt mutation with missing OVN
|
Request to mutate CR with empty OVN fails
|
Pass |
Attempt mutation with incorrect OVN
|
Request to mutate CR with incorrect OVN fails
|
Pass |
Cleanup
|
Cleanup
|
Constraint reference removed
|
Pass |
Constraint references can be queried by ID
|
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Get constraint reference by ID
(2x)
|
Pass |
Get constraint reference response format conforms to spec
(3x)
|
Pass |
Returned constraint reference ID is correct
(3x)
|
Pass |
Returned constraint reference has a manager
(3x)
|
Pass |
Returned constraint reference manager is correct
(3x)
|
Pass |
Returned constraint reference has an USS base URL
(3x)
|
Pass |
Returned constraint reference base URL is correct
(3x)
|
Pass |
Returned constraint reference has a start time
(3x)
|
Pass |
Returned constraint reference has an end time
(3x)
|
Pass |
Returned start time is correct
(3x)
|
Pass |
Returned end time is correct
(3x)
|
Pass |
Returned constraint reference has an OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same version
(3x)
|
Pass |
Get constraint reference response content is correct
(2x)
|
Not tested |
Returned constraint reference has a version
|
Pass |
Search for newly created CR
|
Returned constraint reference ID is correct
(3x)
|
Pass |
Returned constraint reference has a manager
(3x)
|
Pass |
Returned constraint reference manager is correct
(3x)
|
Pass |
Returned constraint reference has an USS base URL
(3x)
|
Pass |
Returned constraint reference base URL is correct
(3x)
|
Pass |
Returned constraint reference has a start time
(3x)
|
Pass |
Returned constraint reference has an end time
(3x)
|
Pass |
Returned start time is correct
(3x)
|
Pass |
Returned end time is correct
(3x)
|
Pass |
Returned constraint reference has an OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same version
(3x)
|
Not tested |
Returned constraint reference has a version
|
Pass |
Retrieve updated CR
|
Get constraint reference by ID
(2x)
|
Pass |
Get constraint reference response format conforms to spec
(3x)
|
Pass |
Returned constraint reference ID is correct
(3x)
|
Pass |
Returned constraint reference has a manager
(3x)
|
Pass |
Returned constraint reference manager is correct
(3x)
|
Pass |
Returned constraint reference has an USS base URL
(3x)
|
Pass |
Returned constraint reference base URL is correct
(3x)
|
Pass |
Returned constraint reference has a start time
(3x)
|
Pass |
Returned constraint reference has an end time
(3x)
|
Pass |
Returned start time is correct
(3x)
|
Pass |
Returned end time is correct
(3x)
|
Pass |
Returned constraint reference has an OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same version
(3x)
|
Pass |
Get constraint reference response content is correct
(2x)
|
Not tested |
Returned constraint reference has a version
|
Pass |
Search for updated CR
|
Returned constraint reference ID is correct
(3x)
|
Pass |
Returned constraint reference has a manager
(3x)
|
Pass |
Returned constraint reference manager is correct
(3x)
|
Pass |
Returned constraint reference has an USS base URL
(3x)
|
Pass |
Returned constraint reference base URL is correct
(3x)
|
Pass |
Returned constraint reference has a start time
(3x)
|
Pass |
Returned constraint reference has an end time
(3x)
|
Pass |
Returned start time is correct
(3x)
|
Pass |
Returned end time is correct
(3x)
|
Pass |
Returned constraint reference has an OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same OVN
(3x)
|
Pass |
Non-mutated constraint reference keeps the same version
(3x)
|
Not tested |
Returned constraint reference has a version
|
Pass |
Query deleted CR
|
Get constraint reference by ID
(2x)
|
Not tested |
Get constraint reference response format conforms to spec
|
Not tested |
Get constraint reference response content is correct
|
Pass |
Create CR validation
|
Create constraint reference query succeeds
|
Pass |
Create constraint reference response format conforms to spec
|
Pass |
Returned constraint reference ID is correct
|
Pass |
Returned constraint reference has a manager
|
Pass |
Returned constraint reference manager is correct
|
Pass |
Returned constraint reference has an USS base URL
|
Pass |
Returned constraint reference base URL is correct
|
Pass |
Returned constraint reference has a start time
|
Pass |
Returned constraint reference has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Returned constraint reference has an OVN
|
Pass |
Create constraint reference response content is correct
|
Not tested |
Returned constraint reference has a version
|
Pass |
Mutate CR
|
Mutate constraint reference query succeeds
|
Pass |
Mutate constraint reference response format conforms to spec
|
Pass |
Returned constraint reference ID is correct
|
Pass |
Returned constraint reference has a manager
|
Pass |
Returned constraint reference manager is correct
|
Pass |
Returned constraint reference has an USS base URL
|
Pass |
Returned constraint reference base URL is correct
|
Pass |
Returned constraint reference has a start time
|
Pass |
Returned constraint reference has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Returned constraint reference has an OVN
|
Pass |
Mutated constraint reference OVN is updated
|
Pass |
Mutated constraint reference version is updated
|
Pass |
Mutate constraint reference response content is correct
|
Not tested |
Returned constraint reference has a version
|
Pass |
Delete CR
|
Delete constraint reference query succeeds
|
Pass |
Delete constraint reference response format conforms to spec
|
Pass |
Returned constraint reference ID is correct
|
Pass |
Returned constraint reference has a manager
|
Pass |
Returned constraint reference manager is correct
|
Pass |
Returned constraint reference has an USS base URL
|
Pass |
Returned constraint reference base URL is correct
|
Pass |
Returned constraint reference has a start time
|
Pass |
Returned constraint reference has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Returned constraint reference has an OVN
|
Pass |
Non-mutated constraint reference keeps the same OVN
|
Pass |
Non-mutated constraint reference keeps the same version
|
Pass |
Delete constraint reference response content is correct
|
Not tested |
Returned constraint reference has a version
|
Pass |
Setup
|
Ensure clean workspace
|
Constraint references can be queried by ID
|
Not tested |
Constraint reference removed
|
Pass |
Cleanup
|
Cleanup
|
Constraint references can be queried by ID
|
Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Constraint references can be queried by ID
|
Not tested |
Constraint reference removed
|
Pass |
Endpoint authorization
|
Constraint reference endpoints authentication
|
Unauthorized requests return the proper error message body
(20x)
|
Pass |
Create constraint reference with valid credentials
|
Pass |
Create constraint reference response format conforms to spec
|
Pass |
Get constraint reference with valid credentials
|
Pass |
Get constraint reference response format conforms to spec
|
Pass |
Mutate constraint reference with valid credentials
|
Pass |
Mutate constraint reference response format conforms to spec
|
Pass |
Delete constraint reference with valid credentials
|
Pass |
Delete constraint reference response format conforms to spec
|
Pass |
Cleanup
|
Cleanup
|
Constraint references can be queried by ID
|
DSS0005,4 |
Pass |
ASTM SCD DSS: Constraint Reference Simple
|
Setup
|
Ensure clean workspace
|
Constraint references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Constraint references can be searched for
|
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Search for newly created CR
|
Successful constraint reference search query
(2x)
|
Pass |
Search constraint reference response format conforms to spec
(3x)
|
Pass |
Expected constraint reference is in search results
(3x)
|
Pass |
Search constraint reference response content is correct
(2x)
|
Pass |
Search for updated CR
|
Successful constraint reference search query
(2x)
|
Pass |
Search constraint reference response format conforms to spec
(3x)
|
Pass |
Expected constraint reference is in search results
(3x)
|
Pass |
Search constraint reference response content is correct
(2x)
|
Pass |
Query deleted CR
|
Successful constraint reference search query
(2x)
|
Pass |
Setup
|
Ensure clean workspace
|
Constraint references can be searched for
|
Pass |
Cleanup
|
Cleanup
|
Constraint references can be searched for
|
Pass |
ASTM SCD DSS: Interfaces authentication
|
Endpoint authorization
|
Constraint reference endpoints authentication
|
Search constraint references with valid credentials
|
Pass |
Search constraint reference response format conforms to spec
|
Not tested |
Setup
|
Ensure clean workspace
|
Constraint references can be searched for
|
DSS0005,5 |
Pass |
ASTM SCD DSS: Implicit Subscription handling
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
|
Not tested |
Subscription can be deleted
|
Pass |
Single OIR implicit subscription is removed upon OIR deletion
|
Delete the OIR with implicit subscription
|
After removal of the only created OIR, subscriptions should be as before its creation
|
Pass |
Implicit subscriptions always properly cover their OIR
|
Create an overlapping OIR without any subscription
|
New OIR creation response contains previous implicit subscription to notify
|
Pass |
Mutate OIR with implicit subscription to not overlap anymore
|
The implicit subscription can be queried
|
Pass |
Non-mutated implicit subscription is deleted
|
Pass |
Create an OIR overlapping with the second OIR but not the first
|
Within a temporal frame not overlapping a newly created implicit subscription, subscriptions should be the same as at the start of the test case
|
Pass |
Implicit subscriptions are properly deleted when required by OIR mutation
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
|
Not tested |
Subscription can be deleted
|
Pass |
Create a subscription
|
Create subscription query succeeds
|
Pass |
Implicit subscriptions are expanded as needed
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(2x)
|
Pass |
Subscription can be deleted
|
Pass |
Expand the OIR while keeping the same implicit subscription
|
The implicit subscription can be queried
|
Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
|
Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
Pass |
Successful subscription search query
|
Not tested |
Subscription can be deleted
|
Pass |
Endpoint authorization
|
Subscription endpoints authentication
|
Unauthorized requests return the proper error message body
(24x)
|
Pass |
Create subscription with valid credentials
|
Pass |
Get subscription with valid credentials
|
Pass |
Mutate subscription with valid credentials
|
Pass |
Delete subscription with valid credentials
(2x)
|
Pass |
Search subscriptions with valid credentials
|
Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
|
Pass |
ASTM SCD DSS: Subscription Simple
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(4x)
|
Not tested |
Subscription can be deleted
|
Pass |
Subscription Simple
|
Create subscription validation
|
Create subscription query succeeds
(4x)
|
Pass |
Create subscription response format conforms to spec
(4x)
|
Pass |
Returned subscription ID is correct
(4x)
|
Pass |
Returned subscription has an USS base URL
(4x)
|
Pass |
Returned USS base URL has correct base URL
(4x)
|
Pass |
Returned subscription has a start time
(4x)
|
Pass |
Returned subscription has an end time
(4x)
|
Pass |
Returned subscription has a version
(4x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(4x)
|
Pass |
Operational intents notification flag is as requested
(4x)
|
Pass |
Constraints notification flag is as requested
(4x)
|
Pass |
New subscription has a notification index of 0
(4x)
|
Pass |
Create subscription response content is correct
(4x)
|
Pass |
Returned end time is correct
(2x)
|
Pass |
Returned start time is correct
(2x)
|
Not tested |
Returned notification index is equal to or greater than 0
|
Pass |
Attempt Subscription mutation with incorrect version
|
Mutation with empty version fails
|
Pass |
Mutation with incorrect version fails
|
Pass |
Mutate Subscription
|
Mutate subscription query succeeds
(8x)
|
Pass |
Mutate subscription response format conforms to spec
(8x)
|
Pass |
Returned subscription ID is correct
(8x)
|
Pass |
Returned subscription has an USS base URL
(8x)
|
Pass |
Returned USS base URL has correct base URL
(8x)
|
Pass |
Returned subscription has a start time
(8x)
|
Pass |
Returned subscription has an end time
(8x)
|
Pass |
Returned start time is correct
(8x)
|
Pass |
Returned end time is correct
(8x)
|
Pass |
Returned subscription has a version
(8x)
|
Pass |
Mutated subscription version is updated
(8x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(8x)
|
Pass |
Operational intents notification flag is as requested
(8x)
|
Pass |
Constraints notification flag is as requested
(8x)
|
Pass |
Returned notification index is equal to or greater than 0
(8x)
|
Pass |
Mutate subscription response is correct
(8x)
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Query Existing Subscription
|
Get subscription query succeeds
(4x)
|
Pass |
Get subscription response format conforms to spec
(4x)
|
Pass |
Returned subscription ID is correct
(8x)
|
Pass |
Returned subscription has an USS base URL
(8x)
|
Pass |
Returned USS base URL has correct base URL
(8x)
|
Pass |
Returned subscription has a start time
(8x)
|
Pass |
Returned subscription has an end time
(8x)
|
Pass |
Returned start time is correct
(8x)
|
Pass |
Returned end time is correct
(8x)
|
Pass |
Returned subscription has a version
(8x)
|
Pass |
Non-mutated subscription keeps the same version
(8x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(8x)
|
Pass |
Operational intents notification flag is as requested
(8x)
|
Pass |
Constraints notification flag is as requested
(8x)
|
Pass |
Returned notification index is equal to or greater than 0
(8x)
|
Pass |
Get subscription response is correct
(4x)
|
Pass |
Search for all subscriptions in planning area query succeeds
|
Pass |
Search subscriptions response format conforms to spec
(4x)
|
Pass |
Created Subscription is in search results
(4x)
|
Pass |
Search for all subscriptions in planning area response is correct
(4x)
|
Pass |
No huge search area allowed
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Delete Subscription
|
Missing version prevents deletion
(4x)
|
Pass |
Incorrect version prevents deletion
(4x)
|
Pass |
Delete subscription query succeeds
(4x)
|
Pass |
Delete subscription response format conforms to spec
(4x)
|
Pass |
Returned subscription ID is correct
(4x)
|
Pass |
Returned subscription has an USS base URL
(4x)
|
Pass |
Returned USS base URL has correct base URL
(4x)
|
Pass |
Returned subscription has a start time
(4x)
|
Pass |
Returned subscription has an end time
(4x)
|
Pass |
Returned start time is correct
(4x)
|
Pass |
Returned end time is correct
(4x)
|
Pass |
Returned subscription has a version
(4x)
|
Pass |
Non-mutated subscription keeps the same version
(4x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(4x)
|
Pass |
Operational intents notification flag is as requested
(4x)
|
Pass |
Constraints notification flag is as requested
(4x)
|
Pass |
Returned notification index is equal to or greater than 0
(4x)
|
Pass |
Delete subscription response is correct
(4x)
|
Not tested |
Subscription can be deleted
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Query Deleted Subscription
|
Query by subscription ID should fail
(4x)
|
Pass |
Search for all subscriptions in planning area query succeeds
|
Pass |
Deleted subscription should not be present in search results
|
Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
(4x)
|
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Get subscription response format conforms to spec
(2x)
|
Pass |
Successful subscription search query
(4x)
|
Not tested |
Get Subscription by ID
|
Not tested |
Created Subscription is in search results
|
Not tested |
Returned subscription ID is correct
|
Not tested |
New subscription has a notification index of 0
|
Not tested |
Returned notification index is equal to or greater than 0
|
Not tested |
Returned subscription has an USS base URL
|
Not tested |
Returned USS base URL has correct base URL
|
Not tested |
Returned subscription has a start time
|
Not tested |
Returned start time is correct
|
Not tested |
Returned subscription has an end time
|
Not tested |
Returned end time is correct
|
Not tested |
Returned subscription has a version
|
Not tested |
Non-implicit subscription has implicit flag set to false
|
Not tested |
Operational intents notification flag is as requested
|
Not tested |
Constraints notification flag is as requested
|
Not tested |
Non-mutated subscription keeps the same version
|
Pass |
Query updated subscription
|
Get subscription response format conforms to spec
(2x)
|
Pass |
Successful subscription search query
(4x)
|
Not tested |
Get Subscription by ID
|
Not tested |
Created Subscription is in search results
|
Not tested |
Returned subscription ID is correct
|
Not tested |
New subscription has a notification index of 0
|
Not tested |
Returned notification index is equal to or greater than 0
|
Not tested |
Returned subscription has an USS base URL
|
Not tested |
Returned USS base URL has correct base URL
|
Not tested |
Returned subscription has a start time
|
Not tested |
Returned start time is correct
|
Not tested |
Returned subscription has an end time
|
Not tested |
Returned end time is correct
|
Not tested |
Returned subscription has a version
|
Not tested |
Non-implicit subscription has implicit flag set to false
|
Not tested |
Operational intents notification flag is as requested
|
Not tested |
Constraints notification flag is as requested
|
Not tested |
Non-mutated subscription keeps the same version
|
Pass |
Verify mutation on all secondaries
|
Get subscription response format conforms to spec
(4x)
|
Pass |
Successful subscription search query
(8x)
|
Not tested |
Get Subscription by ID
|
Not tested |
Created Subscription is in search results
|
Not tested |
Returned subscription ID is correct
|
Not tested |
New subscription has a notification index of 0
|
Not tested |
Returned notification index is equal to or greater than 0
|
Not tested |
Returned subscription has an USS base URL
|
Not tested |
Returned USS base URL has correct base URL
|
Not tested |
Returned subscription has a start time
|
Not tested |
Returned start time is correct
|
Not tested |
Returned subscription has an end time
|
Not tested |
Returned end time is correct
|
Not tested |
Returned subscription has a version
|
Not tested |
Non-implicit subscription has implicit flag set to false
|
Not tested |
Operational intents notification flag is as requested
|
Not tested |
Constraints notification flag is as requested
|
Not tested |
Non-mutated subscription keeps the same version
|
Pass |
Delete subscriptions on secondaries
|
Subscription can be deleted
(2x)
|
Pass |
Delete subscription response format conforms to spec
(2x)
|
Pass |
Returned subscription ID is correct
(2x)
|
Pass |
Returned subscription has an USS base URL
(2x)
|
Pass |
Returned USS base URL has correct base URL
(2x)
|
Pass |
Returned subscription has a start time
(2x)
|
Pass |
Returned subscription has an end time
(2x)
|
Pass |
Returned start time is correct
(2x)
|
Pass |
Returned end time is correct
(2x)
|
Pass |
Returned subscription has a version
(2x)
|
Pass |
Non-mutated subscription keeps the same version
(2x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(2x)
|
Pass |
Operational intents notification flag is as requested
(2x)
|
Pass |
Constraints notification flag is as requested
(2x)
|
Pass |
Returned notification index is equal to or greater than 0
(2x)
|
Pass |
Delete subscription response content is correct
(2x)
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Create subscription validation
|
Create subscription query succeeds
(3x)
|
Pass |
Create subscription response format conforms to spec
(3x)
|
Pass |
Returned subscription ID is correct
(3x)
|
Pass |
Returned subscription has an USS base URL
(3x)
|
Pass |
Returned USS base URL has correct base URL
(3x)
|
Pass |
Returned subscription has a start time
(3x)
|
Pass |
Returned subscription has an end time
(3x)
|
Pass |
Returned start time is correct
(3x)
|
Pass |
Returned end time is correct
(3x)
|
Pass |
Returned subscription has a version
(3x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(3x)
|
Pass |
Operational intents notification flag is as requested
(3x)
|
Pass |
Constraints notification flag is as requested
(3x)
|
Pass |
New subscription has a notification index of 0
(3x)
|
Pass |
Create subscription response content is correct
(3x)
|
Not tested |
Returned notification index is equal to or greater than 0
|
Pass |
Mutate subscription broadcast
|
Subscription can be mutated
|
Pass |
Mutate subscription response format conforms to spec
|
Pass |
Returned subscription ID is correct
|
Pass |
Returned subscription has an USS base URL
|
Pass |
Returned USS base URL has correct base URL
|
Pass |
Returned subscription has a start time
|
Pass |
Returned subscription has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Returned subscription has a version
|
Pass |
Mutated subscription version is updated
|
Pass |
Non-implicit subscription has implicit flag set to false
|
Pass |
Operational intents notification flag is as requested
|
Pass |
Constraints notification flag is as requested
|
Pass |
Returned notification index is equal to or greater than 0
|
Pass |
Mutate subscription response content is correct
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Create subscription with different credentials
|
Create subscription query succeeds
|
Pass |
Mutate subscription on secondaries
|
Subscription can be mutated on secondary DSS
(2x)
|
Pass |
Mutate subscription response format conforms to spec
(2x)
|
Pass |
Returned subscription ID is correct
(2x)
|
Pass |
Returned subscription has an USS base URL
(2x)
|
Pass |
Returned USS base URL has correct base URL
(2x)
|
Pass |
Returned subscription has a start time
(2x)
|
Pass |
Returned subscription has an end time
(2x)
|
Pass |
Returned start time is correct
(2x)
|
Pass |
Returned end time is correct
(2x)
|
Pass |
Returned subscription has a version
(2x)
|
Pass |
Mutated subscription version is updated
(2x)
|
Pass |
Non-implicit subscription has implicit flag set to false
(2x)
|
Pass |
Operational intents notification flag is as requested
(2x)
|
Pass |
Constraints notification flag is as requested
(2x)
|
Pass |
Returned notification index is equal to or greater than 0
(2x)
|
Pass |
Mutate subscription response content is correct
(2x)
|
Not tested |
Subscription returned by a secondary DSS is valid and correct
|
Not tested |
Subscription can be mutated
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Delete subscription on primary
|
Subscription can be deleted
|
Pass |
Delete subscription response format conforms to spec
|
Pass |
Returned subscription ID is correct
|
Pass |
Returned subscription has an USS base URL
|
Pass |
Returned USS base URL has correct base URL
|
Pass |
Returned subscription has a start time
|
Pass |
Returned subscription has an end time
|
Pass |
Returned start time is correct
|
Pass |
Returned end time is correct
|
Pass |
Returned subscription has a version
|
Pass |
Non-mutated subscription keeps the same version
|
Pass |
Non-implicit subscription has implicit flag set to false
|
Pass |
Operational intents notification flag is as requested
|
Pass |
Constraints notification flag is as requested
|
Pass |
Returned notification index is equal to or greater than 0
|
Pass |
Delete subscription response content is correct
|
Not tested |
New subscription has a notification index of 0
|
Pass |
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(4x)
|
Not tested |
Subscription can be deleted
|
Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
(4x)
|
Pass |
Subscription can be deleted
|
Pass |
ASTM SCD DSS: Subscription Validation
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
|
Not tested |
Subscription can be deleted
|
Pass |
Subscription Validation
|
Subscription duration limitations
|
Accept a subscription of maximal duration
|
Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
|
Pass |
Subscription can be deleted
|
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Subscription deletion is reflected on all DSS instances
|
Delete a subscription at every DSS in sequence
|
Get Subscription by ID
(6x)
|
Pass |
Subscription can be deleted
(3x)
|
Pass |
Create a subscription at every DSS in sequence
|
Create subscription query succeeds
(3x)
|
Pass |
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(3x)
|
Not tested |
Subscription can be deleted
|
Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(3x)
|
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Subscription creation returns relevant OIRs
|
Create a subscription at every DSS in sequence
|
Get Subscription by ID
(6x)
|
Pass |
Create subscription query succeeds
(3x)
|
Pass |
Expiration of subscriptions removes them
|
Expire explicit subscriptions at every DSS in sequence
|
Subscription can be mutated
(3x)
|
Pass |
Successful subscription search query
(6x)
|
Pass |
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(4x)
|
Not tested |
Subscription can be deleted
|
Pass |
OIR creation and modification trigger relevant notifications
|
Create background subscription
|
Create subscription query succeeds
|
Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
Pass |
Subscription can be queried by ID
(5x)
|
Pass |
Subscription can be deleted
(4x)
|
DSS0010 |
Not tested |
Not implemented |
DSS0015 |
Pass |
ASTM SCD DSS: Subscription Validation
|
Subscription Validation
|
Subscription duration limitations
|
Don't create a too long subscription
|
Pass |
Don't mutate a subscription to be too long
|
DSS0020 |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Constraint reference can be found at every DSS
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
Not tested |
Propagated constraint reference general area is synchronized
|
Pass |
Search for newly created CR
|
Propagated constraint reference general area is synchronized
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
Not tested |
Constraint reference can be found at every DSS
|
Pass |
Retrieve updated CR
|
Constraint reference can be found at every DSS
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
Not tested |
Propagated constraint reference general area is synchronized
|
Pass |
Search for updated CR
|
Propagated constraint reference general area is synchronized
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Updated CR can be consistently searched for from all DSS instances
(3x)
|
Not tested |
Constraint reference can be found at every DSS
|
Pass |
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
Pass |
Deleted CR cannot be searched for from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Operational intent reference can be found at every DSS
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
Not tested |
Propagated operational intent reference general area is synchronized
|
Pass |
Search for newly created OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
Not tested |
Operational intent reference can be found at every DSS
|
Pass |
Retrieve updated OIR
|
Operational intent reference can be found at every DSS
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Not tested |
Propagated operational intent reference general area is synchronized
|
Pass |
Search for updated OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Not tested |
Operational intent reference can be found at every DSS
|
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Subscription can be found at every DSS
(3x)
|
Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
Pass |
Propagated subscription contains the correct start time
(3x)
|
Pass |
Propagated subscription contains the correct end time
(3x)
|
Pass |
Propagated subscription contains the correct version
(3x)
|
Pass |
Propagated subscription contains the correct notification flags
(3x)
|
Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
Pass |
Propagated subscription contains expected notification count
(3x)
|
Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
Pass |
Query updated subscription
|
Subscription can be found at every DSS
(3x)
|
Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
Pass |
Propagated subscription contains the correct start time
(3x)
|
Pass |
Propagated subscription contains the correct end time
(3x)
|
Pass |
Propagated subscription contains the correct version
(3x)
|
Pass |
Propagated subscription contains the correct notification flags
(3x)
|
Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
Pass |
Propagated subscription contains expected notification count
(3x)
|
Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
Pass |
Verify mutation on all secondaries
|
Subscription can be found at every DSS
(6x)
|
Pass |
Propagated subscription contains the correct USS base URL
(6x)
|
Pass |
Propagated subscription contains the correct start time
(6x)
|
Pass |
Propagated subscription contains the correct end time
(6x)
|
Pass |
Propagated subscription contains the correct version
(6x)
|
Pass |
Propagated subscription contains the correct notification flags
(6x)
|
Pass |
Propagated subscription contains the correct implicit flag
(6x)
|
Pass |
Propagated subscription contains expected notification count
(6x)
|
Pass |
Secondary DSS returns the subscription in searches for area that contains it
(6x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(6x)
|
Pass |
Query deleted subscription
|
DSS should not return the deleted subscription
(3x)
|
Pass |
Delete subscriptions on secondaries
|
DSS should not return the deleted subscription
(9x)
|
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
DSS0100,1 |
Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
USS Availability can be requested
|
Pass |
USS Availability can be updated
|
Pass |
Endpoint authorization
|
Availability endpoints authentication
|
Unauthorized requests return the proper error message body
(8x)
|
Pass |
Read availability with valid credentials
(5x)
|
Pass |
USS Availability Get response format conforms to spec
|
Pass |
Set availability with valid credentials
|
Pass |
USS Availability Set response format conforms to spec
|
Pass |
Cleanup
|
Cleanup
|
USS Availability can be requested
|
Pass |
USS Availability can be updated
|
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability can be requested
(3x)
|
Not tested |
USS Availability can be set to Unknown
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability can be requested
(2x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability can be requested
(2x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability can be requested
(2x)
|
Pass |
Update USS availability on primary DSS to Normal
|
USS Availability can be updated
|
Pass |
Update USS Availability on primary DSS to Down
|
USS Availability can be updated
|
Pass |
Update USS availability on primary DSS to Unknown
|
USS Availability can be updated
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability can be requested
(2x)
|
Pass |
Main DSS instance reports Unknown availability
|
Pass |
Availability version for an unknown USS should be empty
|
Pass |
Cleanup
|
Cleanup
|
USS Availability can be requested
|
Not tested |
Off-Nominal planning: down USS
|
Setup
|
Restore virtual USS availability
|
USS availability successfully set to 'Available'
|
Not tested |
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS availability successfully set to 'Down'
|
Not tested |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Setup
|
Restore virtual USS availability
|
USS availability successfully set to 'Available'
|
Not tested |
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS availability successfully set to 'Down'
|
Not tested |
Restore virtual USS availability at DSS
|
USS availability successfully set to 'Available'
|
Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS availability successfully set to 'Down'
|
Not tested |
Restore virtual USS availability at DSS
|
USS availability successfully set to 'Available'
|
Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS availability successfully set to 'Down'
|
DSS0100,2 |
Pass |
ASTM SCD DSS: Report
|
DSS Report
|
Make valid DSS report
|
DSS report successfully submitted
|
Pass |
DSS returned a valid report ID
|
DSS0200 |
Not tested |
ASTM UTM DSS: Direct CRDB access
|
Verify security interoperability
|
Attempt to connect in insecure mode
|
Node runs in secure mode
|
DSS0205 |
Not tested |
ASTM UTM DSS: Direct CRDB access
|
Verify security interoperability
|
Attempt to connect in insecure mode
|
Node runs in secure mode
|
Not tested |
Attempt to connect with legacy encryption protocol
|
Node rejects legacy encryption protocols
|
DSS0210,1a |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Subscription can be found at every DSS
(3x)
|
Pass |
Query updated subscription
|
Subscription can be found at every DSS
(3x)
|
Pass |
Verify mutation on all secondaries
|
Subscription can be found at every DSS
(6x)
|
Pass |
Query deleted subscription
|
DSS should not return the deleted subscription
(3x)
|
Pass |
Delete subscriptions on secondaries
|
DSS should not return the deleted subscription
(9x)
|
DSS0210,1b |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Verify manager synchronization
|
Subscription deletion with different non-managing credentials on secondary DSS fails
(2x)
|
Pass |
Mutate subscription on secondaries
|
Subscription can be mutated on secondary DSS
(2x)
|
DSS0210,1c |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct USS base URL
(3x)
|
Pass |
Query updated subscription
|
Propagated subscription contains the correct USS base URL
(3x)
|
Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct USS base URL
(6x)
|
DSS0210,1d |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
Pass |
Query updated subscription
|
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
Pass |
Verify mutation on all secondaries
|
Secondary DSS returns the subscription in searches for area that contains it
(6x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(6x)
|
DSS0210,1e |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct start time
(3x)
|
Pass |
Propagated subscription contains the correct end time
(3x)
|
Pass |
Query updated subscription
|
Propagated subscription contains the correct start time
(3x)
|
Pass |
Propagated subscription contains the correct end time
(3x)
|
Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct start time
(6x)
|
Pass |
Propagated subscription contains the correct end time
(6x)
|
DSS0210,1f |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct version
(3x)
|
Pass |
Query updated subscription
|
Propagated subscription contains the correct version
(3x)
|
Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct version
(6x)
|
DSS0210,1g |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct notification flags
(3x)
|
Pass |
Query updated subscription
|
Propagated subscription contains the correct notification flags
(3x)
|
Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct notification flags
(6x)
|
DSS0210,1h |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct implicit flag
(3x)
|
Pass |
Query updated subscription
|
Propagated subscription contains the correct implicit flag
(3x)
|
Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct implicit flag
(6x)
|
DSS0210,1i |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains expected notification count
(3x)
|
Pass |
Query updated subscription
|
Propagated subscription contains expected notification count
(3x)
|
Pass |
Verify mutation on all secondaries
|
Propagated subscription contains expected notification count
(6x)
|
DSS0210,2a |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Constraint reference can be found at every DSS
(3x)
|
Pass |
Retrieve updated CR
|
Constraint reference can be found at every DSS
(3x)
|
Pass |
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
Pass |
Deleted CR cannot be searched for from all DSS instances
(3x)
|
Not tested |
Search for newly created CR
|
Constraint reference can be found at every DSS
|
Not tested |
Search for updated CR
|
Constraint reference can be found at every DSS
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Operational intent reference can be found at every DSS
(3x)
|
Pass |
Retrieve updated OIR
|
Operational intent reference can be found at every DSS
(3x)
|
Pass |
Query deleted OIR
|
Deleted OIR cannot be retrieved from all DSS instances
(3x)
|
Pass |
Deleted OIR cannot be searched for from all DSS instances
(3x)
|
Not tested |
Search for newly created OIR
|
Operational intent reference can be found at every DSS
|
Not tested |
Search for updated OIR
|
Operational intent reference can be found at every DSS
|
DSS0210,2b |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Search for newly created CR
|
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Retrieve updated CR
|
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Search for updated CR
|
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
DSS0210,2c |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Search for newly created CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Retrieve updated CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Search for updated CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
DSS0210,2d |
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
DSS0210,2e |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Search for newly created CR
|
Propagated constraint reference general area is synchronized
(3x)
|
Pass |
Search for updated CR
|
Propagated constraint reference general area is synchronized
(3x)
|
Not tested |
Retrieve newly created CR
|
Propagated constraint reference general area is synchronized
|
Not tested |
Retrieve updated CR
|
Propagated constraint reference general area is synchronized
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Search for newly created OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
Pass |
Search for updated OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
Not tested |
Retrieve newly created OIR
|
Propagated operational intent reference general area is synchronized
|
Not tested |
Retrieve updated OIR
|
Propagated operational intent reference general area is synchronized
|
DSS0210,2f |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Search for newly created CR
|
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Retrieve updated CR
|
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Search for updated CR
|
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
DSS0210,3a |
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
DSS0210,3b |
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
DSS0210,3c |
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability version is consistent across every DSS instance
(3x)
|
DSS0210,A2-7-2,1a |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
Pass |
Search for newly created CR
|
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
Pass |
Search for newly created OIR
|
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
DSS0210,A2-7-2,1b |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve updated CR
|
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
Pass |
Search for updated CR
|
Updated CR can be consistently searched for from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve updated OIR
|
Updated OIR can be consistently retrieved from all DSS instances
(3x)
|
Pass |
Search for updated OIR
|
Updated OIR can be consistently searched for from all DSS instances
(3x)
|
DSS0210,A2-7-2,1c |
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Search for newly created OIR
|
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
Pass |
Search for updated OIR
|
Updated OIR can be consistently searched for from all DSS instances
(3x)
|
DSS0210,A2-7-2,1d |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve updated CR
|
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
Pass |
Retrieve updated OIR
|
Updated OIR can be consistently retrieved from all DSS instances
(3x)
|
DSS0210,A2-7-2,1e |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Search for newly created CR
|
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
Pass |
Search for updated CR
|
Updated CR can be consistently searched for from all DSS instances
(3x)
|
DSS0210,A2-7-2,1f |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
DSS0210,A2-7-2,2a |
Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Key validation on creation
|
Attempt OIR creation overlapping with first OIR
|
Create operational intent reference with missing OVN fails
|
Pass |
Attempt OIR creation overlapping with second OIR
|
Create operational intent reference with missing OVN fails
|
Pass |
Attempt OIR creation overlapping with both OIRs
|
Create operational intent reference with missing OVN fails
|
DSS0210,A2-7-2,2b |
Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Key validation on mutation
|
Attempt mutation with both OVNs missing
|
Mutate operational intent reference with missing OVN fails
|
Pass |
Attempt mutation with first OVN missing
|
Mutate operational intent reference with missing OVN fails
|
Pass |
Attempt mutation to overlap with the first OIR
|
Mutate operational intent reference with missing OVN fails
|
DSS0210,A2-7-2,3a |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Query deleted CR
|
Deleted CR cannot be searched for from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Query deleted OIR
|
Deleted OIR cannot be searched for from all DSS instances
(3x)
|
DSS0210,A2-7-2,3b |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Query deleted OIR
|
Deleted OIR cannot be retrieved from all DSS instances
(3x)
|
DSS0210,A2-7-2,3c |
Not tested |
Not implemented |
DSS0210,A2-7-2,3d |
Not tested |
Not implemented |
DSS0210,A2-7-2,4a |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Subscription creation returns relevant OIRs
|
Create a subscription at every DSS in sequence
|
Subscription may be retrieved from all other DSS instances
(10x)
|
Pass |
DSS response contains the expected OIRs
(3x)
|
DSS0210,A2-7-2,4b |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
OIR creation and modification trigger relevant notifications
|
Create an OIR at every DSS in sequence
|
DSS returns the implicit subscriptions from intersecting OIRs
(6x)
|
Pass |
DSS response contains the expected background subscription
(3x)
|
DSS0210,A2-7-2,4c |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
OIR creation and modification trigger relevant notifications
|
Modify an OIR at every DSS in sequence
|
DSS returns the implicit subscriptions from intersecting OIRs
(6x)
|
Pass |
DSS response contains the expected background subscription
(3x)
|
DSS0210,A2-7-2,4d |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Expiration of subscriptions removes them
|
Expire explicit subscriptions at every DSS in sequence
|
Subscription does not exist on all other DSS instances
(10x)
|
DSS0210,A2-7-2,5a |
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Subscription deletion is reflected on all DSS instances
|
Delete a subscription at every DSS in sequence
|
Subscription does not exist on all other DSS instances
(10x)
|
DSS0210,A2-7-2,5b |
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
OIR creation and modification does not trigger relevant notifications after subscription deletion
|
Create an OIR at every DSS in sequence
|
DSS response does not contain the deleted subscriptions
(3x)
|
DSS0210,A2-7-2,5c |
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
OIR creation and modification does not trigger relevant notifications after subscription deletion
|
Modify an OIR at every DSS in sequence
|
DSS response does not contain the deleted subscriptions
(3x)
|
DSS0210,A2-7-2,6 |
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
DSS0210,A2-7-2,7 |
Pass |
ASTM SCD DSS: Interfaces authentication
|
Endpoint authorization
|
Subscription endpoints authentication
|
Create subscription with missing credentials
|
Pass |
Create subscription with invalid credentials
|
Pass |
Create subscription with missing scope
|
Pass |
Create subscription with incorrect scope
|
Pass |
Get subscription with missing credentials
|
Pass |
Get subscription with invalid credentials
|
Pass |
Get subscription with missing scope
|
Pass |
Get subscription with incorrect scope
|
Pass |
Mutate subscription with missing credentials
|
Pass |
Mutate subscription with invalid credentials
|
Pass |
Mutate subscription with missing scope
|
Pass |
Mutate subscription with incorrect scope
|
Pass |
Delete subscription with missing credentials
|
Pass |
Delete subscription with invalid credentials
|
Pass |
Delete subscription with missing scope
|
Pass |
Delete subscription with incorrect scope
|
Pass |
Search subscriptions with missing credentials
|
Pass |
Search subscriptions with invalid credentials
|
Pass |
Search subscriptions with missing scope
|
Pass |
Search subscriptions with incorrect scope
|
Pass |
Operational intents endpoints authentication
|
Create operational intent reference with missing credentials
|
Pass |
Create operational intent reference with invalid credentials
|
Pass |
Create operational intent reference with missing scope
|
Pass |
Create operational intent reference with incorrect scope
|
Pass |
Get operational intent reference with missing credentials
|
Pass |
Get operational intent reference with invalid credentials
|
Pass |
Get operational intent reference with missing scope
|
Pass |
Get operational intent reference with incorrect scope
|
Pass |
Mutate operational intent reference with missing credentials
|
Pass |
Mutate operational intent reference with invalid credentials
|
Pass |
Mutate operational intent reference with missing scope
|
Pass |
Mutate operational intent reference with incorrect scope
|
Pass |
Delete operational intent reference with missing credentials
|
Pass |
Delete operational intent reference with invalid credentials
|
Pass |
Delete operational intent reference with missing scope
|
Pass |
Delete operational intent reference with incorrect scope
|
Pass |
Search operational intent references with missing credentials
|
Pass |
Search operational intent references with invalid credentials
|
Pass |
Search operational intent references with missing scope
|
Pass |
Search operational intent references with incorrect scope
|
Pass |
Availability endpoints authentication
|
Read availability with missing credentials
|
Pass |
Read availability with invalid credentials
|
Pass |
Read availability with missing scope
|
Pass |
Read availability with incorrect scope
|
Pass |
Set availability with missing credentials
|
Pass |
Set availability with invalid credentials
|
Pass |
Set availability with missing scope
|
Pass |
Set availability with incorrect scope
|
Pass |
Constraint reference endpoints authentication
|
Create constraint reference with missing credentials
|
Pass |
Create constraint reference with invalid credentials
|
Pass |
Create constraint reference with missing scope
|
Pass |
Create constraint reference with incorrect scope
|
Pass |
Get constraint reference with missing credentials
|
Pass |
Get constraint reference with invalid credentials
|
Pass |
Get constraint reference with missing scope
|
Pass |
Get constraint reference with incorrect scope
|
Pass |
Mutate constraint reference with missing credentials
|
Pass |
Mutate constraint reference with invalid credentials
|
Pass |
Mutate constraint reference with missing scope
|
Pass |
Mutate constraint reference with incorrect scope
|
Pass |
Delete constraint reference with missing credentials
|
Pass |
Delete constraint reference with invalid credentials
|
Pass |
Delete constraint reference with missing scope
|
Pass |
Delete constraint reference with incorrect scope
|
Pass |
Search constraint references with missing credentials
|
Pass |
Search constraint references with invalid credentials
|
Pass |
Search constraint references with missing scope
|
Pass |
Search constraint references with incorrect scope
|
DSS0215 |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Constraint reference can be found at every DSS
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
Not tested |
Propagated constraint reference general area is synchronized
|
Pass |
Search for newly created CR
|
Propagated constraint reference general area is synchronized
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
Not tested |
Constraint reference can be found at every DSS
|
Pass |
Retrieve updated CR
|
Constraint reference can be found at every DSS
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
Not tested |
Propagated constraint reference general area is synchronized
|
Pass |
Search for updated CR
|
Propagated constraint reference general area is synchronized
(3x)
|
Pass |
Propagated constraint reference contains the correct manager
(3x)
|
Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
Pass |
Propagated constraint reference contains the correct start time
(3x)
|
Pass |
Propagated constraint reference contains the correct end time
(3x)
|
Pass |
Updated CR can be consistently searched for from all DSS instances
(3x)
|
Not tested |
Constraint reference can be found at every DSS
|
Pass |
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
Pass |
Deleted CR cannot be searched for from all DSS instances
(3x)
|
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Operational intent reference can be found at every DSS
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
Not tested |
Propagated operational intent reference general area is synchronized
|
Pass |
Search for newly created OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Pass |
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
Not tested |
Operational intent reference can be found at every DSS
|
Pass |
Retrieve updated OIR
|
Operational intent reference can be found at every DSS
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Not tested |
Propagated operational intent reference general area is synchronized
|
Pass |
Search for updated OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
Pass |
Propagated operational intent reference contains the correct state
(3x)
|
Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
Not tested |
Operational intent reference can be found at every DSS
|
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Subscription can be found at every DSS
(3x)
|
Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
Pass |
Propagated subscription contains the correct start time
(3x)
|
Pass |
Propagated subscription contains the correct end time
(3x)
|
Pass |
Propagated subscription contains the correct version
(3x)
|
Pass |
Propagated subscription contains the correct notification flags
(3x)
|
Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
Pass |
Propagated subscription contains expected notification count
(3x)
|
Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
Pass |
Query updated subscription
|
Subscription can be found at every DSS
(3x)
|
Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
Pass |
Propagated subscription contains the correct start time
(3x)
|
Pass |
Propagated subscription contains the correct end time
(3x)
|
Pass |
Propagated subscription contains the correct version
(3x)
|
Pass |
Propagated subscription contains the correct notification flags
(3x)
|
Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
Pass |
Propagated subscription contains expected notification count
(3x)
|
Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
Pass |
Verify mutation on all secondaries
|
Subscription can be found at every DSS
(6x)
|
Pass |
Propagated subscription contains the correct USS base URL
(6x)
|
Pass |
Propagated subscription contains the correct start time
(6x)
|
Pass |
Propagated subscription contains the correct end time
(6x)
|
Pass |
Propagated subscription contains the correct version
(6x)
|
Pass |
Propagated subscription contains the correct notification flags
(6x)
|
Pass |
Propagated subscription contains the correct implicit flag
(6x)
|
Pass |
Propagated subscription contains expected notification count
(6x)
|
Pass |
Secondary DSS returns the subscription in searches for area that contains it
(6x)
|
Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(6x)
|
Pass |
Query deleted subscription
|
DSS should not return the deleted subscription
(3x)
|
Pass |
Delete subscriptions on secondaries
|
DSS should not return the deleted subscription
(9x)
|
Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
DSS0300 |
Pass |
ASTM F3548-21 UTM DSS interoperability
|
Prerequisites
|
Test environment requirements
|
DSS instance is reachable
(2x)
|
Not tested |
DSS instance is publicly addressable
|
GEN0100 |
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Recently Ended Flight
|
Incorrectly planned
|
GEN0105 |
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Recently Ended Flight
|
Incorrectly planned
|
GEN0300 |
Not tested |
ASTM F3548 UTM aggregate checks
|
Interoperability test instance is available
|
Interoperability test instance is available
|
Interoperability test instance is available
|
GEN0305 |
Pass |
ASTM F3548-21 evaluate system versions
|
Evaluate versions
|
Evaluate current system versions
|
Test software version matches production
|
Pass |
At most one participant is testing a new software version
|
Pass |
Evaluate system version consistency
|
Software versions are consistent throughout test run
|
GEN0310 |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Check for flight planning readiness
|
Flight planning USS ready
(2x)
|
GEN0400 |
Not tested |
Not implemented |
GEN0405 |
Not tested |
Not implemented |
GEN0500 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Validate tested USS intersection algorithm
(2x)
|
Pass |
Validation of operational intents
|
Validate precision of intersection computations
|
Attempt to plan Tiny Overlap Conflict Flight
|
Incorrectly planned
|
LOG0005 |
Not tested |
Not implemented |
LOG0010 |
Not tested |
Not implemented |
LOG0015 |
Not tested |
Not implemented |
LOG0020 |
Not tested |
Not implemented |
LOG0025 |
Not tested |
Not implemented |
LOG0030 |
Not tested |
Not implemented |
LOG0035 |
Not tested |
Not implemented |
LOG0040 |
Not tested |
Not implemented |
LOG0045 |
Not tested |
Not implemented |
LOG0050 |
Not tested |
Not implemented |
OPIN0015 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Off-nominal volumes
(2x)
|
Not tested |
Mock_uss plans Flight 2
|
Off-nominal volumes
|
Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Off-nominal volumes
|
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Off-nominal volumes
|
Not tested |
mock_uss plans flight 2
|
Off-nominal volumes
|
Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Plan Flight 1
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify planned Flight 1 in conflict
|
Off-nominal volumes
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Activate Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Activate Flight 1
|
Off-nominal volumes
(2x)
|
Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify activated flight in conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Off-nominal volumes
(2x)
|
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Activate Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2m
|
Off-nominal volumes
(2x)
|
Pass |
Declare Flight 2 non-conforming
|
Off-nominal volumes
(2x)
|
Pass |
Activate Flight 1
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify planned Flight 1c into conflict
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Off-nominal volumes
(2x)
|
Pass |
Attempt to modify activated Flight 1c into conflict
|
Off-nominal volumes
(2x)
|
Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Off-nominal volumes
|
Not tested |
Solo happy path
|
Solo happy path
|
Plan Flight 1
|
Off-nominal volumes
|
Not tested |
Activate Flight 1
|
Off-nominal volumes
|
Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Off-nominal volumes
|
OPIN0020 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Vertices
(2x)
|
Not tested |
Mock_uss plans Flight 2
|
Vertices
|
Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Vertices
|
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Vertices
|
Not tested |
mock_uss plans flight 2
|
Vertices
|
Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Vertices
(2x)
|
Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 2
|
Vertices
(2x)
|
Pass |
Plan Flight 1
|
Vertices
(2x)
|
Pass |
Attempt to modify planned Flight 1 in conflict
|
Vertices
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2
|
Vertices
(2x)
|
Pass |
Activate Flight 2
|
Vertices
(2x)
|
Pass |
Activate Flight 1
|
Vertices
(2x)
|
Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Vertices
(2x)
|
Pass |
Attempt to modify activated flight in conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Vertices
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict
|
Vertices
(2x)
|
Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Vertices
(2x)
|
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Vertices
(2x)
|
Pass |
Activate Flight 2
|
Vertices
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2m
|
Vertices
(2x)
|
Pass |
Declare Flight 2 non-conforming
|
Vertices
(2x)
|
Pass |
Activate Flight 1
|
Vertices
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Vertices
(2x)
|
Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Vertices
(2x)
|
Pass |
Attempt to modify planned Flight 1c into conflict
|
Vertices
(2x)
|
Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Vertices
(2x)
|
Pass |
Attempt to modify activated Flight 1c into conflict
|
Vertices
(2x)
|
Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Vertices
|
Not tested |
Solo happy path
|
Solo happy path
|
Plan Flight 1
|
Vertices
|
Not tested |
Activate Flight 1
|
Vertices
|
Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Vertices
|
OPIN0025 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Not tested |
Mock_uss plans Flight 2
|
Operational intent shared correctly
|
Not tested |
Operational intent details retrievable
|
Not tested |
Correct operational intent details
|
Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent shared correctly
|
Not tested |
Operational intent details retrievable
|
Not tested |
Correct operational intent details
|
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Operational intent shared correctly
|
Pass |
Operational intent details retrievable
|
Pass |
Correct operational intent details
|
Not tested |
mock_uss plans flight 2
|
Operational intent shared correctly
|
Not tested |
Operational intent details retrievable
|
Not tested |
Correct operational intent details
|
Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
Operational intent shared correctly
|
Not tested |
Operational intent details retrievable
|
Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Plan Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify planned Flight 1 in conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify activated flight in conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2m
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Declare Flight 2 non-conforming
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify planned Flight 1c into conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Attempt to modify activated Flight 1c into conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Operational intent details retrievable
(2x)
|
Pass |
Correct operational intent details
(2x)
|
Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent shared correctly
|
Pass |
Operational intent details retrievable
|
Pass |
Correct operational intent details
|
Not tested |
Solo happy path
|
Solo happy path
|
Plan Flight 1
|
Operational intent shared correctly
|
Not tested |
Operational intent details retrievable
|
Not tested |
Correct operational intent details
|
Not tested |
Activate Flight 1
|
Operational intent shared correctly
|
Not tested |
Operational intent details retrievable
|
Not tested |
Correct operational intent details
|
Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent shared correctly
|
Pass |
Operational intent details retrievable
|
Pass |
Correct operational intent details
|
OPIN0030 |
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Too Far Away Flight
|
Incorrectly planned
|
OPIN0035 |
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
|
Attempt unauthorized operational intent reference modification
|
Attempt unauthorized operational intent reference modification
|
Non-owning credentials cannot modify operational intent
(3x)
|
Pass |
Non-owning credentials cannot delete operational intent
|
OPIN0040 |
Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Remove Valid Flight
|
Operational intent not shared
|
SCD0005 |
Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Successful planning
|
Not tested |
Rejected planning
|
SCD0010 |
Pass |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Tested USS attempts to plan high-priority Flight 2
|
Incorrectly planned
|
Pass |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Tested USS attempts to plan high-priority Flight 2
|
Incorrectly planned
|
Pass |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Tested USS attempts to plan high-priority Flight 2
|
Incorrectly planned
|
SCD0015 |
Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Attempt to plan Flight 1
|
Incorrectly planned
(2x)
|
SCD0020 |
Pass |
Nominal planning: conflict with higher priority
|
Attempt to modify planned flight in conflict
|
Attempt to modify planned Flight 1 in conflict
|
Incorrectly modified
(2x)
|
SCD0025 |
Pass |
Nominal planning: conflict with higher priority
|
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Incorrectly activated
(2x)
|
SCD0030 |
Pass |
Nominal planning: conflict with higher priority
|
Modify activated flight with pre-existing conflict
|
Modify activated Flight 1 in conflict with activated Flight 2
|
Successful modification
(4x)
|
Pass |
Rejected modification
(2x)
|
Pass |
Attempt to modify activated flight in conflict
|
Attempt to modify activated Flight 1 in conflict
|
Incorrectly modified
(2x)
|
SCD0035 |
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
Validate that tested_uss obtained flight2 details
|
USS obtained operational intent details by means of either notification or GET request
|
Pass |
Flight planning prevented due to invalid data sharing
|
tested_uss attempts to plan flight 1, expect failure
|
Plan should fail
|
Pass |
Validate that tested_uss obtained flight2 details
|
USS obtained operational intent details by means of either notification or GET request
|
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Attempt to plan Flight 1
|
Incorrectly planned
(2x)
|
SCD0040 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to modify planned flight into conflict
|
Attempt to modify planned Flight 1c into conflict
|
Incorrectly modified
(2x)
|
SCD0045 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to activate flight into conflict
|
Attempt to directly activate conflicting Flight 1
|
Incorrectly activated
(2x)
|
SCD0050 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to modify activated flight into conflict
|
Attempt to modify activated Flight 1c into conflict
|
Incorrectly modified
(2x)
|
SCD0055 |
Not tested |
Not implemented |
SCD0060 |
Not tested |
Not implemented |
SCD0065 |
Not tested |
Not implemented |
SCD0070 |
Not tested |
Not implemented |
SCD0075 |
Pass |
ASTM F3548 UTM aggregate checks
|
Performance of SCD requests to USS
|
Performance of successful operational intent details requests
|
Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time
|
SCD0080 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Validate Flight 2 notification received by tested_uss
|
Tested USS receives valid notification
|
Pass |
Modify Activated operational intent area and receive notification of relevant intent
|
Validate Flight 2 notification received by tested_uss
|
Tested USS receives valid notification
|
SCD0085 |
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
Validate flight1 Notification sent to mock_uss
|
Expect Notification sent
(2x)
|
Not tested |
Notification data is valid
|
SCD0090 |
Not tested |
Not implemented |
SCD0095 |
Not tested |
Not implemented |
SCD0100 |
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
|
Attempt unauthorized state creation
|
Attempt direct creation with unauthorized state
|
Direct Nonconforming state creation is forbidden
|
Pass |
Direct Contingent state creation is forbidden
|
Pass |
Attempt unauthorized state transitions
|
Attempt transition of an accepted operational intent reference to an unauthorized state
|
Transition from Accepted to Nonconforming is forbidden
|
Pass |
Transition from Accepted to Contingent is forbidden
|
Pass |
Attempt transition of an activated operational intent reference to an unauthorized state
|
Transition from Activated to Nonconforming is forbidden
|
Pass |
Transition from Activated to Contingent is forbidden
|
Pass |
Attempt transition of an ended operational intent reference to an unauthorized state
|
Transition from Ended to Nonconforming is forbidden
|
Pass |
Transition from Ended to Contingent is forbidden
|
USS0005 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent shared correctly
(2x)
|
Not tested |
Mock_uss plans Flight 2
|
Operational intent shared correctly
|
Not tested |
Validate Flight 2 notification received by tested_uss
|
Mock USS sends valid notification
|
Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent shared correctly
|
Not tested |
Validate Flight 2 notification received by tested_uss
|
Mock USS sends valid notification
|
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Operational intent shared correctly
|
Not tested |
mock_uss plans flight 2
|
Operational intent shared correctly
|
Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
Operational intent shared correctly
|
Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Plan Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify planned Flight 1 in conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify activated flight in conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2m
|
Operational intent shared correctly
(2x)
|
Pass |
Declare Flight 2 non-conforming
|
Operational intent shared correctly
(2x)
|
Pass |
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify planned Flight 1c into conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent shared correctly
(2x)
|
Pass |
Attempt to modify activated Flight 1c into conflict
|
Operational intent shared correctly
(2x)
|
Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent shared correctly
|
Not tested |
Solo happy path
|
Solo happy path
|
Plan Flight 1
|
Operational intent shared correctly
|
Not tested |
Activate Flight 1
|
Operational intent shared correctly
|
Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent shared correctly
|
USS0105 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
Mock_uss plans Flight 2
|
Operational intent details retrievable
|
Not tested |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
Validate Flight 2 notification received by tested_uss
|
Tested USS rejects invalid notification
|
Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent details retrievable
|
Not tested |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
Validate Flight 2 notification received by tested_uss
|
Tested USS rejects invalid notification
|
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Operational intent details retrievable
|
Pass |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
mock_uss plans flight 2
|
Operational intent details retrievable
|
Not tested |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
Operational intent details retrievable
|
Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Plan Flight 1
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify planned Flight 1 in conflict
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Activate Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Activate Flight 1
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify activated flight in conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify activated Flight 1 in conflict
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Activate Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Modify activated flight with pre-existing conflict
|
Plan Flight 2m
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Declare Flight 2 non-conforming
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Pass |
Operational intent telemetry retrievable
(2x)
|
Pass |
Activate Flight 1
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify planned Flight 1c into conflict
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Attempt to modify activated Flight 1c into conflict
|
Operational intent details retrievable
(2x)
|
Pass |
Operational intent details data format
(2x)
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent details retrievable
|
Pass |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
Solo happy path
|
Solo happy path
|
Plan Flight 1
|
Operational intent details retrievable
|
Not tested |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Not tested |
Activate Flight 1
|
Operational intent details retrievable
|
Not tested |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Recently Ended Flight
|
Incorrectly planned
|
Pass |
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent details retrievable
|
Pass |
Operational intent details data format
|
Not tested |
Operational intent telemetry retrievable
|
uspace .article8 |
MSLAltitude |
Not tested |
U-space MSL altitude
|
UAS observations evaluation
|
Evaluate UAS observations
|
Message contains MSL altitude
|
Not tested |
MSL altitude is reported using an acceptable datum
|
Not tested |
MSL altitude is correct
|