astm .f3548 .v21 |
DSS0005,1 |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Clear area validation
|
DSS responses
(8x)
|
| Not tested |
uss_qualifier preparation
|
Remove uss_qualifier op intents
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Not tested |
Clear area validation
|
DSS responses
|
| Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(2x)
|
| Not tested |
Operational intent reference removed
|
| Pass |
Create operational intent references with different credentials
|
Can create an operational intent with valid credentials
(2x)
|
| Pass |
Attempt unauthorized operational intent reference modification
|
Attempt unauthorized operational intent reference modification
|
Operational intent references can be queried directly by their ID
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
(2x)
|
| Pass |
Operational intent reference removed
|
| Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Pass |
Attempt unauthorized state creation
|
Attempt direct creation with unauthorized state
|
Direct Nonconforming state creation is forbidden
|
| Pass |
Direct Contingent state creation is forbidden
|
| Pass |
Attempt unauthorized state transitions
|
Create an Accepted OIR
|
Creation of an Accepted OIR is allowed
|
| Pass |
Transition the OIR to Activated
|
Transition from Accepted to Activated is allowed
|
| Pass |
Transition the OIR to Ended
|
Transition from Activated to Ended is allowed
|
| Pass |
Attempt transition of an ended operational intent reference to an unauthorized state
|
Transition from Ended to Nonconforming is forbidden
|
| Pass |
Transition from Ended to Contingent is forbidden
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
| Pass |
Operational intent reference removed
|
| Pass |
ASTM SCD DSS: Implicit Subscription handling
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
| Not tested |
Operational intent reference removed
|
| Pass |
Single OIR implicit subscription is removed upon OIR deletion
|
Create an OIR with implicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
An implicit subscription was created and can be queried
|
| Pass |
Implicit subscription has correct temporal parameters
|
| Pass |
Delete the OIR with implicit subscription
|
Delete operational intent reference query succeeds
|
| Pass |
The implicit subscription was removed
|
| Pass |
After removal of the only created OIR, subscriptions should be as before its creation
|
| Pass |
Implicit subscriptions always properly cover their OIR
|
Create an OIR with implicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
An implicit subscription was created and can be queried
|
| Pass |
Implicit subscription has correct temporal parameters
|
| Pass |
Create an overlapping OIR without any subscription
|
Create operational intent reference query succeeds
|
| Pass |
OIR is not attached to a subscription
(2x)
|
| Pass |
New OIR creation response contains previous implicit subscription to notify
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
Mutate OIR with implicit subscription to not overlap anymore
|
Mutate operational intent reference query succeeds
|
| Pass |
The implicit subscription can be queried
|
| Pass |
Implicit subscription has correct temporal parameters
|
| Pass |
Non-mutated implicit subscription is deleted
|
| Pass |
Create an OIR overlapping with the second OIR but not the first
|
Create operational intent reference query succeeds
|
| Pass |
OIR is not attached to a subscription
(2x)
|
| Pass |
Within a temporal frame not overlapping a newly created implicit subscription, subscriptions should be the same as at the start of the test case
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
(3x)
|
| Pass |
Implicit subscriptions are properly deleted when required by OIR mutation
|
Create two OIRs with implicit subscription
|
Create operational intent reference query succeeds
(2x)
|
| Pass |
An implicit subscription was created and can be queried
(2x)
|
| Pass |
Implicit subscription has correct temporal parameters
(2x)
|
| Pass |
Update OIR with implicit subscription to use explicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Previously attached implicit subscription was deleted
|
| Pass |
Update OIR with implicit subscription to use no subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Previously attached implicit subscription was deleted
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
(2x)
|
| Pass |
Implicit subscriptions are expanded as needed
|
Create an OIR with implicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
An implicit subscription was created and can be queried
|
| Pass |
Implicit subscription has correct temporal parameters
|
| Pass |
Expand the OIR while keeping the same implicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
The implicit subscription can be queried
|
| Pass |
Implicit subscription has wide enough temporal parameters
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
|
| Pass |
Existing implicit subscription can replace an OIR's explicit subscription
|
Create first OIR with an explicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
Create second OIR with an implicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
An implicit subscription was created and can be queried
|
| Pass |
Implicit subscription has correct temporal parameters
|
| Pass |
Replace first OIR's explicit subscription with implicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
OIR is attached to expected subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
(2x)
|
| Pass |
Existing implicit subscription can be attached to OIR without subscription
|
Create OIR with no subscription
|
Create operational intent reference query succeeds
|
| Pass |
OIR is not attached to a subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
Create second OIR with an implicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
An implicit subscription was created and can be queried
|
| Pass |
Implicit subscription has correct temporal parameters
|
| Pass |
Attach OIR without subscription to implicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Confirm OIR is now attached to implicit subscription
|
OIR is attached to expected subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
(2x)
|
| Pass |
OIR without subscription can be mutated without a new subscription being attached
|
Create OIR with no subscription
|
Create operational intent reference query succeeds
|
| Pass |
OIR is not attached to a subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
Mutate OIR without adding a subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
OIR is not attached to a subscription
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
|
| Pass |
Request new implicit subscription when mutating an OIR with existing explicit subscription
|
Create OIR with explicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
Get operational intent reference by ID
|
| Pass |
OIR is attached to expected subscription
|
| Pass |
Mutate OIR to request new implicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Validate that the OIR is now attached to an implicit subscription
|
OIR is attached to a new subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
OIR is now attached to an implicit subscription
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
|
| Pass |
Request new implicit subscription when mutating an OIR without subscription
|
Create OIR with no subscription
|
Create operational intent reference query succeeds
|
| Pass |
OIR is not attached to a subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
Mutate OIR to request new implicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Validate that the OIR is now attached to an implicit subscription
|
OIR is attached to a new subscription
(2x)
|
| Pass |
Get operational intent reference by ID
|
| Pass |
OIR is now attached to an implicit subscription
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
|
| Pass |
Operational intent references can be queried by ID
(3x)
|
| Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Pass |
Endpoint authorization
|
Operational intents endpoints authentication
|
Unauthorized requests return the proper error message body
(20x)
|
| Pass |
Create operational intent reference with valid credentials
|
| Pass |
Create operational intent reference response format conforms to spec
|
| Pass |
Get operational intent reference with valid credentials
|
| Pass |
Mutate operational intent reference with valid credentials
|
| Pass |
Mutate operational intent reference response format conforms to spec
|
| Pass |
Delete operational intent reference with valid credentials
|
| Pass |
Search operational intent references with valid credentials
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
| Pass |
ASTM SCD DSS: Operational Intent Explicit Subscription handling
|
Setup
|
Cleanup OIRs
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Pass |
Validate explicit subscription on OIR creation
|
Provide subscription not covering extent of OIR being created
|
Request to create OIR with too short subscription fails
|
| Pass |
Create an OIR with correct explicit subscription
|
Create operational intent reference query succeeds
|
| Pass |
OIR is attached to expected subscription
|
Get operational intent reference by ID
|
| Pass |
OIR is attached to expected subscription
|
| Pass |
Validate explicit subscription upon subscription replacement
|
Attempt to replace OIR's existing explicit subscription with an insufficient one
|
Request to mutate OIR while providing a too short subscription fails
|
| Pass |
OIR is attached to expected subscription
|
Get operational intent reference by ID
(2x)
|
| Pass |
OIR is attached to expected subscription
(2x)
|
| Pass |
Replace the OIR's explicit subscription
|
Mutate operational intent reference query succeeds
|
| Pass |
Cleanup After Test Case
|
Delete operational intent reference query succeeds
|
| Not tested |
Unchanged OIR is attached to previous, valid, subscription
|
Get operational intent reference by ID
|
| Not tested |
OIR is attached to expected subscription
|
| Pass |
OIR in ACCEPTED state can be created without subscription
|
Create an operational intent reference
|
Create operational intent reference query succeeds
|
| Pass |
OIR is not attached to any subscription
|
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
OIR is not attached to a subscription
|
| Pass |
Validate explicit subscription being attached to OIR without subscription
|
Attempt to attach insufficient subscription to OIR
|
Request to attach insufficient subscription to OIR fails
|
| Pass |
OIR is not attached to any subscription
|
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
OIR is not attached to a subscription
|
| Pass |
Attach explicit subscription to OIR
|
Mutate operational intent reference query succeeds
|
| Pass |
OIR is attached to expected subscription
|
Get operational intent reference by ID
|
| Pass |
OIR is attached to expected subscription
|
| Pass |
Remove explicit subscription from OIR
|
Remove explicit subscription from OIR
|
Mutate operational intent reference query succeeds
|
| Pass |
OIR is not attached to any subscription
|
Get operational intent reference by ID
|
| Pass |
Subscription referenced by the OIR does not exist
|
| Pass |
OIR is not attached to a subscription
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
|
| Pass |
Operational intent references can be queried by ID
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
| Not tested |
Operational intent reference removed
|
| Pass |
Key validation on creation
|
Create first OIR
|
First operational intent reference in area creation query succeeds
|
| Pass |
Create second non-overlapping OIR
|
Second, non-overlapping operational intent reference creation succeeds
|
| Pass |
Attempt OIR creation overlapping with first OIR
|
Create operational intent reference with missing OVN fails
|
| Pass |
Failure response due to conflict has proper format
|
| Pass |
Failure response due to conflict contains conflicting OIRs
|
| Pass |
Attempt OIR creation overlapping with second OIR
|
Create operational intent reference with missing OVN fails
|
| Pass |
Failure response due to conflict has proper format
|
| Pass |
Failure response due to conflict contains conflicting OIRs
|
| Pass |
Attempt OIR creation overlapping with both OIRs
|
Create operational intent reference with missing OVN fails
|
| Pass |
Failure response due to conflict has proper format
|
| Pass |
Failure response due to conflict contains conflicting OIRs
|
| Pass |
Attempt valid OIR creation overlapping with both OIRs
|
Create operational intent reference with proper OVNs succeeds
|
| Pass |
Key validation on mutation
|
Attempt mutation with both OVNs missing
|
Mutate operational intent reference with missing OVN fails
|
| Pass |
Failure response due to conflict has proper format
|
| Pass |
Failure response due to conflict contains conflicting OIRs
|
| Pass |
Attempt mutation with first OVN missing
|
Mutate operational intent reference with missing OVN fails
|
| Pass |
Failure response due to conflict has proper format
|
| Pass |
Failure response due to conflict contains conflicting OIRs
|
| Pass |
Attempt mutation to overlap with the first OIR
|
Mutate operational intent reference with missing OVN fails
|
| Pass |
Failure response due to conflict has proper format
|
| Pass |
Failure response due to conflict contains conflicting OIRs
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
(3x)
|
| Pass |
Operational intent references can be queried by ID
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Simple
|
Setup
|
Cleanup OIRs
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Pass |
Create and Delete OIR
|
Create OIR
|
Create operational intent reference query succeeds
|
| Pass |
Create operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Create operational intent reference response content is correct
|
| Pass |
Delete OIR
|
Delete operational intent reference query succeeds
|
| Pass |
Delete operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Non-mutated operational intent reference keeps the same OVN
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Non-mutated operational intent reference keeps the same version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Delete operational intent reference response content is correct
|
| Pass |
Deletion requires correct OVN
|
Create OIR
|
Create operational intent reference query succeeds
|
| Pass |
Create operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Create operational intent reference response content is correct
|
| Pass |
Attempt deletion with missing OVN
|
Request to delete OIR with empty OVN fails
|
| Pass |
Attempt deletion with incorrect OVN
|
Request to delete OIR with incorrect OVN fails
|
| Pass |
Cleanup OIR
|
Delete operational intent reference query succeeds
|
| Pass |
Delete operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Non-mutated operational intent reference keeps the same OVN
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Non-mutated operational intent reference keeps the same version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Delete operational intent reference response content is correct
|
| Pass |
Mutation requires correct OVN
|
Create OIR
|
Create operational intent reference query succeeds
|
| Pass |
Create operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Create operational intent reference response content is correct
|
| Pass |
Attempt mutation with missing OVN
|
Request to mutate OIR with empty OVN fails
|
| Pass |
Attempt mutation with incorrect OVN
|
Request to mutate OIR with incorrect OVN fails
|
| Pass |
Attempt mutation with correct OVN
|
Mutate operational intent reference query succeeds
|
| Pass |
Mutate operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Mutated operational intent reference OVN is updated
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Mutated operational intent reference version is updated
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Mutate operational intent reference response content is correct
|
| Pass |
Cleanup OIR
|
Delete operational intent reference query succeeds
|
| Pass |
Delete operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Non-mutated operational intent reference keeps the same OVN
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Non-mutated operational intent reference keeps the same version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Delete operational intent reference response content is correct
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Pass |
Verify secondary DSS instances are clean
|
Operational intent references can be queried by ID
(2x)
|
| Pass |
OIR synchronization
|
Create OIR validation
|
Create operational intent reference query succeeds
|
| Pass |
Create operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Create operational intent reference response content is correct
|
| Pass |
Retrieve newly created OIR
|
Get operational intent reference by ID
(2x)
|
| Pass |
Search for newly created OIR
|
Successful operational intent reference search query
(2x)
|
| Pass |
Mutate OIR
|
Mutate operational intent reference query succeeds
|
| Pass |
Mutate operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Mutated operational intent reference OVN is updated
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Mutated operational intent reference version is updated
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Mutate operational intent reference response content is correct
|
| Pass |
Retrieve updated OIR
|
Get operational intent reference by ID
(2x)
|
| Pass |
Search for updated OIR
|
Successful operational intent reference search query
(2x)
|
| Pass |
Delete OIR
|
Delete operational intent reference query succeeds
|
| Pass |
Delete operational intent reference response format conforms to spec
|
| Pass |
Returned operational intent reference ID is correct
|
| Pass |
Returned operational intent reference has a manager
|
| Pass |
Returned operational intent reference manager is correct
|
| Pass |
Returned operational intent reference has an USS base URL
|
| Pass |
Returned operational intent reference base URL is correct
|
| Pass |
Returned operational intent reference has a start time
|
| Pass |
Returned operational intent reference has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Non-mutated operational intent reference keeps the same OVN
|
| Pass |
Returned operational intent reference has a version
|
| Pass |
Non-mutated operational intent reference keeps the same version
|
| Pass |
Returned operational intent reference state is correct
|
| Pass |
Delete operational intent reference response content is correct
|
| Pass |
Query deleted OIR
|
Get operational intent reference by ID
(2x)
|
| Pass |
Successful operational intent reference search query
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
| Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
(3x)
|
| Not tested |
Operational intent reference removed
|
| Pass |
Verify secondary DSS instances are clean
|
Operational intent references can be queried by ID
(6x)
|
| Pass |
OIR creation and modification does not trigger relevant notifications after subscription deletion
|
Create an OIR at every DSS in sequence
|
Create operational intent reference query succeeds
(3x)
|
| Pass |
Modify an OIR at every DSS in sequence
|
Mutate operational intent reference query succeeds
(3x)
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
(3x)
|
| Pass |
Operational intent references can be queried by ID
(3x)
|
| Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Setup
|
Ensure clean workspace on primary DSS
|
Operational intent references can be queried by ID
(3x)
|
| Not tested |
Operational intent reference removed
|
| Pass |
Verify secondary DSS instances are clean
|
Operational intent references can be queried by ID
(6x)
|
| Pass |
OIR creation and modification trigger relevant notifications
|
Create an OIR at every DSS in sequence
|
Create operational intent reference query succeeds
(3x)
|
| Pass |
Modify an OIR at every DSS in sequence
|
Mutate operational intent reference query succeeds
(3x)
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent reference removed
(3x)
|
| Pass |
Operational intent references can be queried by ID
(3x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Prerequisites check
|
Verify area is clear
|
DSS responses
(4x)
|
| Pass |
OVN Request Optional Extension to ASTM F3548-21
|
Setup
|
Ensure clean workspace
|
Operational intent references can be queried by ID
|
| Not tested |
Operational intent reference removed
|
| Pass |
Request for OIR OVN with valid suffix
|
Create OIR with OVN suffix request
|
Create operational intent reference query succeeds
|
| Pass |
Activate OIR with OVN suffix request
|
Mutate operational intent reference query succeeds
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be queried by ID
|
| Pass |
Operational intent reference removed
|
| Pass |
Off-Nominal planning: down USS
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
(2x)
|
| Pass |
Verify area is clear
|
DSS responses
(2x)
|
| Pass |
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Virtual USS creates conflicting operational intent
|
Operational intent successfully created
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
Successful operational intents cleanup
(2x)
|
| Pass |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
(2x)
|
| Pass |
Verify area is clear
|
DSS responses
(2x)
|
| Pass |
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Virtual USS creates conflicting operational intent
|
Operational intent successfully created
(2x)
|
| Pass |
Virtual USS activates conflicting operational intent
|
Operational intent successfully activated
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
Successful operational intents cleanup
(2x)
|
| Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Virtual USS transitions to Nonconforming conflicting operational intent
|
Operational intent successfully transitioned to Nonconforming
|
| Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Virtual USS transitions to Contingent conflicting operational intent
|
Operational intent successfully transitioned to Contingent
|
| DSS0005,2 |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Clear area validation
|
DSS responses
(8x)
|
| Not tested |
uss_qualifier preparation
|
Remove uss_qualifier op intents
|
Operational intent references can be searched for
|
| Not tested |
Clear area validation
|
DSS responses
|
| Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
(3x)
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference State Transitions
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
(2x)
|
| Pass |
ASTM SCD DSS: Implicit Subscription handling
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Not tested |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
| Pass |
ASTM SCD DSS: Operational Intent Explicit Subscription handling
|
Setup
|
Cleanup OIRs
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Simple
|
Setup
|
Cleanup OIRs
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Setup
|
Ensure clean workspace on primary DSS
|
Operational intent references can be searched for
|
| Pass |
Cleanup
|
Cleanup
|
Operational intent references can be searched for
|
| Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
DSS responses
(8x)
|
| Pass |
Mock_uss plans Flight 2
|
DSS responses
(4x)
|
| Pass |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
DSS responses
(4x)
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
mock_uss plans flight 2
|
DSS responses
(4x)
|
| Pass |
tested_uss plans flight 1
|
DSS responses
(4x)
|
| Pass |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
DSS responses
(4x)
|
| Pass |
tested_uss attempts to plan flight 1, expect failure
|
DSS responses
(4x)
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
DSS responses
(8x)
|
| Pass |
Attempt to plan Flight 1
|
DSS responses
(8x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
DSS responses
(8x)
|
| Pass |
Plan Flight 2
|
DSS responses
(8x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
DSS responses
(8x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
DSS responses
(8x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
DSS responses
(8x)
|
| Pass |
Plan Flight 2
|
DSS responses
(8x)
|
| Pass |
Activate Flight 2
|
DSS responses
(8x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
DSS responses
(8x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
DSS responses
(8x)
|
| Pass |
Attempt to modify activated Flight 1 into conflict
|
DSS responses
(8x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Prerequisites check
|
Verify area is clear
|
DSS responses
(4x)
|
| Pass |
Attempt to plan flight into conflict
|
Plan Flight 2
|
DSS responses
(8x)
|
| Pass |
Activate Flight 2
|
DSS responses
(8x)
|
| Pass |
Attempt to plan Flight 1
|
DSS responses
(8x)
|
| Pass |
Attempt to activate flight into conflict
|
Attempt to directly activate conflicting Flight 1
|
DSS responses
(8x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
DSS responses
(8x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
DSS responses
(8x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
DSS responses
(8x)
|
| Pass |
Attempt to modify activated Flight 1c into conflict
|
DSS responses
(8x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
DSS responses
(8x)
|
| Pass |
Plan Flight 2m
|
DSS responses
(8x)
|
| Pass |
Declare Flight 2 non-conforming
|
DSS responses
(4x)
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
DSS responses
|
| Pass |
OVN Request Optional Extension to ASTM F3548-21
|
Setup
|
Ensure clean workspace
|
Operational intent references can be searched for
|
| Pass |
Off-Nominal planning: down USS
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
(2x)
|
| Pass |
Verify area is clear
|
DSS responses
(2x)
|
| Pass |
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
DSS responses
(4x)
|
| Pass |
Cleanup
|
Cleanup
|
Successful operational intents cleanup
(2x)
|
| Pass |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Setup
|
Clear operational intents created by virtual USS
|
Successful operational intents cleanup
(2x)
|
| Pass |
Verify area is clear
|
DSS responses
(2x)
|
| Pass |
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Tested USS attempts to plan Flight 2
|
DSS responses
(4x)
|
| Pass |
Cleanup
|
Cleanup
|
Successful operational intents cleanup
(2x)
|
| Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Tested USS attempts to plan Flight 2
|
DSS responses
|
| Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Tested USS attempts to plan Flight 2
|
DSS responses
|
| Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Too Far Away Flight
|
DSS responses
(4x)
|
| Pass |
Attempt to plan Recently Ended Flight
|
DSS responses
(4x)
|
| Pass |
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
DSS responses
(4x)
|
| Pass |
Remove Valid Flight
|
DSS responses
(4x)
|
| Pass |
Validate precision of intersection computations
|
Attempt to plan Tiny Overlap Conflict Flight
|
DSS responses
(4x)
|
| DSS0005,5 |
Pass |
ASTM SCD DSS: Implicit Subscription handling
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
|
| Not tested |
Subscription can be deleted
|
| Pass |
Single OIR implicit subscription is removed upon OIR deletion
|
Delete the OIR with implicit subscription
|
After removal of the only created OIR, subscriptions should be as before its creation
|
| Pass |
Implicit subscriptions always properly cover their OIR
|
Create an overlapping OIR without any subscription
|
New OIR creation response contains previous implicit subscription to notify
|
| Pass |
Mutate OIR with implicit subscription to not overlap anymore
|
The implicit subscription can be queried
|
| Pass |
Non-mutated implicit subscription is deleted
|
| Pass |
Create an OIR overlapping with the second OIR but not the first
|
Within a temporal frame not overlapping a newly created implicit subscription, subscriptions should be the same as at the start of the test case
|
| Pass |
Implicit subscriptions are properly deleted when required by OIR mutation
|
Create a subscription
|
Create subscription query succeeds
|
| Pass |
Cleanup After Test Case
|
Subscription can be deleted
|
| Pass |
Implicit subscriptions are expanded as needed
|
Expand the OIR while keeping the same implicit subscription
|
The implicit subscription can be queried
|
| Pass |
Existing implicit subscription can replace an OIR's explicit subscription
|
Create an explicit subscription
|
Create subscription query succeeds
|
| Pass |
Cleanup After Test Case
|
Subscription can be deleted
|
| Pass |
Request new implicit subscription when mutating an OIR with existing explicit subscription
|
Create an explicit subscription
|
Create subscription query succeeds
|
| Pass |
Validate that the OIR is now attached to an implicit subscription
|
Get Subscription by ID
|
| Pass |
Cleanup After Test Case
|
Subscription can be deleted
|
| Pass |
Request new implicit subscription when mutating an OIR without subscription
|
Validate that the OIR is now attached to an implicit subscription
|
Get Subscription by ID
|
| Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
|
| Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
Subscription can be queried by ID
|
| Pass |
Successful subscription search query
|
| Not tested |
Subscription can be deleted
|
| Pass |
Endpoint authorization
|
Subscription endpoints authentication
|
Unauthorized requests return the proper error message body
(24x)
|
| Pass |
Create subscription with valid credentials
|
| Pass |
Get subscription with valid credentials
|
| Pass |
Mutate subscription with valid credentials
|
| Pass |
Delete subscription with valid credentials
(2x)
|
| Pass |
Search subscriptions with valid credentials
|
| Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
|
| Pass |
ASTM SCD DSS: Operational Intent Explicit Subscription handling
|
Setup
|
Cleanup Subscriptions
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(2x)
|
| Not tested |
Subscription can be deleted
|
| Pass |
Validate explicit subscription on OIR creation
|
Create independent subscription
|
Create subscription query succeeds
|
| Pass |
Validate explicit subscription upon subscription replacement
|
Create a subscription
|
Create subscription query succeeds
|
| Pass |
Cleanup After Test Case
|
Subscription can be deleted
|
| Pass |
Validate explicit subscription being attached to OIR without subscription
|
Create a subscription
|
Create subscription query succeeds
|
| Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(4x)
|
| Pass |
Subscription can be deleted
(2x)
|
| Pass |
ASTM SCD DSS: Subscription Simple
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(4x)
|
| Not tested |
Subscription can be deleted
|
| Pass |
Subscription Simple
|
Create subscription validation
|
Create subscription query succeeds
(4x)
|
| Pass |
Create subscription response format conforms to spec
(4x)
|
| Pass |
Returned subscription ID is correct
(4x)
|
| Pass |
Returned subscription has an USS base URL
(4x)
|
| Pass |
Returned USS base URL has correct base URL
(4x)
|
| Pass |
Returned subscription has a start time
(4x)
|
| Pass |
Returned subscription has an end time
(4x)
|
| Pass |
Returned subscription has a version
(4x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(4x)
|
| Pass |
Operational intents notification flag is as requested
(4x)
|
| Pass |
Constraints notification flag is as requested
(4x)
|
| Pass |
New subscription has a notification index of 0
(4x)
|
| Pass |
Create subscription response content is correct
(4x)
|
| Pass |
Returned end time is correct
(2x)
|
| Pass |
Returned start time is correct
(2x)
|
| Pass |
Attempt Subscription mutation with incorrect version
|
Mutation with empty version fails
|
| Pass |
Mutation with incorrect version fails
|
| Pass |
Mutate Subscription
|
Mutate subscription query succeeds
(8x)
|
| Pass |
Mutate subscription response format conforms to spec
(8x)
|
| Pass |
Returned subscription ID is correct
(8x)
|
| Pass |
Returned subscription has an USS base URL
(8x)
|
| Pass |
Returned USS base URL has correct base URL
(8x)
|
| Pass |
Returned subscription has a start time
(8x)
|
| Pass |
Returned subscription has an end time
(8x)
|
| Pass |
Returned start time is correct
(8x)
|
| Pass |
Returned end time is correct
(8x)
|
| Pass |
Returned subscription has a version
(8x)
|
| Pass |
Mutated subscription version is updated
(8x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(8x)
|
| Pass |
Operational intents notification flag is as requested
(8x)
|
| Pass |
Constraints notification flag is as requested
(8x)
|
| Pass |
Returned notification index is equal to or greater than 0
(8x)
|
| Pass |
Mutate subscription response is correct
(8x)
|
| Pass |
Query Existing Subscription
|
Get subscription query succeeds
(4x)
|
| Pass |
Get subscription response format conforms to spec
(4x)
|
| Pass |
Returned subscription ID is correct
(8x)
|
| Pass |
Returned subscription has an USS base URL
(8x)
|
| Pass |
Returned USS base URL has correct base URL
(8x)
|
| Pass |
Returned subscription has a start time
(8x)
|
| Pass |
Returned subscription has an end time
(8x)
|
| Pass |
Returned start time is correct
(8x)
|
| Pass |
Returned end time is correct
(8x)
|
| Pass |
Returned subscription has a version
(8x)
|
| Pass |
Non-mutated subscription keeps the same version
(8x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(8x)
|
| Pass |
Operational intents notification flag is as requested
(8x)
|
| Pass |
Constraints notification flag is as requested
(8x)
|
| Pass |
Returned notification index is equal to or greater than 0
(8x)
|
| Pass |
Get subscription response is correct
(4x)
|
| Pass |
Search for all subscriptions in planning area query succeeds
|
| Pass |
Search subscriptions response format conforms to spec
(4x)
|
| Pass |
Created Subscription is in search results
(4x)
|
| Pass |
Search for all subscriptions in planning area response is correct
(4x)
|
| Pass |
No huge search area allowed
|
| Pass |
Delete Subscription
|
Missing version prevents deletion
(4x)
|
| Pass |
Incorrect version prevents deletion
(4x)
|
| Pass |
Delete subscription query succeeds
(4x)
|
| Pass |
Delete subscription response format conforms to spec
(4x)
|
| Pass |
Returned subscription ID is correct
(4x)
|
| Pass |
Returned subscription has an USS base URL
(4x)
|
| Pass |
Returned USS base URL has correct base URL
(4x)
|
| Pass |
Returned subscription has a start time
(4x)
|
| Pass |
Returned subscription has an end time
(4x)
|
| Pass |
Returned start time is correct
(4x)
|
| Pass |
Returned end time is correct
(4x)
|
| Pass |
Returned subscription has a version
(4x)
|
| Pass |
Non-mutated subscription keeps the same version
(4x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(4x)
|
| Pass |
Operational intents notification flag is as requested
(4x)
|
| Pass |
Constraints notification flag is as requested
(4x)
|
| Pass |
Returned notification index is equal to or greater than 0
(4x)
|
| Pass |
Delete subscription response is correct
(4x)
|
| Pass |
Query Deleted Subscription
|
Query by subscription ID should fail
(4x)
|
| Pass |
Search for all subscriptions in planning area query succeeds
|
| Pass |
Deleted subscription should not be present in search results
|
| Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
(4x)
|
| Pass |
ASTM SCD DSS: Subscription Synchronization
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(4x)
|
| Not tested |
Subscription can be deleted
|
| Pass |
Verify secondary DSS instances are clean
|
Subscription can be queried by ID
(6x)
|
| Pass |
Subscription Synchronization
|
Create subscription validation
|
Create subscription query succeeds
(3x)
|
| Pass |
Create subscription response format conforms to spec
(3x)
|
| Pass |
Returned subscription ID is correct
(3x)
|
| Pass |
Returned subscription has an USS base URL
(3x)
|
| Pass |
Returned USS base URL has correct base URL
(3x)
|
| Pass |
Returned subscription has a start time
(3x)
|
| Pass |
Returned subscription has an end time
(3x)
|
| Pass |
Returned start time is correct
(3x)
|
| Pass |
Returned end time is correct
(3x)
|
| Pass |
Returned subscription has a version
(3x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(3x)
|
| Pass |
Operational intents notification flag is as requested
(3x)
|
| Pass |
Constraints notification flag is as requested
(3x)
|
| Pass |
New subscription has a notification index of 0
(3x)
|
| Pass |
Create subscription response content is correct
(3x)
|
| Pass |
Query newly created subscription
|
Get Subscription by ID
(2x)
|
| Pass |
Returned subscription ID is correct
(3x)
|
| Pass |
Returned subscription has an USS base URL
(3x)
|
| Pass |
Returned USS base URL has correct base URL
(3x)
|
| Pass |
Returned subscription has a start time
(3x)
|
| Pass |
Returned subscription has an end time
(3x)
|
| Pass |
Returned start time is correct
(3x)
|
| Pass |
Returned end time is correct
(3x)
|
| Pass |
Returned subscription has a version
(3x)
|
| Pass |
Non-mutated subscription keeps the same version
(3x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(3x)
|
| Pass |
Operational intents notification flag is as requested
(3x)
|
| Pass |
Constraints notification flag is as requested
(3x)
|
| Pass |
Returned notification index is equal to or greater than 0
(3x)
|
| Pass |
Get subscription response content is correct
(3x)
|
| Pass |
Get subscription response format conforms to spec
(2x)
|
| Pass |
Successful subscription search query
(4x)
|
| Pass |
Mutate subscription broadcast
|
Subscription can be mutated
|
| Pass |
Mutate subscription response format conforms to spec
|
| Pass |
Returned subscription ID is correct
|
| Pass |
Returned subscription has an USS base URL
|
| Pass |
Returned USS base URL has correct base URL
|
| Pass |
Returned subscription has a start time
|
| Pass |
Returned subscription has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Returned subscription has a version
|
| Pass |
Mutated subscription version is updated
|
| Pass |
Non-implicit subscription has implicit flag set to false
|
| Pass |
Operational intents notification flag is as requested
|
| Pass |
Constraints notification flag is as requested
|
| Pass |
Returned notification index is equal to or greater than 0
|
| Pass |
Mutate subscription response content is correct
|
| Pass |
Query updated subscription
|
Get Subscription by ID
(2x)
|
| Pass |
Returned subscription ID is correct
(3x)
|
| Pass |
Returned subscription has an USS base URL
(3x)
|
| Pass |
Returned USS base URL has correct base URL
(3x)
|
| Pass |
Returned subscription has a start time
(3x)
|
| Pass |
Returned subscription has an end time
(3x)
|
| Pass |
Returned start time is correct
(3x)
|
| Pass |
Returned end time is correct
(3x)
|
| Pass |
Returned subscription has a version
(3x)
|
| Pass |
Non-mutated subscription keeps the same version
(3x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(3x)
|
| Pass |
Operational intents notification flag is as requested
(3x)
|
| Pass |
Constraints notification flag is as requested
(3x)
|
| Pass |
Returned notification index is equal to or greater than 0
(3x)
|
| Pass |
Get subscription response content is correct
(3x)
|
| Pass |
Get subscription response format conforms to spec
(2x)
|
| Pass |
Successful subscription search query
(4x)
|
| Pass |
Create subscription with different credentials
|
Create subscription query succeeds
|
| Pass |
Mutate subscription on secondaries
|
Subscription can be mutated on secondary DSS
(2x)
|
| Pass |
Mutate subscription response format conforms to spec
(2x)
|
| Pass |
Returned subscription ID is correct
(2x)
|
| Pass |
Returned subscription has an USS base URL
(2x)
|
| Pass |
Returned USS base URL has correct base URL
(2x)
|
| Pass |
Returned subscription has a start time
(2x)
|
| Pass |
Returned subscription has an end time
(2x)
|
| Pass |
Returned start time is correct
(2x)
|
| Pass |
Returned end time is correct
(2x)
|
| Pass |
Returned subscription has a version
(2x)
|
| Pass |
Mutated subscription version is updated
(2x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(2x)
|
| Pass |
Operational intents notification flag is as requested
(2x)
|
| Pass |
Constraints notification flag is as requested
(2x)
|
| Pass |
Returned notification index is equal to or greater than 0
(2x)
|
| Pass |
Mutate subscription response content is correct
(2x)
|
| Pass |
Verify mutation on all secondaries
|
Get Subscription by ID
(4x)
|
| Pass |
Returned subscription ID is correct
(6x)
|
| Pass |
Returned subscription has an USS base URL
(6x)
|
| Pass |
Returned USS base URL has correct base URL
(6x)
|
| Pass |
Returned subscription has a start time
(6x)
|
| Pass |
Returned subscription has an end time
(6x)
|
| Pass |
Returned start time is correct
(6x)
|
| Pass |
Returned end time is correct
(6x)
|
| Pass |
Returned subscription has a version
(6x)
|
| Pass |
Non-mutated subscription keeps the same version
(6x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(6x)
|
| Pass |
Operational intents notification flag is as requested
(6x)
|
| Pass |
Constraints notification flag is as requested
(6x)
|
| Pass |
Returned notification index is equal to or greater than 0
(6x)
|
| Pass |
Get subscription response content is correct
(6x)
|
| Pass |
Get subscription response format conforms to spec
(4x)
|
| Pass |
Successful subscription search query
(8x)
|
| Pass |
Delete subscription on primary
|
Subscription can be deleted
|
| Pass |
Delete subscription response format conforms to spec
|
| Pass |
Returned subscription ID is correct
|
| Pass |
Returned subscription has an USS base URL
|
| Pass |
Returned USS base URL has correct base URL
|
| Pass |
Returned subscription has a start time
|
| Pass |
Returned subscription has an end time
|
| Pass |
Returned start time is correct
|
| Pass |
Returned end time is correct
|
| Pass |
Returned subscription has a version
|
| Pass |
Non-mutated subscription keeps the same version
|
| Pass |
Non-implicit subscription has implicit flag set to false
|
| Pass |
Operational intents notification flag is as requested
|
| Pass |
Constraints notification flag is as requested
|
| Pass |
Returned notification index is equal to or greater than 0
|
| Pass |
Delete subscription response content is correct
|
| Pass |
Delete subscriptions on secondaries
|
Subscription can be deleted
(2x)
|
| Pass |
Delete subscription response format conforms to spec
(2x)
|
| Pass |
Returned subscription ID is correct
(2x)
|
| Pass |
Returned subscription has an USS base URL
(2x)
|
| Pass |
Returned USS base URL has correct base URL
(2x)
|
| Pass |
Returned subscription has a start time
(2x)
|
| Pass |
Returned subscription has an end time
(2x)
|
| Pass |
Returned start time is correct
(2x)
|
| Pass |
Returned end time is correct
(2x)
|
| Pass |
Returned subscription has a version
(2x)
|
| Pass |
Non-mutated subscription keeps the same version
(2x)
|
| Pass |
Non-implicit subscription has implicit flag set to false
(2x)
|
| Pass |
Operational intents notification flag is as requested
(2x)
|
| Pass |
Constraints notification flag is as requested
(2x)
|
| Pass |
Returned notification index is equal to or greater than 0
(2x)
|
| Pass |
Delete subscription response content is correct
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
(4x)
|
| Pass |
Subscription can be deleted
|
| Pass |
ASTM SCD DSS: Subscription Validation
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
|
| Not tested |
Subscription can be deleted
|
| Pass |
Subscription Validation
|
Subscription duration limitations
|
Accept a subscription of maximal duration
|
| Pass |
Cleanup
|
Cleanup
|
Subscription can be queried by ID
|
| Pass |
Subscription can be deleted
|
| Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Setup
|
Ensure clean workspace
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(3x)
|
| Not tested |
Subscription can be deleted
|
| Pass |
Verify secondary DSS instances are clean
|
Subscription can be queried by ID
(6x)
|
| Pass |
Subscription deletion is reflected on all DSS instances
|
Create a subscription at every DSS in sequence
|
Create subscription query succeeds
(3x)
|
| Pass |
Delete a subscription at every DSS in sequence
|
Subscription can be deleted
(3x)
|
| Pass |
Get Subscription by ID
(6x)
|
| Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(3x)
|
| Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Setup
|
Ensure clean workspace on primary DSS
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(4x)
|
| Not tested |
Subscription can be deleted
|
| Pass |
Verify secondary DSS instances are clean
|
Subscription can be queried by ID
(6x)
|
| Pass |
OIR creation and modification trigger relevant notifications
|
Create background subscription
|
Create subscription query succeeds
|
| Pass |
Subscription creation returns relevant OIRs
|
Create a subscription at every DSS in sequence
|
Create subscription query succeeds
(3x)
|
| Pass |
Get Subscription by ID
(6x)
|
| Pass |
Expiration of subscriptions removes them
|
Expire explicit subscriptions at every DSS in sequence
|
Subscription can be mutated
(3x)
|
| Pass |
Successful subscription search query
(6x)
|
| Pass |
Cleanup
|
Cleanup
|
Successful subscription search query
|
| Pass |
Subscription can be queried by ID
(5x)
|
| Pass |
Subscription can be deleted
(4x)
|
| DSS0015 |
Pass |
ASTM SCD DSS: Subscription Validation
|
Subscription Validation
|
Subscription duration limitations
|
Don't create a too long subscription
|
| Pass |
Don't mutate a subscription to be too long
|
| DSS0020 |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Constraint reference can be found at every DSS
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for newly created CR
|
Propagated constraint reference general area is synchronized
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Retrieve updated CR
|
Constraint reference can be found at every DSS
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for updated CR
|
Propagated constraint reference general area is synchronized
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Updated CR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
| Pass |
Deleted CR cannot be searched for from all DSS instances
(3x)
|
| Not tested |
Setup
|
Verify secondary DSS instances are clean
|
Constraint reference with test ID does not exist
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
Setup
|
Verify secondary DSS instances are clean
|
Operational intent reference with test ID does not exist
(2x)
|
| Pass |
OIR synchronization
|
Retrieve newly created OIR
|
Operational intent reference can be found at every DSS
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for newly created OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Retrieve updated OIR
|
Operational intent reference can be found at every DSS
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
ASTM SCD DSS: Subscription Synchronization
|
Setup
|
Verify secondary DSS instances are clean
|
Subscription with test ID does not exist
(6x)
|
| Pass |
Subscription Synchronization
|
Query newly created subscription
|
Subscription can be found at every DSS
(3x)
|
| Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
| Pass |
Propagated subscription contains the correct start time
(3x)
|
| Pass |
Propagated subscription contains the correct end time
(3x)
|
| Pass |
Propagated subscription contains the correct version
(3x)
|
| Pass |
Propagated subscription contains the correct notification flags
(3x)
|
| Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
| Pass |
Propagated subscription contains expected notification count
(3x)
|
| Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
| Pass |
Query updated subscription
|
Subscription can be found at every DSS
(3x)
|
| Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
| Pass |
Propagated subscription contains the correct start time
(3x)
|
| Pass |
Propagated subscription contains the correct end time
(3x)
|
| Pass |
Propagated subscription contains the correct version
(3x)
|
| Pass |
Propagated subscription contains the correct notification flags
(3x)
|
| Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
| Pass |
Propagated subscription contains expected notification count
(3x)
|
| Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Subscription can be found at every DSS
(6x)
|
| Pass |
Propagated subscription contains the correct USS base URL
(6x)
|
| Pass |
Propagated subscription contains the correct start time
(6x)
|
| Pass |
Propagated subscription contains the correct end time
(6x)
|
| Pass |
Propagated subscription contains the correct version
(6x)
|
| Pass |
Propagated subscription contains the correct notification flags
(6x)
|
| Pass |
Propagated subscription contains the correct implicit flag
(6x)
|
| Pass |
Propagated subscription contains expected notification count
(6x)
|
| Pass |
Secondary DSS returns the subscription in searches for area that contains it
(6x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(6x)
|
| Pass |
Query deleted subscription
|
DSS should not return the deleted subscription
(3x)
|
| Pass |
Delete subscriptions on secondaries
|
DSS should not return the deleted subscription
(9x)
|
| Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Setup
|
Verify secondary DSS instances are clean
|
Operational intent reference with test ID does not exist
(6x)
|
| Pass |
Subscription with test ID does not exist
(6x)
|
| Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Setup
|
Verify secondary DSS instances are clean
|
Operational intent reference with test ID does not exist
(6x)
|
| Pass |
Subscription with test ID does not exist
(6x)
|
| Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| DSS0100,1 |
Pass |
ASTM SCD DSS: Interfaces authentication
|
Setup
|
Ensure clean workspace
|
USS Availability can be requested
|
| Pass |
USS Availability can be updated
|
| Pass |
Endpoint authorization
|
Availability endpoints authentication
|
Unauthorized requests return the proper error message body
(8x)
|
| Pass |
Read availability with valid credentials
(5x)
|
| Pass |
USS Availability Get response format conforms to spec
|
| Pass |
Set availability with valid credentials
|
| Pass |
USS Availability Set response format conforms to spec
|
| Pass |
Cleanup
|
Cleanup
|
USS Availability can be requested
|
| Pass |
USS Availability can be updated
|
| Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability can be requested
(3x)
|
| Not tested |
USS Availability can be set to Unknown
|
| Pass |
USS Availability synchronization
|
Update USS availability on primary DSS to Normal
|
USS Availability can be updated
|
| Pass |
Check Normal USS availability broadcast
|
USS Availability can be requested
(2x)
|
| Pass |
Update USS Availability on primary DSS to Down
|
USS Availability can be updated
|
| Pass |
Check Down USS availability broadcast
|
USS Availability can be requested
(2x)
|
| Pass |
Update USS availability on primary DSS to Unknown
|
USS Availability can be updated
|
| Pass |
Check Unknown USS availability broadcast
|
USS Availability can be requested
(2x)
|
| Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
Main DSS instance reports Unknown availability
|
| Pass |
Availability version for an unknown USS should be empty
|
| Pass |
USS Availability can be requested
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
USS Availability can be requested
|
| Pass |
Off-Nominal planning: down USS
|
Setup
|
Restore virtual USS availability
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Pass |
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Pass |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Setup
|
Restore virtual USS availability
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Pass |
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Pass |
Restore virtual USS availability at DSS
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Pass |
Cleanup
|
Cleanup
|
USS Availability can be requested
(2x)
|
| Pass |
USS Availability can be updated
(2x)
|
| Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS Availability can be requested
|
| Not tested |
USS Availability can be updated
|
| Not tested |
Restore virtual USS availability at DSS
|
USS Availability can be requested
|
| Not tested |
USS Availability can be updated
|
| Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Declare virtual USS as down at DSS
|
USS Availability can be requested
|
| Not tested |
USS Availability can be updated
|
| DSS0200 |
Not tested |
ASTM UTM DSS: Direct datastore access
|
Verify security interoperability
|
Attempt to connect in insecure mode
|
Node enforces authentication of its communications
|
| DSS0205 |
Not tested |
ASTM UTM DSS: Direct datastore access
|
Verify security interoperability
|
Attempt to connect in insecure mode
|
Node enforces encryption of its communications
|
| Not tested |
Attempt to connect with legacy encryption protocol
|
Node rejects legacy encryption protocols
|
| DSS0210,1a |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Subscription can be found at every DSS
(3x)
|
| Pass |
Query updated subscription
|
Subscription can be found at every DSS
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Subscription can be found at every DSS
(6x)
|
| Pass |
Query deleted subscription
|
DSS should not return the deleted subscription
(3x)
|
| Pass |
Delete subscriptions on secondaries
|
DSS should not return the deleted subscription
(9x)
|
| DSS0210,1b |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Verify manager synchronization
|
Subscription deletion with different non-managing credentials on secondary DSS fails
(2x)
|
| Pass |
Mutate subscription on secondaries
|
Subscription can be mutated on secondary DSS
(2x)
|
| DSS0210,1c |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct USS base URL
(3x)
|
| Pass |
Query updated subscription
|
Propagated subscription contains the correct USS base URL
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct USS base URL
(6x)
|
| DSS0210,1d |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
| Pass |
Query updated subscription
|
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Secondary DSS returns the subscription in searches for area that contains it
(6x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(6x)
|
| DSS0210,1e |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct start time
(3x)
|
| Pass |
Propagated subscription contains the correct end time
(3x)
|
| Pass |
Query updated subscription
|
Propagated subscription contains the correct start time
(3x)
|
| Pass |
Propagated subscription contains the correct end time
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct start time
(6x)
|
| Pass |
Propagated subscription contains the correct end time
(6x)
|
| DSS0210,1f |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct version
(3x)
|
| Pass |
Query updated subscription
|
Propagated subscription contains the correct version
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct version
(6x)
|
| DSS0210,1g |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct notification flags
(3x)
|
| Pass |
Query updated subscription
|
Propagated subscription contains the correct notification flags
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct notification flags
(6x)
|
| DSS0210,1h |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains the correct implicit flag
(3x)
|
| Pass |
Query updated subscription
|
Propagated subscription contains the correct implicit flag
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Propagated subscription contains the correct implicit flag
(6x)
|
| DSS0210,1i |
Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Propagated subscription contains expected notification count
(3x)
|
| Pass |
Query updated subscription
|
Propagated subscription contains expected notification count
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Propagated subscription contains expected notification count
(6x)
|
| DSS0210,2a |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Constraint reference can be found at every DSS
(3x)
|
| Pass |
Retrieve updated CR
|
Constraint reference can be found at every DSS
(3x)
|
| Pass |
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
| Pass |
Deleted CR cannot be searched for from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Operational intent reference can be found at every DSS
(3x)
|
| Pass |
Retrieve updated OIR
|
Operational intent reference can be found at every DSS
(3x)
|
| Pass |
Query deleted OIR
|
Deleted OIR cannot be retrieved from all DSS instances
(3x)
|
| Pass |
Deleted OIR cannot be searched for from all DSS instances
(3x)
|
| DSS0210,2b |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Search for newly created CR
|
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Retrieve updated CR
|
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Search for updated CR
|
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct manager
(3x)
|
| DSS0210,2c |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Search for newly created CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Retrieve updated CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Search for updated CR
|
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| DSS0210,2d |
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct state
(3x)
|
| DSS0210,2e |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Search for newly created CR
|
Propagated constraint reference general area is synchronized
(3x)
|
| Pass |
Search for updated CR
|
Propagated constraint reference general area is synchronized
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Search for newly created OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
| DSS0210,2f |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Search for newly created CR
|
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Retrieve updated CR
|
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Search for updated CR
|
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Search for newly created OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Retrieve updated OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| DSS0210,A2-7-2,1a |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for newly created CR
|
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for newly created OIR
|
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
| DSS0210,A2-7-2,1b |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve updated CR
|
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for updated CR
|
Updated CR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve updated OIR
|
Updated OIR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for updated OIR
|
Updated OIR can be consistently searched for from all DSS instances
(3x)
|
| DSS0210,A2-7-2,1c |
Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Search for newly created OIR
|
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Search for updated OIR
|
Updated OIR can be consistently searched for from all DSS instances
(3x)
|
| DSS0210,A2-7-2,1d |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve updated CR
|
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Retrieve updated OIR
|
Updated OIR can be consistently retrieved from all DSS instances
(3x)
|
| DSS0210,A2-7-2,2a |
Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Key validation on creation
|
Attempt OIR creation overlapping with first OIR
|
Create operational intent reference with missing OVN fails
|
| Pass |
Attempt OIR creation overlapping with second OIR
|
Create operational intent reference with missing OVN fails
|
| Pass |
Attempt OIR creation overlapping with both OIRs
|
Create operational intent reference with missing OVN fails
|
| DSS0210,A2-7-2,2b |
Pass |
ASTM SCD DSS: Operational Intent Reference Key Validation
|
Key validation on mutation
|
Attempt mutation with both OVNs missing
|
Mutate operational intent reference with missing OVN fails
|
| Pass |
Attempt mutation with first OVN missing
|
Mutate operational intent reference with missing OVN fails
|
| Pass |
Attempt mutation to overlap with the first OIR
|
Mutate operational intent reference with missing OVN fails
|
| DSS0210,A2-7-2,3a |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Query deleted CR
|
Deleted CR cannot be searched for from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Query deleted OIR
|
Deleted OIR cannot be searched for from all DSS instances
(3x)
|
| DSS0210,A2-7-2,3b |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Query deleted OIR
|
Deleted OIR cannot be retrieved from all DSS instances
(3x)
|
| DSS0210,A2-7-2,4a |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Subscription creation returns relevant OIRs
|
Create a subscription at every DSS in sequence
|
DSS response contains the expected OIRs
(3x)
|
| Pass |
Subscription may be retrieved from all other DSS instances
(10x)
|
| DSS0210,A2-7-2,4b |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
OIR creation and modification trigger relevant notifications
|
Create an OIR at every DSS in sequence
|
DSS response contains the expected background subscription
(3x)
|
| Pass |
DSS returns the implicit subscriptions from intersecting OIRs
(6x)
|
| DSS0210,A2-7-2,4c |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
OIR creation and modification trigger relevant notifications
|
Modify an OIR at every DSS in sequence
|
DSS response contains the expected background subscription
(3x)
|
| Pass |
DSS returns the implicit subscriptions from intersecting OIRs
(6x)
|
| DSS0210,A2-7-2,4d |
Pass |
ASTM SCD DSS: Subscription and entity interaction
|
Expiration of subscriptions removes them
|
Expire explicit subscriptions at every DSS in sequence
|
Subscription does not exist on all other DSS instances
(10x)
|
| DSS0210,A2-7-2,5a |
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
Subscription deletion is reflected on all DSS instances
|
Delete a subscription at every DSS in sequence
|
Subscription does not exist on all other DSS instances
(10x)
|
| DSS0210,A2-7-2,5b |
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
OIR creation and modification does not trigger relevant notifications after subscription deletion
|
Create an OIR at every DSS in sequence
|
DSS response does not contain the deleted subscriptions
(3x)
|
| DSS0210,A2-7-2,5c |
Pass |
ASTM SCD DSS: Subscription and entity deletion interaction
|
OIR creation and modification does not trigger relevant notifications after subscription deletion
|
Modify an OIR at every DSS in sequence
|
DSS response does not contain the deleted subscriptions
(3x)
|
| DSS0210,A2-7-2,7 |
Pass |
ASTM SCD DSS: Interfaces authentication
|
Endpoint authorization
|
Subscription endpoints authentication
|
Create subscription with missing credentials
|
| Pass |
Create subscription with invalid credentials
|
| Pass |
Create subscription with missing scope
|
| Pass |
Create subscription with incorrect scope
|
| Pass |
Get subscription with missing credentials
|
| Pass |
Get subscription with invalid credentials
|
| Pass |
Get subscription with missing scope
|
| Pass |
Get subscription with incorrect scope
|
| Pass |
Mutate subscription with missing credentials
|
| Pass |
Mutate subscription with invalid credentials
|
| Pass |
Mutate subscription with missing scope
|
| Pass |
Mutate subscription with incorrect scope
|
| Pass |
Delete subscription with missing credentials
|
| Pass |
Delete subscription with invalid credentials
|
| Pass |
Delete subscription with missing scope
|
| Pass |
Delete subscription with incorrect scope
|
| Pass |
Search subscriptions with missing credentials
|
| Pass |
Search subscriptions with invalid credentials
|
| Pass |
Search subscriptions with missing scope
|
| Pass |
Search subscriptions with incorrect scope
|
| Pass |
Operational intents endpoints authentication
|
Create operational intent reference with missing credentials
|
| Pass |
Create operational intent reference with invalid credentials
|
| Pass |
Create operational intent reference with missing scope
|
| Pass |
Create operational intent reference with incorrect scope
|
| Pass |
Get operational intent reference with missing credentials
|
| Pass |
Get operational intent reference with invalid credentials
|
| Pass |
Get operational intent reference with missing scope
|
| Pass |
Get operational intent reference with incorrect scope
|
| Pass |
Mutate operational intent reference with missing credentials
|
| Pass |
Mutate operational intent reference with invalid credentials
|
| Pass |
Mutate operational intent reference with missing scope
|
| Pass |
Mutate operational intent reference with incorrect scope
|
| Pass |
Delete operational intent reference with missing credentials
|
| Pass |
Delete operational intent reference with invalid credentials
|
| Pass |
Delete operational intent reference with missing scope
|
| Pass |
Delete operational intent reference with incorrect scope
|
| Pass |
Search operational intent references with missing credentials
|
| Pass |
Search operational intent references with invalid credentials
|
| Pass |
Search operational intent references with missing scope
|
| Pass |
Search operational intent references with incorrect scope
|
| Pass |
Availability endpoints authentication
|
Read availability with missing credentials
|
| Pass |
Read availability with invalid credentials
|
| Pass |
Read availability with missing scope
|
| Pass |
Read availability with incorrect scope
|
| Pass |
Set availability with missing credentials
|
| Pass |
Set availability with invalid credentials
|
| Pass |
Set availability with missing scope
|
| Pass |
Set availability with incorrect scope
|
| Pass |
Constraint reference endpoints authentication
|
Create constraint reference with missing credentials
|
| Pass |
Create constraint reference with invalid credentials
|
| Pass |
Create constraint reference with missing scope
|
| Pass |
Create constraint reference with incorrect scope
|
| Pass |
Get constraint reference with missing credentials
|
| Pass |
Get constraint reference with invalid credentials
|
| Pass |
Get constraint reference with missing scope
|
| Pass |
Get constraint reference with incorrect scope
|
| Pass |
Mutate constraint reference with missing credentials
|
| Pass |
Mutate constraint reference with invalid credentials
|
| Pass |
Mutate constraint reference with missing scope
|
| Pass |
Mutate constraint reference with incorrect scope
|
| Pass |
Delete constraint reference with missing credentials
|
| Pass |
Delete constraint reference with invalid credentials
|
| Pass |
Delete constraint reference with missing scope
|
| Pass |
Delete constraint reference with incorrect scope
|
| Pass |
Search constraint references with missing credentials
|
| Pass |
Search constraint references with invalid credentials
|
| Pass |
Search constraint references with missing scope
|
| Pass |
Search constraint references with incorrect scope
|
| DSS0215 |
Pass |
ASTM SCD DSS: Constraint Reference Synchronization
|
CR synchronization
|
Retrieve newly created CR
|
Constraint reference can be found at every DSS
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Newly created CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for newly created CR
|
Propagated constraint reference general area is synchronized
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Newly created CR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Retrieve updated CR
|
Constraint reference can be found at every DSS
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Updated CR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for updated CR
|
Propagated constraint reference general area is synchronized
(3x)
|
| Pass |
Propagated constraint reference contains the correct manager
(3x)
|
| Pass |
Propagated constraint reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated constraint reference contains the correct start time
(3x)
|
| Pass |
Propagated constraint reference contains the correct end time
(3x)
|
| Pass |
Updated CR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Query deleted CR
|
Deleted CR cannot be retrieved from all DSS instances
(3x)
|
| Pass |
Deleted CR cannot be searched for from all DSS instances
(3x)
|
| Pass |
ASTM SCD DSS: Operational Intent Reference Synchronization
|
OIR synchronization
|
Retrieve newly created OIR
|
Operational intent reference can be found at every DSS
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Newly created OIR can be consistently retrieved from all DSS instances
(3x)
|
| Pass |
Search for newly created OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Newly created OIR can be consistently searched for from all DSS instances
(3x)
|
| Pass |
Retrieve updated OIR
|
Operational intent reference can be found at every DSS
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
Search for updated OIR
|
Propagated operational intent reference general area is synchronized
(3x)
|
| Pass |
Propagated operational intent reference contains the correct manager
(3x)
|
| Pass |
Propagated operational intent reference contains the correct USS base URL
(3x)
|
| Pass |
Propagated operational intent reference contains the correct state
(3x)
|
| Pass |
Propagated operational intent reference contains the correct start time
(3x)
|
| Pass |
Propagated operational intent reference contains the correct end time
(3x)
|
| Pass |
ASTM SCD DSS: Subscription Synchronization
|
Subscription Synchronization
|
Query newly created subscription
|
Subscription can be found at every DSS
(3x)
|
| Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
| Pass |
Propagated subscription contains the correct start time
(3x)
|
| Pass |
Propagated subscription contains the correct end time
(3x)
|
| Pass |
Propagated subscription contains the correct version
(3x)
|
| Pass |
Propagated subscription contains the correct notification flags
(3x)
|
| Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
| Pass |
Propagated subscription contains expected notification count
(3x)
|
| Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
| Pass |
Query updated subscription
|
Subscription can be found at every DSS
(3x)
|
| Pass |
Propagated subscription contains the correct USS base URL
(3x)
|
| Pass |
Propagated subscription contains the correct start time
(3x)
|
| Pass |
Propagated subscription contains the correct end time
(3x)
|
| Pass |
Propagated subscription contains the correct version
(3x)
|
| Pass |
Propagated subscription contains the correct notification flags
(3x)
|
| Pass |
Propagated subscription contains the correct implicit flag
(3x)
|
| Pass |
Propagated subscription contains expected notification count
(3x)
|
| Pass |
Secondary DSS returns the subscription in searches for area that contains it
(3x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(3x)
|
| Pass |
Verify mutation on all secondaries
|
Subscription can be found at every DSS
(6x)
|
| Pass |
Propagated subscription contains the correct USS base URL
(6x)
|
| Pass |
Propagated subscription contains the correct start time
(6x)
|
| Pass |
Propagated subscription contains the correct end time
(6x)
|
| Pass |
Propagated subscription contains the correct version
(6x)
|
| Pass |
Propagated subscription contains the correct notification flags
(6x)
|
| Pass |
Propagated subscription contains the correct implicit flag
(6x)
|
| Pass |
Propagated subscription contains expected notification count
(6x)
|
| Pass |
Secondary DSS returns the subscription in searches for area that contains it
(6x)
|
| Pass |
Secondary DSS does not return the subscription in searches not encompassing the general area of the subscription
(6x)
|
| Pass |
Query deleted subscription
|
DSS should not return the deleted subscription
(3x)
|
| Pass |
Delete subscriptions on secondaries
|
DSS should not return the deleted subscription
(9x)
|
| Pass |
ASTM SCD DSS: USS Availability Synchronization
|
Setup
|
Ensure test USS has Unknown availability
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability synchronization
|
Check Normal USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
Check Down USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
Check Unknown USS availability broadcast
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| Pass |
Unknown USS state is reported as Unknown
|
Query all DSS instances with an unknown USS identifier
|
USS Availability is consistent across every DSS instance
(3x)
|
| Pass |
USS Availability version is consistent across every DSS instance
(3x)
|
| DSS0300 |
Pass |
ASTM F3548-21 UTM DSS interoperability
|
Prerequisites
|
Test environment requirements
|
DSS instance is reachable
(2x)
|
| Fail |
DSS instance is publicly addressable
(2x)
|
| GEN0100 |
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Recently Ended Flight
|
Incorrectly planned
|
| GEN0105 |
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Recently Ended Flight
|
Incorrectly planned
|
| GEN0300 |
Pass |
ASTM F3548 UTM aggregate checks
|
Interoperability test instance is available
|
Interoperability test instance is available
|
Interoperability test instance is available
|
| GEN0305 |
Pass |
ASTM F3548-21 evaluate system versions
|
Evaluate versions
|
Evaluate current system versions
|
Test software version matches production
|
| Pass |
At most one participant is testing a new software version
|
| Pass |
Evaluate system version consistency
|
Software versions are consistent throughout test run
|
| GEN0310 |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Check for flight planning readiness
|
Flight planning USS ready
(2x)
|
| GEN0500 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Validate tested USS intersection algorithm
(2x)
|
| Pass |
Validation of operational intents
|
Validate precision of intersection computations
|
Attempt to plan Tiny Overlap Conflict Flight
|
Incorrectly planned
|
| OPIN0015 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Off-nominal volumes
(2x)
|
| Not tested |
Mock_uss plans Flight 2
|
Off-nominal volumes
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Off-nominal volumes
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Off-nominal volumes
|
| Not tested |
mock_uss plans flight 2
|
Off-nominal volumes
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Off-nominal volumes
(2x)
|
| Pass |
Plan Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Off-nominal volumes
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Off-nominal volumes
(2x)
|
| Pass |
Plan Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Activate Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Off-nominal volumes
(2x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Activate Flight 2
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
Off-nominal volumes
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Off-nominal volumes
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Off-nominal volumes
(2x)
|
| Pass |
Plan Flight 2m
|
Off-nominal volumes
(2x)
|
| Not tested |
Declare Flight 2 non-conforming
|
Off-nominal volumes
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Off-nominal volumes
|
| Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Off-nominal volumes
|
| Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Off-nominal volumes
|
| OPIN0020 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Vertices
(2x)
|
| Not tested |
Mock_uss plans Flight 2
|
Vertices
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Vertices
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Vertices
|
| Not tested |
mock_uss plans flight 2
|
Vertices
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Vertices
(2x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Vertices
(2x)
|
| Pass |
Plan Flight 2
|
Vertices
(2x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
Vertices
(2x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Vertices
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Vertices
(2x)
|
| Pass |
Plan Flight 2
|
Vertices
(2x)
|
| Pass |
Activate Flight 2
|
Vertices
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Vertices
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Vertices
(2x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Vertices
(2x)
|
| Pass |
Activate Flight 2
|
Vertices
(2x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Vertices
(2x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
Vertices
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Vertices
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Vertices
(2x)
|
| Pass |
Plan Flight 2m
|
Vertices
(2x)
|
| Not tested |
Declare Flight 2 non-conforming
|
Vertices
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Vertices
|
| Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Vertices
|
| Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Vertices
|
| OPIN0025 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Not tested |
Mock_uss plans Flight 2
|
Operational intent shared correctly
|
| Not tested |
Operational intent details retrievable
|
| Not tested |
Correct operational intent details
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent shared correctly
|
| Not tested |
Operational intent details retrievable
|
| Not tested |
Correct operational intent details
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Operational intent shared correctly
|
| Pass |
Operational intent details retrievable
|
| Pass |
Correct operational intent details
|
| Not tested |
mock_uss plans flight 2
|
Operational intent shared correctly
|
| Not tested |
Operational intent details retrievable
|
| Not tested |
Correct operational intent details
|
| Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
Operational intent shared correctly
|
| Not tested |
Operational intent details retrievable
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Plan Flight 2m
|
Operational intent shared correctly
(2x)
|
| Pass |
Operational intent details retrievable
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Not tested |
Declare Flight 2 non-conforming
|
Operational intent shared correctly
|
| Not tested |
Operational intent details retrievable
|
| Not tested |
Correct operational intent details
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent shared correctly
|
| Not tested |
Operational intent details retrievable
|
| Not tested |
Correct operational intent details
|
| Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent shared correctly
|
| Pass |
Operational intent details retrievable
|
| Pass |
Correct operational intent details
|
| Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent shared correctly
|
| Pass |
Operational intent details retrievable
|
| Pass |
Correct operational intent details
|
| OPIN0030 |
Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Too Far Away Flight
|
Incorrectly planned
|
| OPIN0035 |
Pass |
ASTM F3548-21 UTM DSS Operational Intent Reference Access Control
|
Attempt unauthorized operational intent reference modification
|
Attempt unauthorized operational intent reference modification
|
Non-owning credentials cannot modify operational intent
(3x)
|
| Pass |
Non-owning credentials cannot delete operational intent
|
| OPIN0040 |
Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Remove Valid Flight
|
Operational intent not shared
|
| SCD0035 |
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
Validate that tested_uss obtained flight2 details
|
USS obtained operational intent details by means of either notification or GET request
|
| Pass |
Flight planning prevented due to invalid data sharing
|
tested_uss attempts to plan flight 1, expect failure
|
Plan should fail
|
| Pass |
Validate that tested_uss obtained flight2 details
|
USS obtained operational intent details by means of either notification or GET request
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Attempt to plan Flight 1
|
Incorrectly planned
(2x)
|
| SCD0040 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to modify planned flight into conflict
|
Attempt to modify planned Flight 1c into conflict
|
Incorrectly modified
(2x)
|
| SCD0045 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to activate flight into conflict
|
Attempt to directly activate conflicting Flight 1
|
Incorrectly activated
(2x)
|
| SCD0050 |
Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to modify activated flight into conflict
|
Attempt to modify activated Flight 1c into conflict
|
Incorrectly modified
(2x)
|
| SCD0075 |
Pass |
ASTM F3548 UTM aggregate checks
|
Performance of SCD requests to USS
|
Performance of successful operational intent details requests
|
Operational intent details requests take no more than [MaxRespondToOIDetailsRequest] second 95% of the time
|
| SCD0080 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Validate Flight 2 notification received by tested_uss
|
Tested USS receives valid notification
|
| Pass |
Modify Activated operational intent area and receive notification of relevant intent
|
Validate Flight 2 notification received by tested_uss
|
Tested USS receives valid notification
|
| SCD0085 |
Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
Validate flight1 Notification sent to mock_uss
|
Expect Notification sent
(2x)
|
| Not tested |
Notification data is valid
|
| SCD0090 |
Pass |
ASTM F3548 UTM aggregate checks
|
Notifications to operator
|
Notifications for causing conflicts
|
Notifications for causing conflicts
|
| SCD0095 |
Pass |
ASTM F3548 UTM aggregate checks
|
Notifications to operator
|
Notifications for observing conflicts
|
Notifications for observing conflicts
|
| USS0005 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent shared correctly
(2x)
|
| Not tested |
Mock_uss plans Flight 2
|
Operational intent shared correctly
|
| Not tested |
Validate Flight 2 notification received by tested_uss
|
Mock USS sends valid notification
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent shared correctly
|
| Not tested |
Validate Flight 2 notification received by tested_uss
|
Mock USS sends valid notification
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Operational intent shared correctly
|
| Not tested |
mock_uss plans flight 2
|
Operational intent shared correctly
|
| Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
Operational intent shared correctly
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
Operational intent shared correctly
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent shared correctly
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent shared correctly
(2x)
|
| Pass |
Plan Flight 2m
|
Operational intent shared correctly
(2x)
|
| Not tested |
Declare Flight 2 non-conforming
|
Operational intent shared correctly
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent shared correctly
|
| Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent shared correctly
|
| Pass |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent shared correctly
|
| USS0105,1 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Not tested |
Mock_uss plans Flight 2
|
Operational intent details retrievable
|
| Not tested |
Operational intent details data format
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent details retrievable
|
| Not tested |
Operational intent details data format
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Operational intent details retrievable
|
| Pass |
Operational intent details data format
|
| Not tested |
mock_uss plans flight 2
|
Operational intent details retrievable
|
| Not tested |
Operational intent details data format
|
| Not tested |
Flight planning prevented due to invalid data sharing
|
mock_uss plans flight 2, sharing invalid operational intent data
|
Operational intent details retrievable
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Pass |
Plan Flight 2m
|
Operational intent details retrievable
(2x)
|
| Pass |
Operational intent details data format
(2x)
|
| Not tested |
Declare Flight 2 non-conforming
|
Operational intent details retrievable
|
| Not tested |
Operational intent details data format
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent details retrievable
|
| Not tested |
Operational intent details data format
|
| Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent details retrievable
|
| Pass |
Operational intent details data format
|
| Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Recently Ended Flight
|
Incorrectly planned
|
| Pass |
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent details retrievable
|
| Pass |
Operational intent details data format
|
| USS0105,3 |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Validate Flight 2 notification received by tested_uss
|
Tested USS receives valid notification
|
| Pass |
Modify Activated operational intent area and receive notification of relevant intent
|
Validate Flight 2 notification received by tested_uss
|
Tested USS receives valid notification
|
| USS0105,4 |
Pass |
ASTM F3548 makeUssReport
|
Call makeUssReport interface
|
Call makeUssReport interfaces
|
makeUssReport responds correctly
|
interuss .automated_testing .flight_planning |
ClearArea |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Area clearing
|
Area cleared successfully
(8x)
|
| DeleteFlightSuccess |
Pass |
Awareness of relevant operational intents
|
Cleanup
|
Cleanup
|
Successful flight deletion
|
| Pass |
Nominal planning: conflict with higher priority
|
Cleanup
|
Cleanup
|
Successful flight deletion
(4x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Cleanup
|
Cleanup
|
Successful flight deletion
(4x)
|
| Pass |
Off-Nominal planning: down USS
|
Cleanup
|
Cleanup
|
Successful flight deletion
|
| Pass |
Validation of operational intents
|
Cleanup
|
Cleanup
|
Successful flight deletion
|
| ExpectedBehavior |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Successful activation
|
| Not tested |
Mock_uss plans Flight 2
|
Successful planning
|
| Not tested |
Failure
|
| Not tested |
Injection fidelity
|
| Not tested |
Operational intent state is correct
|
| Not tested |
Correct operational intent details
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Successful modification
|
| Not tested |
Failure
|
| Not tested |
Injection fidelity
|
| Not tested |
Operational intent state is correct
|
| Not tested |
Correct operational intent details
|
| Pass |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
tested_uss plans flight 1
|
Failure
|
| Pass |
Injection fidelity
|
| Pass |
Successful planning
|
| Pass |
Operational intent state is correct
|
| Pass |
Correct operational intent details
|
| Pass |
Delete tested_uss flight
|
Successful deletion
|
| Not tested |
mock_uss plans flight 2
|
Successful planning
|
| Not tested |
Failure
|
| Not tested |
Injection fidelity
|
| Not tested |
Operational intent state is correct
|
| Not tested |
Correct operational intent details
|
| Not tested |
Delete mock_uss flight
|
Successful deletion
|
| Pass |
Flight planning prevented due to invalid data sharing
|
tested_uss attempts to plan flight 1, expect failure
|
Operational intent not shared
|
| Not tested |
mock_uss plans flight 2, sharing invalid operational intent data
|
Successful planning
|
| Not tested |
Failure
|
| Not tested |
Injection fidelity
|
| Not tested |
Delete mock_uss flight
|
Successful deletion
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to plan flight in conflict
|
Plan Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to plan Flight 1
|
Failure
(2x)
|
| Pass |
Operational intent not shared
(2x)
|
| Pass |
Delete Flight 2
|
Successful deletion
(2x)
|
| Pass |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Plan Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify planned Flight 1 in conflict
|
Failure
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Failure
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Delete Flight 2
|
Successful deletion
(2x)
|
| Pass |
Activate Flight 1
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful activation
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Plan Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Activate Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful activation
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful modification
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify activated Flight 1 into conflict
|
Failure
(2x)
|
| Pass |
Operational intent not shared
(2x)
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Plan Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Activate Flight 2
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful activation
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to plan Flight 1
|
Failure
(2x)
|
| Pass |
Operational intent not shared
(2x)
|
| Pass |
Attempt to activate flight into conflict
|
Attempt to directly activate conflicting Flight 1
|
Failure
(2x)
|
| Pass |
Operational intent not shared
(2x)
|
| Pass |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify planned Flight 1c into conflict
|
Failure
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful activation
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Attempt to modify activated Flight 1c into conflict
|
Failure
(2x)
|
| Pass |
Operational intent not shared
(2x)
|
| Pass |
Delete Flight 2
|
Successful deletion
(2x)
|
| Not tested |
Delete Flight 1c if USS did not support its modification
|
Successful deletion
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful activation
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Plan Flight 2m
|
Failure
(2x)
|
| Pass |
Injection fidelity
(2x)
|
| Pass |
Successful planning
(2x)
|
| Pass |
Operational intent state is correct
(2x)
|
| Pass |
Correct operational intent details
(2x)
|
| Pass |
Declare Flight 2 non-conforming
|
Failure
(2x)
|
| Pass |
Successful transition to non-conforming state
(2x)
|
| Not tested |
Injection fidelity
|
| Not tested |
Operational intent state is correct
|
| Not tested |
Correct operational intent details
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Successful flight intent handling
|
| Not tested |
Failure
|
| Not tested |
Operational intent state is correct
|
| Not tested |
Correct operational intent details
|
| Not tested |
Operational intent not shared
|
| Pass |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Failure
|
| Pass |
Injection fidelity
|
| Pass |
Operational intent state is correct
|
| Pass |
Correct operational intent details
|
| Not tested |
Operational intent not shared
|
| Pass |
Off-Nominal planning: down USS with equal priority conflicts not permitted
|
Plan Flight 2 in conflict with activated operational intent managed by down USS
|
Tested USS attempts to plan Flight 2
|
Failure
|
| Pass |
Operational intent not shared
|
| Not tested |
Plan Flight 2 in conflict with nonconforming operational intent managed by down USS
|
Tested USS attempts to plan Flight 2
|
Failure
|
| Not tested |
Operational intent not shared
|
| Not tested |
Plan Flight 2 in conflict with contingent operational intent managed by down USS
|
Tested USS attempts to plan Flight 2
|
Failure
|
| Not tested |
Operational intent not shared
|
| Pass |
Validation of operational intents
|
Attempt to plan invalid flights
|
Attempt to plan Too Far Away Flight
|
Failure
|
| Pass |
Operational intent not shared
|
| Pass |
Attempt to plan Recently Ended Flight
|
Failure
|
| Pass |
Operational intent not shared
|
| Pass |
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Failure
|
| Pass |
Injection fidelity
|
| Pass |
Successful planning
|
| Pass |
Operational intent state is correct
|
| Pass |
Correct operational intent details
|
| Pass |
Remove Valid Flight
|
Successful deletion
|
| Not tested |
Operational intent not shared
|
| Pass |
Validate precision of intersection computations
|
Plan Valid Flight
|
Failure
|
| Pass |
Injection fidelity
|
| Pass |
Successful planning
|
| Pass |
Attempt to plan Tiny Overlap Conflict Flight
|
Failure
|
| Pass |
Operational intent not shared
|
| FlightCoveredByOperationalIntent |
Pass |
Awareness of relevant operational intents
|
Activated operational intent receives notification of relevant intent
|
Tested_uss plans and activates Flight 1
|
Operational intent for active flight not deleted
|
| Not tested |
Mock_uss plans Flight 2
|
Operational intent for active flight not deleted
|
| Not tested |
Modify Activated operational intent area and receive notification of relevant intent
|
Mock_uss modifies planned Flight 2
|
Operational intent for active flight not deleted
|
| Not tested |
Data Validation of GET operational intents by USS
|
Successfully plan flight near an existing flight
|
mock_uss plans flight 2
|
Operational intent for active flight not deleted
|
| Not tested |
tested_uss plans flight 1
|
Operational intent for active flight not deleted
|
| Pass |
Nominal planning: conflict with higher priority
|
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent for active flight not deleted
(2x)
|
| Pass |
Activate Flight 2
|
Operational intent for active flight not deleted
(2x)
|
| Pass |
Modify activated Flight 1 in conflict with activated Flight 2
|
Operational intent for active flight not deleted
(2x)
|
| Not tested |
Plan Flight 2
|
Operational intent for active flight not deleted
|
| Pass |
Attempt to modify activated flight into conflict
|
Modify activated Flight 2 to not conflict with activated Flight 1
|
Operational intent for active flight not deleted
(2x)
|
| Not tested |
Attempt to plan flight in conflict
|
Plan Flight 2
|
Operational intent for active flight not deleted
|
| Not tested |
Attempt to modify planned flight in conflict
|
Plan Flight 1
|
Operational intent for active flight not deleted
|
| Not tested |
Plan Flight 2
|
Operational intent for active flight not deleted
|
| Not tested |
Attempt to modify planned Flight 1 in conflict
|
Operational intent for active flight not deleted
|
| Not tested |
Attempt to activate flight in conflict
|
Attempt to activate conflicting Flight 1
|
Operational intent for active flight not deleted
|
| Pass |
Nominal planning: not permitted conflict with equal priority
|
Attempt to plan flight into conflict
|
Activate Flight 2
|
Operational intent for active flight not deleted
(2x)
|
| Not tested |
Plan Flight 2
|
Operational intent for active flight not deleted
|
| Pass |
Attempt to modify activated flight into conflict
|
Activate Flight 1c
|
Operational intent for active flight not deleted
(2x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 1
|
Operational intent for active flight not deleted
(2x)
|
| Not tested |
Plan Flight 2m
|
Operational intent for active flight not deleted
|
| Not tested |
Declare Flight 2 non-conforming
|
Operational intent for active flight not deleted
|
| Not tested |
Attempt to modify activated Flight 1 in conflict with nonconforming Flight 2
|
Operational intent for active flight not deleted
|
| Not tested |
Attempt to modify planned flight into conflict
|
Plan Flight 1c
|
Operational intent for active flight not deleted
|
| Not tested |
Attempt to modify planned Flight 1c into conflict
|
Operational intent for active flight not deleted
|
| Not tested |
Off-Nominal planning: down USS
|
Plan Flight 1 in conflict with accepted operational intent managed by down USS
|
Tested USS attempts to plan Flight 1
|
Operational intent for active flight not deleted
|
| Not tested |
Validation of operational intents
|
Validate transition to Ended state after cancellation
|
Plan Valid Flight
|
Operational intent for active flight not deleted
|
| ImplementAPI |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Check for flight planning readiness
|
Valid response to readiness query
(2x)
|
| Pass |
Area clearing
|
Valid response to clearing query
(8x)
|
| Pass |
Nominal planning: conflict with higher priority
|
Attempt to modify planned flight in conflict
|
Plan Flight 2
|
Retrieve pre-existing notifications
(4x)
|
| Pass |
Check for conflict notifications
|
Retrieve notifications
(3x)
|
| Pass |
Modify activated flight with pre-existing conflict
|
Activate Flight 2
|
Retrieve pre-existing notifications
(4x)
|
| Pass |
Check for conflict notifications
|
Retrieve notifications
(3x)
|
| Readiness |
Pass |
ASTM F3548 flight planners preparation
|
Flight planners preparation
|
Check for flight planning readiness
|
Flight planning USS ready
(2x)
|
interuss .f3548 .notification_requirements |
NoDssEntityNoNotification |
Pass |
Data Validation of GET operational intents by USS
|
Flight planning prevented due to invalid data sharing
|
Validate flight 1 Notification not sent to mock_uss
|
Expect Notification not sent
|