10. Operational Acceptance

Contents

Regularly test the end-to-end services in an environment identical to that of the live version, including on all common browsers and devices, and using dummy accounts and a representative sample of users.

How point 10 improves their service

Testing the end-to-end service allows them to:

  • find problems
  • check that the service will work for the number of people who want to use it

How they’ll be assessed

Their assessment and the questions the assessors ask them will vary depending on their service and what it does.

In the discovery assessment

To pass the discovery assessment, the service team usually needs to show that they:

  • have a plan for testing their alpha and have identified how they’ll perform automated testing
  • the plan for testing should include development testing and after acceptance testing for bug capture
  • have an approach to capturing the end user experience and taking action on feedback
  • have shown any non-functional requirements they are planning to test during alpha

In the alpha and beta assessment

To pass the alpha and beta assessments, they usually need to show that they:

  • have an effective deployment environment
  • can create new environments quickly and easily
  • know the data that exists in their pre-production environments
  • are designing and testing their service to work with the devices and browsers their users use - find out the browsers they must test with
  • are testing their service in an environment that’s as similar to live as possible
  • know that their service can keep working when the number of expected users try to use it, including for users who need assisted digital support
  • understand the systems they need and the testing environments for non-digital parts of the service
  • are testing their service frequently - they’ll have to explain how they’ve decided how often to test