About Test Criteria

The criteria applied to testing is intended to be a fair representation of processes and criteria that is typically used by large Enterprises in the packaging and deployment of applications today. These organizations know that they have many choices on how to deploy an application and are not likely to accept feature reduction just to deploy using a given technology. In the criteria we use, only packages that have the full fidelity of features that an Enterprise is likely to want meet the Acceptable level. If you want to consider what the test results would look like with a less strict criteria, you would combine both the Acceptable and Partial Featurecategories.

The criteria definitions are as follows:

CategoryDescription
Failed PackagingIt was not possible to produce a package for the application using the tooling.
Failed SmokeIt was not possible to deploy and run a test of the application. The smoke testgenerally consists of launching the application without attempting to utilize much of the functionality of the app.
Failed FeatureA primary feature of the app failed to work properly. In our judgement the lack of this feature is important enough to prevent deployment in most all customers.
Partial FeatureA feature failed to work that might be considered optional to some customers.
AcceptedThe application appears to completely work. The testing we do for this assessment is not what a full enterprise acceptance test plan might include for the app, but to achieve this category we have done a reasonable job of testing the app to feel confident enough that we would pass it on to the customer for their acceptance testing and deployment.
Back to Report Card Central
© 2020 m6conf.com. All Rights Reserved.