Services

TEST & EVALUATION (T&E)

T&E is conducted to satisfy the following objectives:

As specified in program documents, assess the critical technical issues:

Determine how well the development contract specifications have been met;
Identify system technical deficiencies and focus on areas for corrective actions;
Determine whether the system is compatible, inter-operable, and can be integrated
with existing and planned equipment or systems;
Estimate the Reliability, Availability, and Maintainability (RAM) of the system
after it is deployed;
Determine whether the system is safe and ready for Production;
Evaluate effects on performance of any configuration changes caused by correcting
deficiencies, modifications, or Product Improvements;
Assess human factors and identify limiting factors.

Assess the technical risk and evaluate the trade-offs among specifications, operational
requirements, life cycle costs, and schedules;
Assess the survivability, vulnerability, and logistics supportability of the system;
Verify the accuracy and completeness of then technical documentation developed to
maintain and operate the weapons system;
Gather information for training programs and technical training materials needed to
support the weapons system;
Provide information on environmental issues for use in preparing environmental impact
assessments; and
Determine system performance limitations and safe operating parameters.

GWIS believes that a good testing strategy relies on early and continuous user and Test and
Evaluation (T&E) community involvement from a Net-Centric perspective. The strategy will start
with contractor demonstrations prior to contract award; development of a stable and robust beta
user group to support all levels of testing; and a series of Early User Tests (EUTs) that involve
developmental and operational events to confirm individual services and products, or groups of
services and products meet performance specifications and enable user defined capabilities.

The Five (5) Phases of how each EUT is developed is discussed below:

Phase 1 – Review of Managed Service RFPs/PWSs/SLAs

Develop Requirement Traceability Matrix to ensure requirements/metrics are linked to
the RFP/PWS/SLA requirements
Provide input to user evaluation plan criteria for demonstration
A Vendor's Requirements Checklist of the functionality
A solicitation for User Representation to be part of the Source Selection Evaluation Board

Phase 2 – Support Source Selection

Verify Service Providers demonstrate ability to meet requirements in RFP
Verify operational users are involved in demonstration
Provide User Scenarios and Operational Threads during the source selection process and
collect data during demonstrations to assist the Program in the assessment of proposed
managed services’ ability to meet service requirements identified in the RFP
Verify functionality of productized versions, as applicable
Obtain user scenario data as input to run the Benchmark Test

Phase 3 – Capability Verification Testing (Post-award) against the Acquisition Program Baseline.

A Solicitation for dedicated users to participate in EUTs
Conduct Certification and Accreditation (C&A) of services
Perform dry run to ensure accessibility and verify production processes in place
Compare MSP PWS/SLA Metrics against Requirement Metrics
Validate that the MSP PWS/SLA Metrics are based on industry best practices—using a
business practice industry research

Phase 4 (EUT Part 1) – Conduct Beta Testing with limited beta users

Perform beta testing in accordance with industry best practices
Conduct beta tests with a limited set of Beta Users to evaluate functionality, performance,
interoperability, security, effectiveness, and suitability in beta user environment

Phase 5 (EUT Part 2) – Conduct Beta Test with Entire Beta Community

An Independent OTA Lead provides EUT report summarizing results from exercises,
experiments, directed and day-to-day usage by beta community
Includes mission thread and simultaneous usage to evaluate scalability, stability, and
verify PWS/SLA metrics
Initial Operational Test & Evaluation (IOT&E) for Operational Testing Event
Perform official Operational Testing in accordance with the Agency or client policies
and/or guidelines

If you would like to learn more about how we can help. Let’s Talk.

Risk Advisory Service (RAS)

Financial Systems/Resources

Independent Verification &
Validation (IV&V)

Software Quality Assurance
(SQA)

Continuous Process
Improvement (CPI)

Test & Evaluation (T&E)

Information Assurance (IA)

Anchored in Integrity