5 FAH-5 H-400
quality Assurance
5 FAH-5 H-410
QUALITY ASSURANCE DISCIPLINE
(CT:ITS-8; 06-09-2017)
(Office of Origin: IRM/BMP/GRP/GP)
5 FAH-5 H-411 QUALITY ASSURANCE
DISCIPLINE
(TL:ITS-1; 02-13-2002)
a. The Quality Assurance (QA) discipline provides a
mechanism that stipulates all products developed will meet specific Department
of State documented requirements.
b. QA provides a framework from which to monitor the
requirements and specifications. It helps to ensure that project guidelines,
policies, and procedures are being followed in the development of services and
products. The QA discipline includes a comprehensive QA plan that defines the
best practices documented by the Department. QA procedures will specifically
define various techniques, practices, and processes in conjunction with
reviews, audits, and inspections.
c. Managers must adhere to the guidelines concerning
acquisition reform standards for contractors (see 5 FAM 614), and
include these standards in a QA contract plan.
5 FAH-5 H-412 QUALITY ASSURANCE PLAN
(TL:ITS-1; 02-13-2002)
a. Provide a well-documented QA plan during project
initiation to ensure that the development of the project follows established
project guidelines for producing a complete, accurate, and easily understood
product within the framework of the life cycle model. This plan will provide
monitoring and review techniques that QA will employ throughout the life cycle
(see 5 FAH-5
Exhibit H-412).
b. Tailor the QA plan to individual projects in
accordance with the project plan. Update the QA plan each time the project plan
is updated to ensure consistency of activities and control gates.
c. A QA plan that has been produced for a contract
should also adhere to the recent guidelines for performance-based contracting.
Incorporate any changes or deviations from a QA contract plan into the project
QA plan.
5 FAH-5 H-413 REVIEWS AND EVALUATIONS
(TL:ITS-1; 02-13-2002)
a. The QA function will be effective if it works with
all of the projects functions to build in quality reviews and audits over the
course of the products development. QA must have the support of Department of
State upper management as well as project management for QA evaluations to be
meaningful and acted upon.
b. The QA manager ensures that all activities that take
place during the life of the project are in compliance with the QA plan,
standards, and procedures that have been defined for the project. Products and
activities must be evaluated and scheduled audits and reviews should focus on
products and/or processes.
c. The QA input to the project plan should focus on
the following:
(1) Defining the scope of the authority that QA has on
the project;
(2) Describing the products and activities that will
be reviewed by QA;
(3) Defining the standards to be used as the basis for
QA evaluations;
(4) Defining the steps to follow while performing
audits and reviews
(5) Developing a schedule for audits to take place;
(6) Defining the organizational structure of QAs
reporting channel; and
(7) Describing how problems will be addressed that
cannot be resolved.
d. Use established QA control gates in the QA plan to
record and report the results of the evaluation process.
5 FAH-5 H-414 QUALITY ASSURANCE LIFE
CYCLE MANAGEMENT
(TL:ITS-1; 02-13-2002)
Perform QA throughout the development effort to implement
and execute timely evaluation of risks and other factors that could affect the
quality of the process and/or the product. See 5 FAH-5 Exhibit
H-414 Quality Assurance Life Cycle Management for a crosswalk between MSP
and life cycle management.
5 FAH-5 H-415 STUDY PERIOD
(TL:ITS-1; 02-13-2002)
a. QA during the study period conducted by the
sponsors, users, and project team defines the new system or changes to an
existing system. The project team develops the project plan, which establishes
the standards and procedures to conduct the project. QA ensures that the tasks
are accomplished properly. The main concern during the study period is the QA
plan. This plan supports the project plan and identifies and defines the
mechanisms which ensure that quality is built into the system.
b. The QA results should support the functional
requirement review and determine advancement to the next phase.
c. During the study period QA also provides the
management plan to the QA section. See 5 FAH-5 Table 415 for a summary of the
QA planning activities during the study period.
5 FAH-5 Table H-415
Quality Assurance Planning
Activities
|
PURPOSE
(Study Period)
|
ACTIVITY
(Project Initiation)
|
|
Assessment Request (AR) and/or Change
Request (CR)
|
QA conducts the review in accordance with the (AR/CR) QA
Checklist (see 5 FAH-5
Exhibit H-415(1).
|
|
Risk Analysis
|
QA conducts the review in accordance with the risk
analysis QA checklist (see 5 FAH-5
Exhibit H-415(2).
|
|
Feasibility Study and Benefit and/or Cost
Analysis
|
The feasibility study and the BCA are prepared according
to this handbook in 5
FAH-5 H-600. QA conducts review of the feasibility study and BCA in
accordance with the Feasibility Study QA Checklist (see 5 FAH-5
Exhibit H-415(3) and the Benefit and/or Cost Analysis QA Checklist (see 5 FAH-5
Exhibit H-415(4) respectively.
|
|
Project Plan
|
The QA Manager will assist the project manager in
developing the project plan by:
(1) Providing recommended tailoring of the
organizations QA plan to meet project needs, resources, and schedule, and
(2) Coordinating QA personnel availability for the
project. QA conducts review of the Project Plan QA Checklist (see 5 FAH-5
Exhibit H-415(5).
|
|
Quality Assurance Plan
|
QA plans must be written for every project requiring a
project plan. QA plans must be tailored to individual projects and must
normally be created to parallel the project plan.
|
|
PURPOSE
(Study Period)
|
|
|
Functional Requirements Specification
(FRS)
|
Perform QA based on both the functional and non-functional
requirements specified in the FRS. Conduct QA review of the FRS using the
FSR QA Checklist (see 5 FAH-5
Exhibit H-415(6).
|
|
Acceptance Criteria
|
A key QA responsibility is to ensure that the acceptance
criteria are consistent with the FRS and do not implicitly or explicitly
change the requirements in the FRS. Use the QA acceptance criteria checklist
to conduct the acceptance criteria review (see 5 FAH-5
Exhibit H-415(7).
|
|
Functional Requirements Review (FRR)
|
The QA process provides assistance to the program manager
in regards to conducting the FRR.
|
|
Project Plan
|
Update the project plan created during the project
initiation phase. QA focuses on the planned design activities. If the
project manager has made changes to the project plan, then QA needs to focus
on those areas. A full review must be conducted as defined by the project
plan QA checklist. See 5 FAH-5
Exhibit H-415(5).
|
|
PURPOSE
(Study Period)
|
ACTIVITY
(Preliminary Design)
|
|
System and/or Subsystem Specification
(SSS)
|
The SSS identifies and defines system components. QA
conducts a review of the SSS using the system and/or subsystem specification
QA checklist. The checklist consists of the following quality attributes:
Identification, type, purpose, function, subordinates, dependencies,
interface, and resources (see 5 FAH-5
Exhibit H-415(8).
|
Preliminary Design Review (PDR)
|
The PDR is conducted by the project manager. QA documents
the PDR findings, decisions, and recommendations that become action items to
which the project manager must respond before the SSS is finalized.
By using the identification and purpose quality attributes
in the SSS and the requirement reference numbers in FRS, QA can verify the
traceability matrix prepared by the designers.
|
|
Project Plan
|
The project plan is updated after the preliminary design
has been devised. QAs review of the project plan is similar to the review
conducted during requirements analysis, although attention should be focused
on the planned detailed design activities.
|
5 FAH-5 H-416 ACQUISITION PERIOD
(TL:ITS-1; 02-13-2002)
a. Acquisition should begin with the most effective
resource planning. System specifications are developed and QA is performed to
ensure system quality and attributes.
b. Perform QA to track requirements and conduct the
necessary reviews and evaluations to document quality at various control
gates. This action should be taken prior to acquiring resources.
c. Move to the next step only when QA controls and CM
of all hardware and software items (including documentation) are in place. See
5 FAH-5 Table H-416 for QA planning activities during the acquisition period.
|
PURPOSE
(Acquisition)
|
ACTIVITY
(Detailed Design)
|
|
Program Specification (PS)
|
The PS reveals internal design, including inputs, outputs,
plus data base and file specifications, as well as processing and performance
characteristics for each design component identified in the preliminary
design.
Design Quality Attributes
At a minimum QA must be performed to ensure that these
attributes are
addressed and documented for each component and subcomponent in the program
specification.
Document Quality Attributes
The quality attributes identified for an SSS also apply to
a program specification. Two additional quality attributes for a program
specification are process and data.
Test Specification
Multiple tests are required for each module. Quality
attributes of a module test include identification, description, assumptions,
initialization, instrumentation, limitations, inputs, anticipated outputs,
and output assessment. In addition to ensuring that the systems coupling
and cohesion requirements, specified in the SSS, have been met and that tests
for each program and module have been performed. QA is to review the program
specification using the Program Specification QA Checklist (see 5 FAH-5
Exhibit H-416(1)).
|
|
System Test Plan
|
After ensuring that the SSS and PS specifications have
been met, perform QA on the system test using the System Test QA Checklist
(see 5
FAH-5 Exhibit H-416(2)).
|
|
Conversion Plan
|
The conversion plan is used for both creation and
significant modification activities. QA should ensure that the references
are correct. Perform QA on the conversion plan using the conversion plan QA
checklist (see 5 FAH-5 Exhibit H- 416(3)).
|
5 FAH-5 H-417 OPERATIONS AND
MAINTENANCE PERIOD
(TL:ITS-1; 02-13-2002)
Perform QA:
(1) During implementation to ensure that the new
system is available to users and operators while undergoing modification. QA
plays a vital role in testing and ensuring that the product or service is
functioning according to plan and that the results are in compliance with
requirements;
(2) To ensure that the system built or modified is
tested according to QA standards. Ensure that proper training is provided for
users and that standards are in place in accordance with the planned
operational environment; and
(3) To thoroughly examine the system and review
acceptance and/or regression test reports to ensure that the tests conducted
yield the expected results as planned. See 5 FAH-5 Table H-417 for planning
activities and procedures during the operations and maintenance period.
5 FAH-5 Table H-417
Quality Assurance Planning Activities
|
PURPOSE
(Operations & Maintenance)
|
ACTIVITY
(Implementation)
|
|
User Manual
Operations Manual
System Administration Manual
Program Maintenance Manual
|
QA verifies that the traceability matrix prepared by the
implementation personnel have the following:
(1) All user functions identified in each manual are shown in the matrix;
(2) All PS components and subcomponents are shown in the matrix;
(3) Each PS component and subcomponent is traceable to at least one user
function;
(4) Each user function is traceable to at least one PS component or
subcomponent.
QA does the review of manuals by using the (see 5 FAH-5
Exhibit H-417(1) User Manual QA Checklist, 5 FAH-5
Exhibit H-417(2) Operations Manual QA Checklist, 5 FAH-5
Exhibit H-417(3) System Administration Manual QA Checklist, 5 FAH-5
Exhibit H-417(4) Program Maintenance Manual QA Checklist).
|
|
System Test Report
|
QA conducts a review to verify the traceability matrix
prepared by the implementation personnel and ensures that:
(1) All tests identified in the system test plan are shown in the matrix;
(2) All tests identified in the system test plan report are shown in the
matrix;
(3) Each test in the system test plan is traceable to a test in the system
test report;
(4) Each test in the system test report is traceable to a test in the system
test plan.
QA conducts a review of the system test report using the System Test Report
QA Checklist (see 5 FAH-5
Exhibit H-417(5)).
|
|
Acceptance/Regression Test Report
|
QA must ensure that both the testing and the assessment of
its results were conducted as defined in the plan. Conduct the QA review of
the acceptance and/or regression test report using the Acceptance and/or
Regression Report QA Checklist (see 5 FAH-5
Exhibit H-417(6)).
|
|
Project Plan
|
The project plan is updated after the detailed design is
finalized. QAs review of the project plan is similar to that conducted
during requirements analysis, although attention should be focused on the
planned detailed design activities.
|
5 FAH-5 H-418 AND H-419 UNASSIGNED
5 FAH-5 Exhibit H-412
QA Plan Outline Sample
(TL:ITS-1; 02-13-2002)
INTENDED USE: The Quality
Assurance (QA) plan describes the activities to be performed during system
development to ensure correctness, reliability, usability and maintainability
of the system. The QA plan describes the quality management approach and
procedures to insure product quality throughout the implementation phase and
the configuration management approach for managing and controlling the system
configuration.
INTERRELATIONSHIP: The system
requirements document and system performance specification drive this plan.
The QA plan drives the programming, practices, standards and procedures manual
and programmers manual. The manufacturing plan must be in conformance with
the QA plan.
CONTROL GATE: DraftProject Initiation
Review (PIR), FinalCritical Design Review (CDR)
1.0 IntroductionProvide brief
overview of effort and any complexity or risks.
1.1 PurposeState the purpose as
to why you are conducting QA in order to provide management with the
appropriate reporting process for projects and the quality of the product being
built.
1.2 ScopeSummarize what the plan
will include.
1.3 GoalsState what you expect
to accomplish with this plan.
1.4 Roles And ResponsibilitiesName
the persons performing QA and their areas of responsibility.
1.5 QA Standards and/or ProceduresSummarize
the standards and process used to ensure the quality of product to be delivered
and to set the stage for measurement.
2.0 Control Gates and/or ActivitiesProvide
dates and schedules for assessing the results and what is expected before
moving on to the next phase of development.
2.1 Project PlanState how QA
section of the plan is complete and in compliance with established standards
and procedures.
2.1.1 QA Group ConcurrenceDisplay
the process by which the QA manager and team reach concurrence in regards to
the project plan and schedule. This will assist the group with planning
reviews and activities.
2.1.2 CM ImpactState the
ways QA may affect possible change control during review and/or activities.
2.2 MetricsState how the
planned QA process will determine that the quality level expected is the
quality level that will be met as the final result. Show how quality can be
measured by way of performance-based standards.
2.3 Walkthroughs and ReviewsSummarize
scheduled walkthroughs and reviews and the activities that will be evaluated.
2.3.1 Participate in walkthroughs
2.3.2 Conduct QA reviews
2.3.3 Conduct independent reviews
2.3.4 Identify deviations and/or
noncompliance
2.3.5 Document findings
3.0 Deliverables
3.1 Project plan
3.2 Documentation
3.3 Metrics report
3.4 Discrepancy report
3.5 Independent review report
5 FAH-5 Exhibit H-414
Quality Assurance Life-Cycle Management
(TL:ITS-1; 02-13-2002)
MSP/Period
|
Traditional System Life Cycle
Phase
|
Purpose
|
|
Study
|
Project Initiation
|
SDR/SCR
Risk analysis
Feasibility study
Benefit and/or cost analysis
Project plan
Quality assurance plan
|
|
Requirements Analysis
|
Functional requirements specs
Acceptance criteria
Functional requirements review
Project plan
|
|
Preliminary Design
|
System and/or subsystem
specification
Preliminary design review (PDR)
Project plan
|
|
Acquisition
|
Detailed Design
|
Program specification
System test plan
Conversion plan
Acceptance and/or regression
test plan
Training plan
Contingency planning
component document
Installation plan
Critical design review (CDR)
Project plan
|
|
Operations and Maintenance
|
Implementation
|
User manual
Operations manual
System administration manual
Program maintenance manual
System test report
Acceptance and/or
regressionest report
Project plan
|
5 FAH-5 Exhibit H-415(1)
Assessment Request (AR) and/or
Change Request (CR) QA Checklist
(TL:ITS-1; 02-13-2002)
|
AR and/or CR QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope describes the document content and indicates
any specific limitations and/or omissions?
|
|
|
|
|
7. References include all (and only) those that appear
in SCR?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the SCR?
|
|
|
|
|
9. System purpose stated?
|
|
|
|
|
10. Functional (user) requirements addressed?
|
|
|
|
|
11. System operation (preliminary) described?
|
|
|
|
|
12. Potential system users identified?
|
|
|
|
|
13. Inputs addressed?
|
|
|
|
|
14. Outputs addressed?
|
|
|
|
|
15. System architecture (preliminary) shown?
|
|
|
|
|
16. Security requirements (initial) addressed?
|
|
|
|
|
17. Preliminary hardware support requirements
(computers, modems, etc.) addressed?
|
|
|
|
|
18. Preliminary software support requirements
(language, DBMS, other GOTS, COTS) addressed?
|
|
|
|
|
19. Preliminary data storage requirements (initial and
growth) addressed?
|
|
|
|
|
20. Interfacing systems identified?
|
|
|
|
|
21. Non-functional (performance) requirements (response
time, transmission times, etc.) addressed?
|
|
|
|
|
22. Conversion activities addressed?
|
|
|
|
|
23. Sponsor provided personnel (preliminary)
identified?
|
|
|
|
|
24. Sponsor provided equipment (preliminary)
identified?
|
|
|
|
|
25. Initial sponsor required schedule identified?
|
|
|
|
|
26. Initial sponsor budget, cost estimate, and/or
funding limit identified?
|
|
|
|
|
27. AR and/or CR completed, including signatures?
|
|
|
|
5 FAH-5 Exhibit H-415(2)
Risk Analysis QA Checklist
(CT:ITS-8; 06-09-2017)
|
Risk Analysis QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope describes the document content and indicates
any specific limitations and/or omissions?
|
|
|
|
|
7. References include all (and only) those that appear
in the risk analysis?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the risk analysis?
|
|
|
|
|
9. System functionality, operation described?
|
|
|
|
|
10. System physical environment described?
|
|
|
|
|
11. User physical environment described?
|
|
|
|
|
12. DS/CTS participation
confirmed?
|
|
|
|
|
13. DS/CTS security
requirements addressed?
|
|
|
|
|
14. DS/ST/CMP participation confirmed?
|
|
|
|
|
15. DS/ST /CMP security requirements addressed?
|
|
|
|
|
16. Unauthorized system access addressed?
|
|
|
|
|
17. Manual checks and controls addressed?
|
|
|
|
|
18. Facility operating procedures addressed?
|
|
|
|
|
19. Application software failure addressed?
|
|
|
|
|
20. Operating system failure addressed?
|
|
|
|
|
21. Communication system failure addressed?
|
|
|
|
|
22. Application unique threats addressed?
|
|
|
|
|
23. Safeguard for each threat identified?
|
|
|
|
|
24. Cost of each safeguard estimated?
|
|
|
|
5 FAH-5 Exhibit H-415(3)
Feasibility Study QA Checklist
(TL:ITS-1; 02-13-2002)
|
Feasibility Study QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the feasibility study?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the feasibility study?
|
|
|
|
|
9. System functional and performance requirements
presented?
|
|
|
|
|
10. Study assumptions and constraints identified?
|
|
|
|
|
11. Study methodology described?
|
|
|
|
|
12. Study evaluation criteria for comparative analysis
defined?
|
|
|
|
|
13. Existing system analyzed?
|
|
|
|
|
14. Analyses of alternatives address identical system
characteristics?
|
|
|
|
|
15. Comparative analysis of technical and benefit
and/or cost aspects performed?
|
|
|
|
|
16. Proposed system (or change) identified?
|
|
|
|
|
17. Selection rationale presented?
|
|
|
|
|
18. Development schedule presented?
|
|
|
|
|
19. Development schedule consistent with LCM?
|
|
|
|
|
20. Reviewed and approved by senior management?
|
|
|
|
5 FAH-5 Exhibit H-415(4)
Benefit Cost Analysis QA Checklist
(TL:ITS-1; 02-13-2002)
|
Benefit/Cost Analysis QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope describes the document content and indicates
any specific limitations and/or omissions?
|
|
|
|
|
7. References include all (and only) those that appear
in the benefit and/or cost analysis?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the benefit and/or cost analysis?
|
|
|
|
|
9. System functional and performance requirements
presented?
|
|
|
|
|
10. BCA assumptions and constraints identified?
|
|
|
|
|
11. BCA methodology described?
|
|
|
|
|
12. BCA evaluation criteria for comparative analysis
defined?
|
|
|
|
|
13. Existing system analyzed?
|
|
|
|
|
14. Are alternative systems described?
|
|
|
|
|
15. Are alternatives identical to those in the
feasibility study?
|
|
|
|
|
16. Are all identified alternatives analyzed?
|
|
|
|
|
17. Does analyses of alternatives address identical
cost issues?
|
|
|
|
|
18. Does cost analyses address both non-recurring and
recurring costs?
|
|
|
|
|
19. Does benefits analyses address both non-recurring
and recurring benefits?
|
|
|
|
|
20. Does comparative analyses include all alternatives?
|
|
|
|
|
21. Does sensitivity analyses include all alternatives?
|
|
|
|
|
22. Has the project been reviewed and approved by
senior management?
|
|
|
|
5 FAH-5 Exhibit H-415(5)
Project Plan QA Checklist
(TL:ITS-1; 02-13-2002)
|
Project Plan QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains the intent of the document and not
the system?
|
|
|
|
|
6. Scope describes the document content and indicate
any specific limitations and/or omissions?
|
|
|
|
|
7. References include in the documents mentioned in
the project plan?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the project plan?
|
|
|
|
|
9. State Department project management personnel
responsibilities defined?
|
|
|
|
|
10. Contractor project personnel responsibilities
defined?
|
|
|
|
|
11. Sponsor and/or user personnel responsibilities
defined?
|
|
|
|
|
12. Responsibility definitions consistent among State
Department project management, contractor, and sponsor/user personnel?
|
|
|
|
|
13. Responsibility and schedule for updating project
plan specified?
|
|
|
|
|
14. Project management interfaces defined, including
interfaces to senior Department of State management, sponsor and/or user,
contractors, subcontractors, and independent organizations (for testing,
verification, etc.)?
|
|
|
|
|
15. Internal project management structure shown with
clear lines of authority and communication?
|
|
|
|
|
16. Internal project management structure includes
software engineering, are quality assurance, configuration management, and
security functions?
|
|
|
|
|
17. Internal management structure identifies
responsible individuals for each structure element?
|
|
|
|
|
18. Risk (security) management procedures and
responsible individual identified?
|
|
|
|
|
19. Reporting procedures for project monitoring and
control specified, including format, frequency, and distribution?
|
|
|
|
|
20. Programming language(s) identified and Programming
Guidelines Manual or other standard specified?
|
|
|
|
|
21. Support software (operating systems, tools, word
processing, etc.) identified?
|
|
|
|
|
22. Off-the-shelf applications software identified?
|
|
|
|
|
23. Deviations from cited Department of State policies,
standards, and procedures identified and described?
|
|
|
|
|
24. Project schedule shows all LCM phases?
|
|
|
|
|
25. Project schedule shows relationships (dependencies)
among phases and start/stop dates for each phase?
|
|
|
|
|
26. Project schedule shows dependencies on external events?
|
|
|
|
|
28. Project schedule shows phase transition reviews,
deliverables, baselines, and approvals?
|
|
|
|
|
29. Project total and monthly staff budgets equal sum
of LCM phase budgets?
|
|
|
|
|
30. Project total and monthly resource budgets equal
sum of all LCM phase budgets?
|
|
|
|
|
31. Phase schedule shows relationships (dependencies)
among phase activities and start and/or stop dates for each activity?
|
|
|
|
|
32. Phase schedule shows dependencies on external
events?
|
|
|
|
|
33. Phase schedule shows reviews, non-deliverable
products, deliverables, new baselines, and approvals?
|
|
|
|
|
34. Phase schedule consistent with project schedule?
|
|
|
|
|
35. Each phase activity uniquely identified, work and
products described, and appears on phase schedule once and only once?
|
|
|
|
|
36. Total phase staff months and staff loading by month
specified?
|
|
|
|
|
37. Total phase resource requirements for computer
time, support software, computer hardware, facilities, travel, and
maintenance specified by month?
|
|
|
|
|
38. Phase staff allocated by activity?
|
|
|
|
|
39. Phase resources allocated by activity?
|
|
|
|
5 FAH-5 Exhibit H-415(6)
Functional Requirements Specification QA Checklist
(TL:ITS-1; 02-13-2002)
|
Functional Requirements
Specification
QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the FRS?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the FRS?
|
|
|
|
|
9. Is the requirement clear?
|
|
|
|
|
10. Is the requirement verifiable (testable)?
|
|
|
|
|
11. Is the requirement traceable?
|
|
|
|
|
12. Is the requirement annotated (prioritized)?
|
|
|
|
|
13. Does each TBD (if any) indicate why it exists and
what must be done to eliminate it?
|
|
|
|
|
14. Is the FRS thorough as a whole considering all
sections and subsections?
|
|
|
|
|
15. Is the FRS consistent as a whole considering all
sections and subsections?
|
|
|
|
|
16. Is the FRS modifiable as a whole considering all
sections and subsections?
|
|
|
|
|
17. Is the FRS relevant as a whole considering all
sections and subsections?
|
|
|
|
|
18. Are performance and/or efficiency requirements
addressed?
|
|
|
|
|
19. Are reliability requirements addressed?
|
|
|
|
|
20. Are security requirements addressed?
|
|
|
|
|
21. Are maintainability requirements addressed?
|
|
|
|
|
22. Are portability requirements addressed?
|
|
|
|
5 FAH-5 Exhibit H-415(7)
Acceptance Criteria QA Checklist
(TL:ITS-1; 02-13-2002)
|
Acceptance Criteria QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses the FRS?
|
|
|
|
|
7. References include all (and only) those that appear
in the acceptance criteria document?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the acceptance criteria document?
|
|
|
|
|
9. Is the acceptance criterion clear?
|
|
|
|
|
10. Is the acceptance criterion verifiable (testable)?
|
|
|
|
|
11. Is the acceptance criterion traceable, by FRS
reference number, to one or more requirements?
|
|
|
|
|
12. Is the acceptance criterion annotated (prioritized)
consistently with its referenced requirements?
|
|
|
|
|
13. Is there an acceptance criterion "place
holder" for each TBD (if any) in the FRS?
|
|
|
|
|
14. Is the acceptance criteria document thorough as a
whole considering all sections and subsections, i.e., does the acceptance
criteria document address every requirement in the FRS?
|
|
|
|
|
15. Is the acceptance criteria document consistent, as
a whole considering all sections and subsections, i.e., is each acceptance
criterion consistent with the requirement(s) to be tested?
|
|
|
|
|
16. Is the acceptance criteria document modifiable as a
whole considering all sections and subsections?
|
|
|
|
|
17. Is the acceptance criteria document relevant as a
whole considering all sections and subsections?
|
|
|
|
5 FAH-5 Exhibit H-415(8)
System/Subsystem Specification
QA Checklist
(TL:ITS-1; 02-13-2002)
|
System/Subsystem Specification
QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the SSS?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the SSS?
|
|
|
|
|
9. Does the SSS include an overview of the preliminary
design?
|
|
|
|
|
10. Does the SSS address the support software that is
needed to implement the design?
|
|
|
|
|
11. Does the SSS address the hardware that is needed to
implement the design?
|
|
|
|
|
12 Does the SSS address the communications
capabilities that are needed to implement the design?
|
|
|
|
|
13. Does the SSS address each requirement included in the
FRS?
|
|
|
|
|
14. Is the component coupling requirement specified?
|
|
|
|
|
15. Is the component identification unique?
|
|
|
|
|
16. Is the component type specified?
|
|
|
|
|
17. Is the component purpose specified?
|
|
|
|
|
18. Is the component function specified?
|
|
|
|
|
19. Are the component subordinates specified?
|
|
|
|
|
20. Are the component dependencies specified?
|
|
|
|
|
21. Are the component interfaces specified?
|
|
|
|
|
22. Are the component resources specified?
|
|
|
|
|
23. Are the component cohesion specified?
|
|
|
|
5 FAH-5 Exhibit H-416(1)
Program Specification QA
Checklist
(TL:ITS-1; 02-13-2002)
|
Program Specification QA
Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the PS?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the PS?
|
|
|
|
|
9. Does the PS contain an overview of the
system-operating environment, including the hardware, support software,
system interfaces, and security and privacy constraints?
|
|
|
|
|
10. Does the PS contain a list of all the programs in
the specification?
|
|
|
|
|
11. Is the program identification identical to a
component identification in the SSS?
|
|
|
|
|
12. Has the program coupling requirement been met?
|
|
|
|
|
13. Is the module identification unique?
|
|
|
|
|
14. Is the module type specified?
|
|
|
|
|
15. Is the module purpose specified?
|
|
|
|
|
16. Is the module function specified?
|
|
|
|
|
17. Are the module subordinates specified?
|
|
|
|
|
18. Are the module dependencies specified?
|
|
|
|
|
19. Are the module interfaces specified?
|
|
|
|
|
20. Are the module resources specified?
|
|
|
|
|
21. Is the module processing specified?
|
|
|
|
|
22. Is the module data specified?
|
|
|
|
|
23. Has the module cohesion requirement been met?
|
|
|
|
|
24. Is the module test identification unique?
|
|
|
|
|
25. Does the module test description include type,
purpose, and reference to specific functions being tested?
|
|
|
|
|
26. Does the module test assumptions identify testing
prerequisites outside the control of the tester?
|
|
|
|
|
27. Does the module test initialization identify
testing prerequisites that are within the control of the tester?
|
|
|
|
|
28. Does the module test instrumentation identify test
support tools and techniques?
|
|
|
|
|
29. Are module test limitations identified?
|
|
|
|
|
30. Are module test inputs specified?
|
|
|
|
|
31. Are module test anticipated outputs specified?
|
|
|
|
|
32. Are module test output assessment methods
specified?
|
|
|
|
|
33. Is the integration test identification unique?
|
|
|
|
|
34. Does the integration test description include type,
purpose, and reference to specific functions being tested?
|
|
|
|
|
35. Do the integration test assumptions identify
testing prerequisites outside the control of the tester?
|
|
|
|
|
36. Does the integration test Initialization identify
testing prerequisites that are within the control of the tester?
|
|
|
|
|
37. Does the integration test Instrumentation identify
test support tools and techniques?
|
|
|
|
|
37. Does the integration test Instrumentation identify
test support tools and techniques?
|
|
|
|
|
38. Are integration test limitations identified?
|
|
|
|
|
39. Are integration test Inputs specified?
|
|
|
|
|
40. Are integration test anticipated outputs specified?
|
|
|
|
|
41. Are integration test output assessment methods
specified?
|
|
|
|
|
42. Are integration test data compatibility tests
specified?
|
|
|
|
|
43. Are integration test call compatibility tests
specified?
|
|
|
|
|
44. Are integration test path coverage tests specified?
|
|
|
|
|
45. Are integration test entry and/or exit coverage
tests specified?
|
|
|
|
5 FAH-5 Exhibit H-416(2)
System Test Plan QA Checklist
(TL:ITS-1; 02-13-2002)
|
System Test Plan QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and acronyms?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the system test plan?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the system test plan?
|
|
|
|
|
9. Does the system test address all PS specifications?
|
|
|
|
|
10. Is the system test identification unique?
|
|
|
|
|
11. Does the system test description include type,
purpose, and reference to specific functions being tested?
|
|
|
|
|
12. Do the system test assumptions identify testing
prerequisites outside the control of the tester?
|
|
|
|
|
13. Does the system test initialization identify
testing prerequisites that are within the control of the tester?
|
|
|
|
|
14. Does the system test instrumentation identify test
support tools and techniques?
|
|
|
|
|
15. Are system test limitations identified?
|
|
|
|
|
16. Are system test inputs specified?
|
|
|
|
|
17. Are system test anticipated outputs specified?
|
|
|
|
|
18. Are system test output assessment methods
specified?
|
|
|
|
|
19. Are system test data compatibility tests specified?
|
|
|
|
|
20. Are system compatibility tests specified?
|
|
|
|
|
21. Are system test path coverage tests specified?
|
|
|
|
|
22. Are system test entry and/or exit coverage tests
specified?
|
|
|
|
5 FAH-5 Exhibit H-416(3)
Conversion Plan QA Checklist
(TL:ITS-1; 02-13-2002)
|
Conversion Plan QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and acronyms?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the conversion plan?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the conversion plan?
|
|
|
|
|
9. Is the hardware configuration described?
|
|
|
|
|
10. Is the system support software (operating system,
utilities, vendor provided applications) described?
|
|
|
|
|
11. Is the application (i.e., project developed)
software described?
|
|
|
|
|
12. Are the files and databases described?
|
|
|
|
|
13. Are special conversion difficulties described and a
method presented for their resolution?
|
|
|
|
|
14. Is security and privacy requirements addressed and
are they consistent with the FRS?
|
|
|
|
|
15. Is the status of all system documentation
presented?
|
|
|
|
|
16. Are user procedures described?
|
|
|
|
|
17. Is the physical location(s) of the hardware
described?
|
|
|
|
|
18. Are the major system functions and their processing
modes (e.g., on line, batch) described?
|
|
|
|
|
19. Are the system conventions and standards described?
|
|
|
|
|
20. Are the system communications methods (protocols,
software packages, etc.) described?
|
|
|
|
|
21. Are the user and operations personnel (and their
number) described?
|
|
|
|
|
22. Are the constraints on conversion, including their
impact on user support, described?
|
|
|
|
|
23. Is the conversion methodology (parallel processing,
phased implementation, etc.) described?
|
|
|
|
|
24. Are the conversion schedule and resource
requirements consistent with the project plan?
|
|
|
|
5 FAH-5 Exhibit H-417(1)
User Manual QA Checklist
(TL:ITS-1; 02-13-2002)
|
User Manual QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the user manual?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the user manual?
|
|
|
|
|
9. Has traceability between the user manual and
program description been established?
|
|
|
|
|
10. Is the function's purpose defined?
|
|
|
|
|
11. Is the function's setup defined?
|
|
|
|
|
12. Are the function's inputs defined?
|
|
|
|
|
13. Are the function's consequences identified and
described?
|
|
|
|
|
14. Are the function's suspension and/or termination
processes defined?
|
|
|
|
|
15. Are the function's outputs defined?
|
|
|
|
|
16. Are the function's error conditions identified and
described?
|
|
|
|
5 FAH-5 Exhibit H-417(2)
Operations Manual QA Checklist
(TL:ITS-1; 02-13-2002)
|
Operations Manual QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the user manual?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the user manual?
|
|
|
|
|
9. Has traceability between the operations manual and
program description been established?
|
|
|
|
|
10. Is the run's purpose defined?
|
|
|
|
|
11. Is the run's progression defined?
|
|
|
|
|
12. Are the run's control inputs defined?
|
|
|
|
|
13. Is the run's operating information presented?
|
|
|
|
|
14. Are the run's input and/or output files described?
|
|
|
|
|
15. Are the run's reports described?
|
|
|
|
|
16. Are the run's non-routine procedures described?
|
|
|
|
5 FAH-5 Exhibit H-417(3)
System Administration Manual QA Checklist
(TL:ITS-1; 02-13-2002)
|
System Administration Manual QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol,
and revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that
appear in the user manual?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the user manual?
|
|
|
|
|
9. Is system initiation addressed?
|
|
|
|
|
10. Is parameter data maintenance addressed?
|
|
|
|
|
11. Is cyclic system use addressed?
|
|
|
|
|
12. Is data base management addressed?
|
|
|
|
|
13. Is system access and security addressed?
|
|
|
|
|
14. Are special supplies addressed?
|
|
|
|
|
15. Is general system usage addressed?
|
|
|
|
|
16. Is the contingency environment addressed?
|
|
|
|
5 FAH-5 Exhibit H-417(4)
Program Maintenance Manual QA
Checklist
(TL:ITS-1; 02-13-2002)
|
Program Maintenance Manual
QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the user manual?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the user manual?
|
|
|
|
|
9. Has traceability between the program maintenance
manual and program description been established?
|
|
|
|
|
10. Is the identification of the component identical to
one in the program specification?
|
|
|
|
|
11. Is the component's description provided?
|
|
|
|
|
12. Are the component's subcomponents identified?
|
|
|
|
|
13. Are the component's inputs identified?
|
|
|
|
|
14. Is the component's processing described?
|
|
|
|
|
15. Are the component's outputs described?
|
|
|
|
|
16. Are the component's Interfaces described?
|
|
|
|
|
17. Are the component's tables described?
|
|
|
|
|
18. Is the component's run description provided?
|
|
|
|
5 FAH-5 Exhibit H-417(5)
System Test Report QA Checklist
(TL:ITS-1; 02-13-2002)
|
System Test Report QA Checklist
|
Yes
|
No
|
Note
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
2. Preface describes the content and intended
audience?
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
7. References include all (and only) those that appear
in the system test report?
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the system test report?
|
|
|
|
|
9. Has traceability between the system test plan and
system test report been established?
|
|
|
|
|
10. Is the identification for each system test unique?
|
|
|
|
|
11. Are the deviations (if any) described?
|
|
|
|
|
12. Are the results of the system test presented?
|
|
|
|
|
13. Is an assessment of the system test result made by
comparison with the anticipated output?
|
|
|
|
|
14. Is an evaluation of the readiness of the system for
acceptance and/or regression test presented?
|
|
|
|
5 FAH-5 Exhibit H-417(6)
Acceptance/Regression Test Report QA Checklist
(TL:ITS-1; 02-13-2002)
|
Acceptance/Regression Test Report
QA Checklist
|
Yes
|
No
|
Note
|
|
|
1. Title page includes title, date, office symbol, and
revision notice or version identifier?
|
|
|
|
|
|
2. Preface describes the content and intended audience?
|
|
|
|
|
|
3. Table of contents shows chapter titles, major
sections, and page numbers?
|
|
|
|
|
|
4. Introductory chapter includes purpose, scope,
references, and page numbers?
|
|
|
|
|
5. Purpose explains intent of document (not system)?
|
|
|
|
|
|
6. Scope addresses general system functions, inputs
and outputs, and external interfaces?
|
|
|
|
|
|
7. References include all (and only) those that appear
in the acceptance and/or regression test report?
|
|
|
|
|
|
8. Acronyms include all (and only) those that appear
in the acceptance and/or regression test report?
|
|
|
|
|
|
9. Has traceability between the acceptance and/or
regression test plan and system test report been established?
|
|
|
|
|
|
10. Is the Identification for each acceptance and/or
regression test unique?
|
|
|
|
|
|
11. Are the deviations (if any) described?
|
|
|
|
|
|
12. Are the results of the acceptance and/or regression
test presented?
|
|
|
|
|
|
13. Is an assessment of the acceptance and/or
regression test result made by comparison with the anticipated output?
|
|
|
|
|
|
14. Is an evaluation of the readiness of the system for
installation and operation presented?
|
|
|
|
|