DOD Weapon Systems Testing Policies Lag Behind Modernization Best Practices

A new report from the U.S. Government Accountability Office (GAO) indicates that the Department of Defense (DOD) needs to update its policies for testing weapon systems to better align with modern development practices and accelerate the delivery of capabilities to the warfighter. The GAO’s findings suggest that while the DOD has initiated modernization efforts, its existing policies for testing major weapon systems do not fully incorporate leading practices seen in the private sector, potentially contributing to delays in acquisition programs.

The GAO report highlights that the DOD’s goal of more rapidly deploying weapon systems to the battlefield is a significant undertaking, with plans focusing on the increased use of digital engineering tools and the development of a highly skilled workforce. In comparing the DOD’s testing policies with those of leading companies that quickly bring complex systems to market through iterative testing, the GAO identified a gap. The report found that while some aspects of these leading practices are present, particularly in software and urgent capability acquisition pathways, they are largely absent from policies governing major capability acquisition and middle-tier acquisition programs, which represent a substantial portion of DOD spending on weapon systems.

Specifically, the GAO’s analysis identified that DOD-wide policies for test and evaluation do not sufficiently detail processes for incorporating key leading practices. These practices include involving testers early in the acquisition process, employing iterative testing methodologies, utilizing digital twins and threads (digital representations of physical assets and their lifecycle data), and continuously obtaining user feedback. The report notes that the DOD’s digital engineering policy and the systems engineering policy’s test and evaluation sections lack specific procedures to ensure these leading practices are applied to testing. Furthermore, the GAO found that these leading practices are not consistently reflected in military department-level testing policies or in critical program documents such as acquisition strategies and test strategies for the weapon systems examined.

The GAO has put forth 13 recommendations aimed at addressing these shortcomings. These recommendations include requiring the Secretary of Defense, along with the Secretaries of the Air Force, Army, and Navy, to revise their respective weapon system test and evaluation policies and related documents. The proposed revisions would mandate the involvement of developmental and operational testers in the development of acquisition strategies, with a focus on testing-related aspects like the use of and access to digital twins and digital threads. Additionally, policies should be updated to require the development of test strategies and plans that embrace iterative and integrated testing approaches, supported by digital twins and threads, to facilitate the delivery of minimum viable products. The recommendations also emphasize the need to establish processes for obtaining ongoing user input and feedback throughout the testing phases. The DOD has concurred with seven recommendations, partially concurred with five, and did not concur with one. The GAO maintains that all 13 recommendations remain valid.

For the public, the implications of these findings suggest a potential for more efficient and timely delivery of military capabilities. By adopting leading practices in weapon system testing, the DOD could move from a reactive testing role to a more proactive one, providing earlier input and support to acquisition efforts. This modernization could ultimately lead to warfighters receiving needed equipment and technologies faster.

Article by Mel Anara, based upon information from the U.S. Government Accountability Office

---