Test and Verification Management

Test and verification management are the processes and procedures to suitable critique the product (hardware or software) or processes (production). This is risk identification and mitigation activity as it attempts to quantify quality attributes of the product that may cause concerns with the customer during application. Testing and verification is also part of project management in that the results are often used to confirm contractual obligations are met, and thereby are part of project closure. Testing and verification management contain, planning and control, analysis and design, execution, reporting and closing activities. Hardware testing may include environmental stimuli (multiple simultaneous such as thermal and vibration) as well as testing the product to the extremes of functionality.

Test and verification management - Value Transformation

Testing Closure

In testing closure the objective and specific deliverable items from the testing are compared to the actual achievements and deliverables. The testing documentation is stored in a way that is easily retrievable along with the information on the product iteration the specific test cases were conducted. The test environment configurations are archived so these can also be retrieved at a later date should that be needed. Lessons learned are recorded from which the team will apply at some future date.

Test Execution

During test execution the tests are conducted on the product. Each of the test conditions and test environments are used to conduct the defined tests. Sometimes there will be spontaneous testing conducted, that is not one that was born out of the scope, plan or test analysis, but from what is learned in the process of conducting the test. Test execution will also be responsible for re-testing as perhaps the results of the test were some anomaly based upon the test configuration, or to learn more about the failure to be able to accurately report the details of the conditions that caused the failure. These are clues the developers will use to find the reason for the failure (hardware or software). Test execution address regression testing, that is testing of old parts of the product that have not changed, but require testing since the product has changes – this is largely associated with software.

Test Exit, Metrics and Reporting

Testing produces data from which an informed decision about the product can be made. These metrics will inform the team and other stakeholders the product’s suitability for release or production. Test metrics such as failure rates and severity remove some of the uncertainty from the launch. This phase of the testing produces reports where this information will reside allowing the project manager, stakeholders and executives to decide whether to launch or not based upon the results.

Test Planning and Control

To be able to test requires an understanding of the objectives of the project and customers. This understanding makes it possible to discern specific risks and clarify the scope of the testing to make assessment of those risks possible. Test planning will uncover and define the best test strategy along with discovering the talent and equipment required. Additionally, the planning will evoke key metrics or measurements from which the testing and results will be evaluated.

Test Analyze and Design

In test analysis and design, specific test conditions are identified from which the details of the testing will be created. This will require inputs such as product requirements and drawings, specifications, system descriptions and interfaces to other components and typical and extreme applications of the product. This will generate specific test methods, criterion, and metrics that will lead to detailed test cases along with the input data (test conditions) for the test. There is a strong connection between the product requirements and design documentation and the test details.

Testing Sites

Test and verification management – techniques for ensuring the product design, material and, where applicable, manufacturing processes culminate in meeting the customer’s needs. At the minimum verification serves to confirm or refute the product meets requirements.  However, there are many other approaches to testing iterations of the product through the development process. This includes software testing, which consists of processes and techniques that is coupled with the development effort to ensure the product quality over prototype iterations and the full lifecycle of the product.

    1. https://www.ministryoftesting.com/events
    2. https://astqb.org/
    3. https://www.istqb.org/
    4. https://www.softwaretestpro.com/
    5. https://www.stpcon.com/stpcon-staff/
    6. https://testinginstitute.com/cstpa.php
    7. https://www.associationforsoftwaretesting.org/
This video is a part of the Interview with Leaders in Testing series Jon M. Quigley holds the PMP and CTFL certification and is a principal of Value Transformation LLC a product development training and cost improvement organization. He has more then twenty years of product development experience, ranging from embedded hardware and software through verification and project management. Jon’s LinkedIn profile can be accessed at https://www.linkedin.com/in/jonmquigley His twitter handle is @jonmquigley Jon has submitted a paper for the upcoming Global Testing Retreat Conference at Pune, India on 22nd to 24th April 2016. To know more about the conference, please visit http://gtr.agiletestingalliance.org

The use of decision matrix tools can help us make a better decisions for our project and our organization and improve the outcome of our work.

Why Effective Product Testing Fails: Common Pitfalls

Effective Product Testing Execution and my thoughts on this. The outcome can be a disaster if we poorly execute an effective, well-defined process.  Below are my thoughts on this link https://www.linkedin.com/posts/robert-fey-78178b154_mrbrokentesting-integrationblindness-testingstrategy-activity-7345338918126432256-OWgo/?utm_source=share&utm_medium=member_desktop&rcm=ACoAAAJVUn4BzjTVfTnHgKx3zQWTPI5tYcYTiCM   Unit tests pass. If unit testing does not represent the real world, then it means little. Unit testing should go beyond specification limits […]

Configuration Management in Manufacturing Equipment and Software: It Matters

What Is Configuration Management in Manufacturing?   Configuration management (CM) is a systematic process that ensures all aspects of a product—manufacturing equipment, software, or both—remain consistent with their original specifications and intended functionality throughout their lifecycle. In manufacturing, configuration management aligns the product’s performance, functional, and physical attributes with requirements, design, and operational information from […]

Outsourcing Testing Doesn’t Have to Kill Product Quality: Trust But Verify

Jon M Quigley The genesis of this post is  https://www.linkedin.com/feed/update/urn:li:activity:7343144597839056897/ Outsourced Testing Best Practices: Safeguarding Product Quality in 2025 We often seek out best practices for outsourced testing as if there is a silver bullet. That is not so.  Some key principles help. Outsourced testing is often criticized as a shortcut that leads to poor […]

A Process Is Not Necessarily Poor If Its Execution Is Errant

  My thoughts on this LinkedIn post Judging a process by its outcomes in organizations, teams, and even personal projects is common. When things go awry, the immediate instinct is often to blame the process itself. However, this overlooks a crucial distinction: a well-designed process can still yield poor results if executed improperly. Consider a […]

Engineering Excellence in Action

Baja SAE Carolina Showcases the Future of Off-Road Innovation Introduction Vehicles have always required some engineering. I am glad about that, as my career in vehicle development has been mentally engaging and motivating. I have other engineering colleagues who are similarly motivated, such as my friend who owns Raptor Performance.  We have worked together on […]

Ideal PLM and Failures

This blog post is promoted by a LinkedIn post: https://www.linkedin.com/posts/alindenthal_engineers-give-up-plm-plm-systems-have-activity-7337209561826660352-Yi2X/?utm_source=share&utm_medium=member_desktop&rcm=ACoAAAJVUn4BzjTVfTnHgKx3zQWTPI5tYcYTiCM What Is an Ideal PLM System Supposed to Do? An ideal Product Lifecycle Management (PLM) system is designed to serve as the digital backbone for managing a product’s entire lifecycle—from concept and design through manufacturing, service, and end-of-life. At its core, a PLM system should: […]

Why Engineers Give Up on PLM Systems

This blog post is promoted by a LinkedIn post: https://www.linkedin.com/posts/alindenthal_engineers-give-up-plm-plm-systems-have-activity-7337209561826660352-Yi2X/?utm_source=share&utm_medium=member_desktop&rcm=ACoAAAJVUn4BzjTVfTnHgKx3zQWTPI5tYcYTiCM Engineers Give Up on PLM Systems – Lessons from Jon M. Quigley’s Work Product Lifecycle Management (PLM) systems are intended to streamline product development, enhance traceability, and ensure quality. Yet, as Jon M. Quigley, renowned author, engineer, and project management expert, has observed throughout his […]

Why Delayed SOP Reveals Systemic Blindness in Testing Chaos

By Jon M. Quigley From Robert Fey’s post on LinkedIn. Response:    Delayed SOP Is Just the Tip—Systemic Blindness Runs Deep When a delayed SOP (Start of Production) surfaces, it’s tempting to blame test quality or last-minute execution. These are failure points for sure. However, it can also be uncontrolled scope changes, poor configuration, poor […]

Project Management in Product Development: Overcoming Cognitive Biases and Communication Challenges

Jon M Quigley The Critical Role of Project Management in Product Development Project management in product development is the backbone of innovation and market success. In today’s fast-paced industries, organizations must modernize their development processes to stay competitive, adapt to change, and deliver value quickly. Jon M. Quigley, a recognized leader with decades of experience […]

Comparing Robert Fey’s Thoughts with Jon M. Quigley’s Published Work

Written with Perplexity – also found at https://www.perplexity.ai/search/write-a-responser-to-the-post-aOnmPGV4SoeB_AawG1JTJQ#0 The post from Robert Fey: https://www.linkedin.com/posts/robert-fey-78178b154_automotivetesting-requirementsengineering-activity-7330094926694662144-Wsy4/ My Thoughts – From Me In general, we should not think of product verification and validation efforts dogmatically. We are well advised to think in terms of principles. Everything is context-dependent, the degree of diligence commensurate with the associated risk.  We […]

2019 Carolina Collegiate Student Chapter

Building a Cause & Effect Diagram

CMMI Tracking

8D Template

Pugh Matrix

How to Brainstorm

TIEMP 02

Using Pareto Charts

SPaMCAST 477 – Silence: A Powerful Tool, Muddling Through, Monolithic Monolith

https://podtail.se/podcast/software-process-and-measurement-cast/spamcast-477-silence-a-powerful-tool-muddling-thro/

SPaMCAST 552 – Fit For Value, Saying No, Essays and Discussions

https://spamcast.libsyn.com/spamcast-552-fit-for-value-saying-no-essays-and-discussions

SPaMCAST 575 – Messing Up Agile Hybrids, Deming and Book Club, Essays and Discussions

https://spamcast.libsyn.com/spamcast-575-messing-up-agile-hybrids-deming-and-book-club-essays-and-discussions

Contact Value Transformation about Test and Verification Management