Verification and validation of complex systems: human factors issues

Despite its increasing importance, the verification and validation of the human-machine interface is perhaps the most overlooked aspect of system development. Although much has been written about the design and developmentprocess, very little organized information is available on how to verifyand validate highly complex and highly coupled dynamic systems. Inability toevaluate such systems adequately may become the limiting factor in our ability to employ systems that our technology and knowledge allow us to design. This volume, based on a NATO Advanced Science Institute held in 1992, is designed to provide guidance for the verification and validation of all highly complex and coupled systems.

Book contents:

  1. Verification and Validation: Concepts, Issues, and Applications

  2. Resilience Theory and System Evaluation

  3. On The Future Of Hybrid Human-Machine Systems

  4. Basic Considerations in Verification and Validation

  5. Validation in Complex Systems: Behavioral Issues

  6. Defining Human-Centered System Issues for Verifying and Validating Air Traffic Control Systems

  7. Evaluating the Impact of New Technology on Human-Machine Cooperation

  8. Integrating Verification and Validation with the Design of Complex Man-Machine Systems

  9. Assessment of Complexity

  10. Limits to Analysis and Verification

  11. The Validation and Verification of Complex Knowledge-Based Systems

  12. The Reliability Of Interactive Systems: Simulation Based Assessment

  13. The Identification of Latent Organizational Failures in Complex Systems

  14. The Role of Incident Investigation in System Validation

  15. Problems of Systematic Safety Assessments: Lessons Learned from Aircraft Accidents

  16. Major Incidents, Safe and Reliable Verdicts and the Process of Validation and Verification

  17. The Human Component of System Validation

  18. When Task Demand is Variable: Verifying and Validating Mental Workload in Complex, “Real World” Systems

  19. Performance Evaluation of Human-Machine Systems

  20. Requirements Analysis for Human System Information Exchange

  21. Working Memory and Human-Machine Systems

  22. The Role of Verification and Validation in the Design Process of Knowledge Based Components of Air Traffic Control Systems

  23. Automation and Representation in Complex Man-Machine Systems

  24. How to Fit the Man-Machine Interface and Mental Models of the Operators

  25. Cultures with Requisite Imagination

  26. System Validation — A Step in a Continuous Improvement Process

  27. Cultural Behavior in the Airline Cockpit System: A Theoretical Framework Proposal

  28. The Inclusion of Future Users in the Design and Evaluation Process

  29. User Involvement in the Development of Highly Interactive Software Systems

  30. Psychological Aspects of Human Factors Testing and Evaluation of Military Human-Machine Systems

  31. Involving the User in the Design of Computer-Based Displays in Power Plant Control Rooms

  32. Systems Theory Versus Verification and Validation

  33. Controlling Factors: An Operator’s Perspective

  34. What They Want Is What They Get?

  35. Contemporary Issues in ATC System Development

  36. Validation Problems in Air Traffic Control Systems

  37. Simulating and Evaluating the Future — Pitfalls or Success?

  38. The National Plan for Aviation Human Factors

  39. Test and Evaluation Program for a Prototype of an Advanced Computerized Control Room for Nuclear Power Plants

  40. Validation Issues in Decision Support Systems for Maintenance Planning

  41. Artificial Habitat for Man in Extreme Environments as an Integrated Human-Machine System

  42. Concept of a FMS/ATC Air-Ground Data Link Testbed Employing an Airbus A340 Full Flight Simulator

  43. The Qualification of Military Aircraft Cockpits

  44. The Use of Video to Verify and Validate Human System Interactions: A Methodology

  45. Potential Application of Neural Networks to Verification and Validation of Complex Systems

  46. Verification and Validation of the Training Components of Highly Complex Systems

  47. An Expert Air Traffic Control Teaching Machine: Critical Learning Issues

  48. Interaction of Stages in Validating and Verifying ATC Training

  49. The Verification of Pilot Abilities as a Basis for Validating Flight Crew Competency

  50. Closing Remarks

  51. Complex and Integrated Human-Machine Systems: Retroflections