[Skip Navigation]

Research Theme 4 - Design Process

Study and influence the process of designing sociotechnical systems to ensure the practical relevance of our work.

Summary

Studying the process of design is the focus of two projects. A field study was conducted in industry to observe designers working on a large engineering project [DCIEM 93], a laboratory study was completed to examine expertise factors which shape strategies and performance in a design-like problem solving task [TIM 94], and a series of studies were conducted to explore designers' use and judgments of human factors reference information [DCIEM 93].

To facilitate technology transfer to industry, the design rationale of an industry application of EID has been investigated [EID-RAT 99], and CWA has been integrated with the ISO standard on Human-Centered Design [MHI 00]. A cost-benefit model for EID has been developed, and a framework is being developed to use CWA to address design questions in the development of new simulators [SIM 06].

Project Listing

The diagram below shows the individual projects that have been performed for this theme, and the relationships between them. Click any project to view its description.

Theme 4: Study the Design Process - Projects and Relationships DCIEM 93 TIM 94 EID-RAT 99 MHI 00 SIM 06

 
Study
 
Influence

DCIEM 93 — Human Factors Design Guidance: Matching the Advice to Designer's Questions

Dates:

9/93 - 3/94

Participants:

Catherine M. Burns, Klaus Christoffersen, William Pawlak, and Kim J. Vicente

This project addressed concerns regarding the extent to which human factors (HF) information has been incorporated into systems design. A four month field study of HF design in industry was conducted to gain an understanding of the constraints and challenges facing designers. HF designers in industry were surveyed to learn their judgements of the value and cost associated with typical HF handbook information. This project also involved two studies of handbook usage. Results indicated that current HF handbooks may not be providing the information that designers need. It was found that the design process, in this case, was highly constrained with many interactions with designers from different disciplines. Solution concepts appeared early in the design process and in a holistic manner, suggesting that design prototypes and other context-rich sources of information may better support these designers.

Publications:

  • Burns, C. M., and Vicente, K. J., "Judgements about the value and cost of human factors information in design," Information Processing and Management, vol. 32, pp. 259-271, 1996.
  • Burns, C. M., Vicente, K. J., Christoffersen, K., and Pawlak, W. S., "Towards viable, useful, and usable human factors design guidance," Applied Ergonomics, vol. 28, 311-322, 1997.
  • Pejtersen, A. M., Sonnenwald, D. H., Buur, J., Govindaraj, T., and Vicente, K. J., "The design explorer project: Using a cognitive framework to support knowledge exploration," Journal of Engineering Design, vol. 8, 289-301, 1997. (Invited)
  • Burns, C. M., & Vicente, K. J., "A participant-observer study of ergonomics in engineering design: How constraints drive design process," Applied Ergonomics, vol. 31, pp. 73-82, 2000.
  • Vicente, K. J., Burns, C. M., and Pawlak, W. S., "Muddling through wicked design problems," Ergonomics in Design, vol. 5, no. 1, pp. 25-30, 1997.
  • Vicente, K. J., Burns, C. M., and Pawlak, W. S., "Better handbooks, better design," Ergonomics in Design, vol. 6, no. 2, pp. 21-27, 1998.
  • Christoffersen, K., Pawlak, W. S., and Vicente, K. J., "A comparative study of the effectiveness of human factors design handbooks," Proceedings of the 12th Triennial Congress of the International Ergonomics Association, Volume 6, pp. 292-294, 1994.
  • Burns, C. M., and Vicente, K. J., "Designer evaluations of human factors reference information," Proceedings of the 12th Triennial Congress of the International Ergonomics Association, Volume 6, pp. 295-297, 1994.
  • Burns, C. M., and Vicente, K. J., "Experiences in design: The case for design driven human factors," Proceedings of the 12th Triennial Congress of the International Ergonomics Association, Volume 4, pp. 28-31, 1994.
  • Pejtersen, A. M., Sonnenwald, D. H., Buur, J., Govindaraj, T., and Vicente, K. J., "The design explorer project: Using a cognitive framework to support knowledge exploration," Proceedings of the 10th International Conference on Engineering Design, vol. 2, pp. 419-429, 1995.
  • Burns, C. M., and Vicente, K. J., "A framework for understanding interdisciplinary interactions in design," Proceedings of DIS 95: Symposium on Designing Interactive Systems, pp. 97-103, 1995.
  • Burns, C. M., & Vicente, K. J., "The value of human factors handbooks to human factors designers in the nuclear industry," Proceedings of the 1996 American Nuclear Society International Topical Meeting on Nuclear Plant Instrumentation, Control and Human-Machine Interface Technologies, pp. 679-681, 1996.
  • "Egg-sucking, Mousetraps, and the Tower of Babel: Making Human Factors Guidance More Accessible to Designers - Kim J. Vicente, Catherine M. Burns, & William S. Pawlak.
  • "Muddling Through Wicked Problems: Exploring the Role of Human Factors Information in Design" - Catherine M. Burns.

EID-RAT 99 — EID Design Rationale

Dates:

9/99 - 12/00

Participants:

Greg A. Jamieson, Wayne Ho, Kim J. Vicente

Collaborators:

Dal-Vernon C. Reising (Honeywell)

Although there is substantial industry interest in the demonstrated performance benefits of EID, the methodology is perceived to be labor-intensive and potentially difficult to reproduce on a large scale. Industry representatives perceive these two issues as obstacles to using EID in practice. The ASM Consortium and Honeywell expressed an interest in making EID more tractable and accessible to industry. This project consisted of a case study of the EID process effort that took place in the UMP 00 project. By documenting the design process, a ‘case-based’ design guideline was generated. Capturing the process by which EID is done and abstracting heuristic guidelines is essential for determining to what extent EID can be fully utilized for industrial-sized applications.

Publications:

  • CEL 01-03 "EID Design Rationale Project: Case Study Report" - G. A. Jamieson, D. V. C. Reising, & J. R. Hajdukiewicz.

MHI 00 — Applying Cognitive Work Analysis to Supervisory Control in Process Control Plants and Aviation Systems

Dates:

7/00 - 3/01

Participants:

Shinichiro Hori, Kim J. Vicente

The purpose of this project was to conduct research on how to design adaptive human-computer interfaces (HCI) for supervisory control of process control plants and aviation systems in practice. Such interfaces were context-sensitive in that the form or content of information changed as a function of plant or aviation system state, operator or pilot task, or some other goal-relevant dynamic variable. The project was built on CEL's previous work on cognitive work analysis (CWA) and Ecological Interface Design. This project also included research on aligning the application of CWA as the standard design method of human-computer interactive systems to conform to "ISO13407: Human Centered Design Process Standard." This was a collaborative project between Mitsubishi Heavy Industries (MHI) and CEL. Mr. Hori of MHI spent the project period as a visiting researcher in CEL.

Publications:

  • None

SIM 06  — Guiding Simulator Fidelity and Design with Cognitive Work Analysis

Dates:

10/2006 - present

Participants:

Antony Hilliard, Greg A. Jamieson

The microcomputer revolution of the 1980s allowed economical development of simulations for a wide range of domains.  While classical stimulus-response representations are simplified to eliminate many phenomena of interest, conventional high-fidelity simulations of complex systems can produce very difficult to interpret results.  Abstract ‘microworlds’ such as DURESS II have shown some of the strengths of both extremes and have been widely used for human factors research.  Recently, a need has been identified for a theoretical framework to guide the design of simulators, the selection of appropriate levels of fidelity, and the generation of useful simulated scenarios.  This project generalizes from successful applications of Cognitive Work Analysis to military training simulators (Naikar 2002) and provides a theoretical basis for applying analysis results to design.

Publications:

  • None

TIM 94 — The Incredible Machine: Research on Human Problem Solving

Dates:

10/94 - 10/96

Participants:

Klaus Christoffersen, Tim Yee Lee, Kim J. Vicente

This exploratory project investigated the strategies and performance of subjects of various backgrounds on a small-scale design-like activity. The goal of the project was to understand the relationship between problem types and effective solution strategies for adaptive, functional problem solving, as well as the expertise factors which shape behaviour in such contexts. A novel task domain was proposed for use as a design microworld. Subjects of high and low spatial ability were asked to perform trials under various conditions related to the level of constraint in the problems. The results revealed that spatial ability and constraint level both had significant effects on subjects' performance. A speculative model was proposed as a potential mechanism through which spatial ability and constraint level may have combined to lead to the results observed.

Publications:

  • CEL 96-03 "Practical Problem Solving in a Design Microworld: An Exploratory Study" - Klaus Christoffersen.