 |
Home |
|
SERVICESPERFORMANCE MEASUREMENT Performance measurement is essential for evaluating new technologies and new organizations. It is also a fundamental component of effective training. Without an in-depth understanding of the skills needed to perform a job, and measures to provide feedback on that performance, training is reduced to unguided practice. But measuring performance in the real world is no easy task and pitfalls abound: “We recorded everything…now what?”
“The average message length was 2.35 minutes…but what does that mean?”
“Individually, the operators did so well. Why did the entire team fail?”
“The exercise was going so well at first. What happened?”
Real-world performance measurements. Aptima provides performance measurement solutions that are theoretically sound and operationally grounded in real-world environments. We have extensive experience and innovative technology for measuring collaboration, coordination, and team performance. And we develop valid, reliable, cost-effective measures that capture the key components of operational expertise. Our COMPASS method employs a unique combination of subject matter expertise and measurement theory to define competency-based performance measures for teams and individuals. Using specific training objectives as a basis, COMPASS allows us to identify performance goals before each training exercise, thus guiding both objective and subjective data collection efforts and improving the value of the results. A▪Measure, our suite of performance measurement tools, provides rich capabilities to author, implement, and capture desired performance data—providing valuable feedback to trainees and analysts. Author. A graphical Performance Workbench user interface allows instructors or analysts to specify performance measures that use simulator data without the need for complex programming skills. Implement. Measures are implemented using the XML-based Human Performance Measurement Language (HPML) format, as Performance Measurement Objects (PMOs) Capture. PMOs are configured, collected, and computed from simulator data streams using the Performance Measurement (PM) Engine. Observer-based data is captured using SPOTLITE, a hand-held assessment device that runs on a tablet PC. Finally, self-assessments are made directly by participants during an exercise using an interactive software application. Feedback. Customized mechanisms for providing feedback to trainees (such as after-action reviews) are created using a Feedback Toolkit. These aids help instructors present the collected performance data back to the trainees in ways that best support learning.
FEEDBACK SERVICES Feedback is the essential ingredient that turns practice into training. It is what allows trainees to discover and diagnose their failures, and ultimately improve their performance. But in the modern, distributed organization, how can you be sure that trainees are receiving all the feedback they need? How can you ensure that the feedback is even correct? Aptima’s professional staff and system designers are expert at integrating measurement with performance feedback visualizations. Our proven feedback systems provide a critical learning advantageto trainers serving large, distributed audiences, as well as trainees working independently to learn complex skills. Gaining insight into performance. Aptima works with an organization's instructors and domain experts to design feedback systems for During Action Review and After Action Review. We clearly define desired outcomes, establish performance standards, and identify observable and measurable events that can be used to gain meaningful insight into performance. We design our feedback systems to help trainers and trainees focus on the most critical lessons. Working with our Feedback Toolkit, we provide feedback authoring tools for instructors, and distributed, interactive graphical display systems that help everyone on the team understand the key elements of performance. Aptima in action. Aptima provides tailored action review systems for a wide range of uses, including training for: AWACS crews providing verbal flight direction to pilots, Navy pilots performing close air support missions, and distributed Navy crews coordinating air and shipboard operations.
|
 |
|||||||
