I/O Psychologist / Psychometrician — Methodology Review for Workplace Decision Simulation

I’m developing a scenario-based workplace decision simulation for frontline managers and am looking for an experienced I/O psychologist, psychometrician, or measurement scientist to review the measurement framework before pilot testing.

The simulation presents managers with realistic operational scenarios and captures their decisions across multiple dimensions rather than treating responses as simply right or wrong. It also examines decision-making under varying operational conditions.

WHAT I’M LOOKING FOR

I need someone to review the existing framework and help determine:

• Whether the proposed dimensions and constructs are being measured appropriately
• How multidimensional decision impacts should be scored, scaled, and aggregated
• Whether and how composite measures can be methodologically supported
• How contextual variables should factor into the analysis
• What data should be collected during pilot testing
• How pilot data should be analyzed to evaluate reliability, validity, and improve the instrument

I’m not looking for someone to redesign the simulation or write the scenarios. The product and decision architecture already exist. I’m looking for expertise on the measurement side to make sure the resulting methodology is defensible.

IDEAL BACKGROUND

Experience with workplace assessment, psychometrics, Situational Judgment Tests (SJTs), scoring models, construct validity, reliability, or behavioral measurement would be especially relevant.

An M.S. or Ph.D. in I/O psychology, psychometrics, quantitative psychology, measurement, or a related field is preferred.

Experience working with an assessment before pilot data exists would be valuable. Experience with restaurant, hospitality, retail, or other frontline service environments is a plus, but not required.

ENGAGEMENT

This would start as a focused review of the existing methodology and recommendations for pilot validation.

In your proposal, please include your relevant experience, how you would approach a project like this, what you would recommend as the initial scope/deliverables, and your estimated hours and fee.

There may be additional work later for pre-pilot review and analysis of pilot data.