I am an Assistant Professor in the Human-Computer Interaction Institute at Carnegie Mellon University, where I direct the Co- Augmentation, Learning, & AI (CoALA) Lab
I am the PI or co-PI on several projects focused on the design, development, and evaluation of AI systems that complement and bring out the best of human ability in work that people find personally meaningful. In our work, we partner with relevant stakeholders to co-design systems that draw upon complementary strengths (and mitigate biases) of human and AI decision-makers. We create new design and prototyping methods to facilitate meaningful stakeholder involvement throughout the AI development lifecycle. Finally, we conduct field experiments to understand the causal impacts of these human–AI systems in deployment.
You can find my publications on my Google Scholar page and my CV. If you’d like to know more about my work or explore opportunities for collaboration, please get in touch!

Representative papers

Holstein, K., Wortman Vaughan, J., Daumé III, H., Dudík, M., Wallach, H. (2019). Improving fairness in machine learning systems: What do industry practitioners need?  In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI’19). (p. 600). ACM.  
[ACM]   [supp. materials]   [pdf]
Holstein, K., McLaren, B. M., & Aleven, V.  (2018). Student learning benefits of a mixed-reality teacher awareness tool in AI-enhanced classrooms. In Proceedings of the 19th International Conference on Artificial Intelligence in Education (AIED 2018). LNAI 10947 (pp. 154-168). Springer: Berlin.  
*Best Paper Award*   [pdf]

Holstein, K., McLaren, B. M. & Aleven, V.  (2019). Co-designing a real-time classroom orchestration tool to support teacher–AI complementarity. Journal of Learning Analytics (JLA), 6(2), 27-52. 
[link]   [pdf]
Holstein, K.*, Harpstead, E.*, Gulotta, R., & Forlizzi, J. (2020). Replay Enactments: Exploring possible futures through historical data. In Proceedings of the 2020 Designing Interactive Systems Conference (DIS’20) (pp. 1607-1618). ACM.   [ACM]   [pdf]
Back to Top