I Gave The Job To An AI Machine: Cognitive Ability and Potential, What Are We Really Assessing For?
Thursday 13th July 2023 9:30am – 12:30pm
Online Seminar and followed by TPF’S Annual General Meeting
Machine learning is shaping our world. Despite AI being used as a label to refer to everything from a key-word matching search through to The Terminator it’s the Large Language Model machine learning tool called ChatGPT which is disrupting our working world. Every other LinkedIn post seems to be discussing it in some form including reports of recruiters choosing it as a candidate over a human and it being able to outperform humans on critical reasoning tests like the Watson Glaser.
If we hold to our evidence-based roots we will all be familiar with Schmidt and Hunter’s meta analyses which showed that the best single predictor of future performance was cognitive ability (GMA specifically). A combination of GMA plus either work sample, integrity test or a structured interview being the highest predictors of future performance.
In this seminar we looked more closely at cognitive ability to find out what it is measuring and whether it can separate us from the machines!
Our speakers were: Dr Hugh McCredie; Dr. Nigel Guenole; Lucy Standing; Tameron Chappell and Luke Montuori. See below for brief outlines of each of their sessions.
Dr Hugh McCredie PhD, CPsychol., FBPsS, CertPBP, Chartered FCIPD
Chartered Psychologist and Author
Following a career in HR and Management assessment & development, Hugh has written a series for Psyche and Assessment and Development Matters (ADM) charting the histories of personality, intelligence and implicit motives testing. These followed an earlier series on the Big Five and managerial effectiveness. Amongst his recent interests is the stability in adulthood and what is measured by psychometrics.
Can we get SMARTer? Based on an historic presentation to The Psychometrics Forum and a recently published article in the magazine Assessment and Development Matters (ADM), Hugh gave us a fascinating review of his research and whether we can actually change our Psychometric IQ.
Dr. Nigel Guenole, PhD, CPsychol.,
Director of Research Goldsmiths, University of London & Strategic Advisor, Podium Assessment Systems
Nigel is a Senior Lecturer and Director of Research for the Institute of Management at Goldsmiths, University of London. He specialises in Talent Management and Applied Statistics. Nigel’s work has appeared in leading scientific journals including Industrial Organizational Psychology: Perspectives on Science and Practice and Frontiers in Quantitative Psychology & Measurement, as well as in the popular press including the Sunday Times. He is the current external examiner for organizational behaviour programs at London School of Economics (LSE) and University College London (UCL). He is a Chartered Psychologist and Associate Fellow of the British Psychological Society (BPS), registered with the Health & Care Professions Council (HCPC), and a member of the Society for Industrial and Organizational Psychology in the United States (SIOP).
Interviewing Executives using the Interpersonal Vitality Model: It is a challenge discerning the arc of an executive’s career from a single conversation in order to be in a position to recommend their likelihood of success in a role or their development needs. There is no agreed recipe for how to do this effectively but there are elements common to the best interviews that reveal information which will improve decision-making for selection and development. Nigel shared with us the Interpersonal Vitality Model used in Podium which enhances what technical skills, cognitive abilities and personality can tell us about an executive.
Lucy Standing CPsychol.,
Co-Founder of Brave Starts CIC
Brave Starts CIC is a non profit organisation who see being over 50 as an asset. They’re building the blueprint for how people can figure out how to make this the best and most fulfilling time of their careers and focus on producing an evidence base to support their work. Lucy provides advice and insight to the UK Parliament select committee for older workers. Lucy is a Chartered Psychologist, Associate Fellow with the British Psychological Society and Certified Principal Psychologist with the Association for Business Psychology (ABP) for which she was Vice Chair for nearly 10 years. Prior to her non-profit career, she worked in the strategy consulting and Investment banking sectors as a Global Head of Recruitment.
Designing Assessments for an Older and Wiser Candidate Base: are intelligence tests sufficient to capture the value of an aging candidate population? In this talk Lucy explored how values and needs for candidate change as they get older and whether or not the use of intelligence tests meet the purpose for which they were designed.
Dr. Luke Montuori, PhD, CPsychol.,
Psychometrician, Arctic Shores
Luke received an undergraduate degree in Psychology in his native Australia, and subsequently moved to the UK to pursue a PhD in Behavioural Neuroscience where he designed behavioural paradigms for the study of associative learning and memory. He then transitioned to a career in organisational psychology. From 2016 to 2019 he worked at Central Test, first as a psychometrician and then also as a consultant. Currently he is a Senior Psychometrician at Arctic Shores, where he designs task based assessments. He is also the director of Lumos Insight, an organisation that helps clients with the development of both psychometric products, and products that benefit from the understanding and application of psychological theories.
Pre-Recorded Video Presentation – What Does It Mean To Be Human In The Age Of AI? New ‘artificially intelligent’ tools are rapidly improving in their capabilities, challenging what we think is important to measure, undermining many of our psychometric tools, and forcing us to confront our own relevance in a brave new world. In this conversation, which Tameron had recorded with Luke prior to the seminar, they discussed frameworks for thinking about human capabilities, how we might deal with the challenges AI poses, and what it means to be human in the age of AI.