Interviewing Candidates Who Have Prepared Using Generative AI Technologies

Navio Kwok writes in the MIT Sloan Management Review that job candidates increasingly are utilizing generative artificial intelligence to prepare for interviews.  They are providing job descriptions and company data, as well as information about themselves, and then asking for help simulating the interview, anticipating questions, and generating strong responses to those queries.  Kwok sounds an alarm though:

However, there is growing concern among hiring professionals that candidates using generative AI are gaming the interview process. Research suggests that GenAI use has a material influence on hiring decisions: In one recent study, candidates who used such tools to prepare received higher overall interview performance ratings compared with those who were unassisted by GenAI.

This finding only exacerbates concerns about the job interview process. Several years ago, I drafted a post about Yale Professor Jason Dana's research on the flawed approach and poor results of many job interviews. Dana's work demonstrated that hiring managers often draw erroneous conclusions from interviews. He makes the case that people often hear what they wish to hear.  Reflecting on his research, he wrote, "The key psychological insight here is that people have no trouble turning any information into a coherent narrative....People can't help seeing signals, even in noise."

Kwok recognizes that we cannot stop candidates from using generative artificial intelligence to prepare for interviews.  However, we can take some steps to insure that we are not being duped by these candidates.  First, Kwok advises that in-person interviews are important, so that candidates cannot use AI in real time to generate responses.  Second, Kwok argues that the right types of follow-up questions are critical to assessing a candidate's qualifications and capabilities.   For instance, Kwok recommends asking the candidate to explain their thought process in detail, as well as their rationale, when explaining key decisions they have made in the past.  Kwok also recommends asking the candidate to explain what options were considered, but rejected.  Finally, Kwok suggests that hiring managers pose probing questions about the challenges and obstacles that the candidate faced, and how they addressed those unanticipated issues.  He also recommends asking the candidate to explain what he or she might do differently next time. 

Moving beyond these thoughtful suggestions, I would recommend requiring candidates to take on a challenging task, rather than simply answering questions.  Give them a problem and ask them to present on that issue.  Or, ask them to do some work that is similar to what they will encounter on the job, evaluate that work, and then ask them about how they approached the task.  Require people to DO, rather than SAY what they have done.  That is the best remedy for the challenges Kwok and Dana describe regarding the interview process.