IliaLarchenko commited on
Commit
fae1562
1 Parent(s): 984b566
Files changed (1) hide show
  1. tests/testing_prompts.py +3 -3
tests/testing_prompts.py CHANGED
@@ -21,7 +21,7 @@ You are reviewing an interview. Your goal is to evaluate the performance of the
21
  Be extremely critical and strict, you have highest quality standards.
22
  Even a slight mistake should lead to a negative evaluation. If in doubt about any criteria, give a negative evaluation.
23
  Analyze the JSON file with the interview transcript and provide your feedback.
24
- JSON contains, problem description, interview transcript (messages, code and hodden notes not visible to candidate), and feedback.
25
 
26
  You should evaluate the following aspects and return a JSON with these keys:
27
 
@@ -42,11 +42,11 @@ You should evaluate the following aspects and return a JSON with these keys:
42
  "interviewer_found_mistakes": "The interviewer accurately identified any mistakes made by the candidate.",
43
  "interviewer_hallucinations": "The interviewer didn't say anything non-relevant or strange.",
44
  "interviewer_summary": "The interviewer doesn't repeat or summarize what the candidate just said.",
45
- "interviewer_gaslighting": "The interviewer refrained from gaslitgting the candidate: didn't claim any candidates errors or missed facts that he didn't make.",
46
  "interviewer_leaks": "The interviewer didn't leak any hidden notes to candidate during the main part of the interview.",
47
  "interviewer_empty": "The interviewer didn't send any empty messages.",
48
  "interviewer_notes": "The interviewer made reasonable notes catching candidates mistakes and important facts.",
49
- "interviewer_stuck": "The interview didn't stuck at any point in repeating cycle of same questions and answers.",
50
  "interviewer_end": "The interview ended interview after candidate answer all questions (vs. interview ended abruptly).",
51
 
52
  "feedback_quality": "The feedback was constructive and offered actionable insights.",
 
21
  Be extremely critical and strict, you have highest quality standards.
22
  Even a slight mistake should lead to a negative evaluation. If in doubt about any criteria, give a negative evaluation.
23
  Analyze the JSON file with the interview transcript and provide your feedback.
24
+ JSON contains, problem description, interview transcript (messages, code and hidden notes not visible to candidate), and feedback.
25
 
26
  You should evaluate the following aspects and return a JSON with these keys:
27
 
 
42
  "interviewer_found_mistakes": "The interviewer accurately identified any mistakes made by the candidate.",
43
  "interviewer_hallucinations": "The interviewer didn't say anything non-relevant or strange.",
44
  "interviewer_summary": "The interviewer doesn't repeat or summarize what the candidate just said.",
45
+ "interviewer_gaslighting": "The interviewer refrained from gaslighting the candidate: didn't claim any candidates errors or missed facts that he didn't make.",
46
  "interviewer_leaks": "The interviewer didn't leak any hidden notes to candidate during the main part of the interview.",
47
  "interviewer_empty": "The interviewer didn't send any empty messages.",
48
  "interviewer_notes": "The interviewer made reasonable notes catching candidates mistakes and important facts.",
49
+ "interviewer_stuck": "The interview's dialog was reasonable and didn't stuck at any point in repeating cycle of same questions and answers.",
50
  "interviewer_end": "The interview ended interview after candidate answer all questions (vs. interview ended abruptly).",
51
 
52
  "feedback_quality": "The feedback was constructive and offered actionable insights.",