Skip to content

Open-source framework for bias-free candidate evaluation using LLMs. Features 100-point scoring system, dual bias checkpoints, and 8-step asynchronous workflow. Model-agnostic design tested with Claude, GPT, and GLM for evidence-based hiring.

License

Notifications You must be signed in to change notification settings

Gabriel-Jossic/PrismIA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

License: AGPL v3

Also available in: English | Français

Version: 2.0 | Date: October 12, 2025 | Author: Gabriel Jossic

Overview & Core Principles

This methodology treats recruitment as an analytical discipline rather than a subjective process. The objective is to supplement human decision-making with systematic data analysis, reducing bias while improving selection accuracy.

The approach is built on division of labor between AI and human evaluators:

  • AI systems process large datasets, execute repetitive tasks, and flag potential biases in decision patterns.
  • Human evaluators handle contextual judgment, candidate engagement, strategic decisions, and final selections.

The workflow targets three measurable outcomes:

  1. Reduced Bias: Minimize subjective decision-making at critical evaluation points.
  2. Operational Efficiency: Automate low-value tasks to allocate time to strategic activities.
  3. Candidate Experience: Create a transparent, responsive process with clear evaluation criteria.

8-Step Workflow Implementation

Step 1: Semantic CV Analysis (AI)

  • Function: Process high-volume applications using contextual analysis rather than keyword matching.
  • Primary System: Elite AI CV Semantic Analysis & Candidate Scoring Agent (CVAnalysis.md).
  • Execution:
    1. Contextual Parsing: The system extracts implicit skills from project descriptions. For example, "built recommendation engine for 10M users" indicates experience with ML pipelines, distributed systems, and production deployment—regardless of whether these terms appear explicitly.
    2. Quantitative Scoring (0-100 scale): Candidates receive scores across five dimensions: Technical Skills, Experience Quality/Impact, Behavioral Indicators, Learning Capacity, and Cultural Alignment Probability.
    3. Ranked Output: The system generates a prioritized candidate list, flagging non-traditional profiles that meet criteria but lack conventional markers.

Step 2: Automated Initial Contact (AI)

  • Function: Engage top-tier candidates (typically top 20-30%) with personalized outreach to maximize response rates.
  • Primary System: Elite AI Recruitment Specialist - MODE 1: OUTREACH (Outreach+PreQualifScreening.md).
  • Execution:
    1. Profile-Specific Messaging: System references concrete elements from the candidate's background (specific projects, publications, measurable achievements).
    2. Value-First Communication: Messages focus on opportunity relevance rather than transactional recruitment language.

Step 3: Automated Pre-qualification (AI)

  • Function: Validate mandatory requirements (technical prerequisites, compensation expectations, availability) without human involvement.
  • Primary System: Elite AI Recruitment Specialist - MODE 2: PRE-QUALIFICATION (Outreach+PreQualifScreening.md).
  • Execution: Conversational interface collects knockout criteria data, filtering candidates who don't meet non-negotiable constraints.

Step 4: Selection Review Process (Human ↔ AI)

  • Function: Primary bias checkpoint. Ensure candidate advancement decisions are evidence-based.
  • Primary System: Elite AI Objective Recruitment Debate Partner (InterviewDebate.md).
  • Execution:
    1. Data Review: System presents scoring data and analysis for each pre-qualified candidate.
    2. Challenge Protocol: Recruiter states decision (Advance/Reject). System challenges decisions that contradict data or appear based on subjective factors.
      • Example: If recruiter rejects a candidate scoring 89/100 citing "gut instinct," system responds: "This decision contradicts the data. 'Gut instinct' often indicates unconscious bias. What objective criteria support rejecting the 3rd-ranked candidate?"
    3. Evidence-Based Resolution: Protocol requires explicit, fact-based justification for decisions, particularly when contradicting quantitative analysis.

Step 5: Structured Asynchronous Evaluation (AI + Human)

  • Function: Measure actual capabilities through structured assessment, eliminating communication-style bias inherent in synchronous interviews.
  • Primary System: Elite AI In-Depth Assessment Expert (Assessment.md).
  • Execution:
    1. Assessment Delivery: Candidates receive asynchronous written assessment (45-60 minute completion time) with explicit instructions and evaluation criteria.
    2. Assessment Architecture (30% behavioral / 70% technical):
      • Behavioral Component (6 questions): Evaluates handling of complexity, diagnostic approach, learning behavior, communication clarity, failure response, and collaboration patterns. Questions adapt to industry-specific terminology.
      • Technical Component (5 questions): Tests conceptual understanding, tradeoff analysis, tooling knowledge, quality practices, and applied problem-solving.
    3. Automated Analysis: System evaluates response depth, structure, and specificity. Generates scored report (0-100) with flagged concerns (plagiarism indicators, insufficient detail) and positive signals (quantified results, explicit learning from failures).

Step 6: Interview Coordination and Execution (AI + Human)

  • Function: Handle scheduling logistics and enable high-value interview conversations.
  • Supporting Systems: Elite AI Recruitment Specialist - MODE 3: SCHEDULING and Elite AI Automated Candidate Communication Expert.
  • Execution:
    1. Automated Scheduling: System manages calendar coordination, timezone conversion, and multi-interviewer availability.
    2. Interview Preparation: Interviewers receive comprehensive reports from prior stages, enabling deeper technical discussions rather than redundant screening questions.

Step 7: Interview Data Collection and Analysis (AI)

  • Function: Capture structured interview feedback immediately post-interview to accelerate decision cycles.
  • Primary System: Elite AI Automated Interview Feedback Collection & Analysis Agent (InterviewFeedback.md).
  • Execution:
    1. Automated Collection: System sends structured feedback forms to interviewers immediately after sessions.
    2. Consolidated Analysis: System synthesizes human feedback with any recorded interview analysis into unified report, highlighting consensus and divergence across evaluators.

Step 8: Final Selection Review (Human ↔ AI)

  • Function: Ensure final decisions are auditable, justified, and consistent with collected evidence.
  • Primary System: Elite AI Objective Recruitment Debate Partner (InterviewDebate.md).
  • Execution:
    1. Comprehensive Review: System presents consolidated data for each finalist candidate.
    2. Decision Protocol: Team discusses candidates. System challenges subjective reasoning ("I prefer candidate X's vibe") with data: "'Vibe' is not an objective criterion. Candidate Y scored 15 points higher on technical assessment and received unanimous positive feedback. What measurable factors support selecting candidate X?"
    3. Final Verification: Last checkpoint against late-stage bias, ensuring decisions align with evidence and stated evaluation criteria.

Workflow Component Summary

Step Function Primary System Purpose
1 Semantic Analysis CVAnalysis.md Evidence-based filtering on capability indicators
2 Initial Contact Outreach+PreQualifScreening.md High-response engagement of qualified candidates
3 Pre-qualification Outreach+PreQualifScreening.md Automated validation of mandatory criteria
4 Selection Review InterviewDebate.md Primary bias checkpoint before interviews
5 Asynchronous Assessment Assessment.md Objective capability measurement
6 Interview Coordination Outreach+PreQualifScreening.md Logistics automation and preparation
7 Feedback Analysis InterviewFeedback.md Structured post-interview data collection
8 Final Selection InterviewDebate.md Evidence-based final decision verification

System Architecture: Framework vs. Component

This methodology integrates two distinct but complementary elements:

  • The 8-Step Workflow functions as the process framework—the control structure managing the complete recruitment pipeline from sourcing through final selection. It enforces consistency and bias checkpoints at each transition point.

Together, these components form a complete system that is both strategically coherent (managing the full process) and tactically rigorous (executing accurate capability assessment), optimizing for both efficiency and selection quality.

About

Open-source framework for bias-free candidate evaluation using LLMs. Features 100-point scoring system, dual bias checkpoints, and 8-step asynchronous workflow. Model-agnostic design tested with Claude, GPT, and GLM for evidence-based hiring.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published