Verified Job
Work from home
Computer science engineer
Work from home
#56567
Remote / WFH
Codefeast
Job Description
Job description
JOB DESCRIPTION:
Role Overview
We are looking for Ph D level computer science experts to help fine-tune and evaluate large language models, including systems similar to Chat GPT. The role focuses on designing challenging, conceptual computer science problems that test advanced AI reasoning across topics such as algorithms, systems design, cybersecurity, theory, databases, networks, and other undergraduate to Ph D-level computer science domains.
Key Responsibilities
Design advanced computer science problems that test AI model performance across conceptual and reasoning-heavy topics, including systems design, algorithms, cybersecurity, and other advanced CS areas.
Develop clear, step-by-step reference solutions with rigorous logic, well-structured explanations, and defensible reasoning.
Evaluate AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with the intended problem requirements.
Identify flaws, gaps, edge cases, and near-miss reasoning patterns in AI outputs.
Collaborate with researchers to refine benchmarks across undergraduate, graduate, and Ph D-level computer science topics.
Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.
Required Qualifications
Ph D, completed or pursuing, in Computer Science or a closely related field.
Strong computer science reasoning and problem-solving skills across advanced domains.
Ability to design challenging conceptual problems that require deep understanding rather than straightforward recall or coding.
Excellent written communication skills, with the ability to explain complex technical ideas clearly and logically.
JOB DESCRIPTION:
Role Overview
We are looking for Ph D level computer science experts to help fine-tune and evaluate large language models, including systems similar to Chat GPT. The role focuses on designing challenging, conceptual computer science problems that test advanced AI reasoning across topics such as algorithms, systems design, cybersecurity, theory, databases, networks, and other undergraduate to Ph D-level computer science domains.
Key Responsibilities
Design advanced computer science problems that test AI model performance across conceptual and reasoning-heavy topics, including systems design, algorithms, cybersecurity, and other advanced CS areas.
Develop clear, step-by-step reference solutions with rigorous logic, well-structured explanations, and defensible reasoning.
Evaluate AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with the intended problem requirements.
Identify flaws, gaps, edge cases, and near-miss reasoning patterns in AI outputs.
Collaborate with researchers to refine benchmarks across undergraduate, graduate, and Ph D-level computer science topics.
Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.
Required Qualifications
Ph D, completed or pursuing, in Computer Science or a closely related field.
Strong computer science reasoning and problem-solving skills across advanced domains.
Ability to design challenging conceptual problems that require deep understanding rather than straightforward recall or coding.
Excellent written communication skills, with the ability to explain complex technical ideas clearly and logically.
