Healthcare Subject Matter Expert (SME) - AI Model Evaluation (Australia)

Volga PartnersAustraliaRemoteVolunteer2 weeks ago

Volga Partners seeks medical students, residents, and advanced healthcare trainees in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner, or Physician Assistant pathways to evaluate AI-generated medical content. This remote, project-based independent contractor role involves assessing clinical reasoning, identifying inaccuracies, and providing evidence-based feedback to improve AI models. No prior AI experience is required.

What you'll do

Evaluate AI-generated medical content for factual accuracy, completeness, clinical relevance, and consistency with established medical knowledge and guidelines.
Assess clinical reasoning in AI-generated assessments, differential diagnoses, and treatment explanations.
Identify medical inaccuracies, unsupported assumptions, missing clinical considerations, and potential patient safety concerns.
Conduct medical research and verification using credible sources such as peer-reviewed literature and clinical guidelines.
Review clinical scenarios, including hypothetical patient cases, symptoms, medical histories, and diagnostic information.
Provide evidence-based feedback explaining findings and recommending corrections.
Apply evaluation standards, scoring rubrics, and annotation instructions.
Complete assigned evaluations using designated online platforms like DataCompute, meeting deadlines and quality expectations.
Maintain confidentiality and comply with privacy, ethical, and data security requirements.

What you need

Must-have

Medical terminologyAnatomyPhysiologyPathologyPharmacologyClinical reasoningEvidence-based medicineMedical research

Nice-to-have

Artificial intelligenceHealthcare technologyMedical informaticsHealthcare quality assuranceMedical documentation reviewClinical evaluation

Soft skills

Analytical reasoningCritical thinkingProblem-solvingAttention to detailWritten communicationIndependent workAccountability

HealthcareAI EvaluationMedical SMERemoteProject-BasedFreelanceMedical StudentsClinical ReasoningData Annotation

/What you'll do

/What you need

Must-have

Nice-to-have

Soft skills

What you'll do

What you need