Location: Global - Remote (Anywhere in the world) Work model: 100% remote Engagement type: PrismWorks AI Affiliate Candidate pathway; independent affiliate or contractor status may follow after confirmation. AI Evaluation and Observability Affiliate Candidate PrismWorks AI is building a selective talent bench of AI-first practitioners who can help enterprises measure, monitor, and improve AI system behavior before and after production deployment. This posting is for an affiliate candidate pathway, not an immediate employment offer or guaranteed client assignment. AI-first requirement Practical fluency with AI systems, AI-assisted delivery, and responsible use of enterprise AI tools is an essential criterion for every PrismWorks AI role. Candidates should be comfortable learning with AI, applying AI tools to real work, and operating with strong judgment around privacy, security, governance, and client trust. Selection and confirmation pathway - Apply with CV, cover letter, and relevant profile links. - Shortlisted applicants may be invited to a 30-minute face-to-face video interview. - Selected applicants may receive provisional PrismWorks AI Affiliate Candidate status. - Provisional affiliate candidates may be nominated for a short AI readiness and certification pathway selected by PrismWorks AI. - Where certification access is limited or invitation-based, PrismWorks AI may sponsor the candidate's invitation or access to the pathway. - Any third-party exam, certification, proctoring, or credential fees may be the candidate's responsibility unless PrismWorks AI confirms otherwise in writing before enrollment. - Candidates should not pay PrismWorks AI for job consideration, interviews, onboarding, equipment, placement, or access to PrismWorks systems. Any certification fee, if applicable, should be paid directly to the independent certification provider. - Successful completion of the pathway does not guarantee paid work or a client assignment. Confirmed affiliate status depends on certification completion, role fit, availability, professional conduct, client demand, and execution of the required PrismWorks AI affiliate or contractor agreement. The Work This bench role is for practitioners who can design evaluation harnesses, evidence capture, observability, incident replay, quality checks, and operational metrics for AI workflows, retrieval systems, and agent-assisted processes. Strong Fit - Background in AI engineering, ML evaluation, SRE, observability, QA automation, data quality, platform engineering, or reliability engineering. - Experience turning ambiguous system behavior into measurable checks and operational signals. - Strong scripting, data analysis, test design, or engineering implementation ability. - Comfortable translating technical metrics into stakeholder-facing reporting. Useful Experience LLM evals, RAG evals, prompt/version testing, model comparison, OpenTelemetry, dashboards, tracing, SLOs, incident review, vector search metrics, model gateways, log pipelines, warehouse analytics, regulated workflows, or audit-ready evidence design.
Pay: $17.75-$80.00 per hour
Work Location: Remote