Government Subject Matter Expert (SME) - AI Model Evaluation

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Government Subject Matter Expert (SME) – AI Model Evaluation based in the United States.

Put your government and regulatory expertise to work in an innovative role helping improve the accuracy and reliability of artificial intelligence. As a Government Subject Matter Expert, you will evaluate AI-generated responses to complex public-sector scenarios, ensuring they align with applicable policies, regulations, and professional standards. You’ll use your analytical judgment to identify errors, assess reasoning, validate conclusions, and develop high-quality evaluation benchmarks. This opportunity is ideal for experienced professionals who enjoy research, critical thinking, and explaining complex decisions clearly. No previous AI experience is required—your specialized knowledge is what matters most. Work remotely on project-based assignments while contributing to the development of more reliable and effective AI systems.

Accountabilities

• Evaluate AI-generated responses to complex government-related scenarios, assessing accuracy, completeness, reasoning quality, and compliance with relevant regulations and policies.
• Apply specialized professional knowledge to determine whether AI-generated conclusions are appropriate, defensible, and supported by authoritative sources.
• Identify inaccurate interpretations, flawed assumptions, missing information, inconsistencies, unsupported conclusions, and potential regulatory or compliance risks.
• Research and validate findings against applicable federal, state, and local statutes, regulations, agency guidance, policies, and professional standards.
• Develop and refine evaluation benchmarks, reference responses, assessment criteria, and examples of sound professional reasoning.
• Provide clear, actionable feedback explaining identified issues and recommending improvements to AI-generated content.
• Follow project-specific evaluation guidelines and participate in quality reviews to promote consistency, reliability, and accuracy.
• Contribute expertise in one or more specialized areas, including government policy, public records, privacy compliance, program eligibility, administrative decision-making, procurement, contracting, and vendor evaluation.

Requirements:

• At least 2 years of relevant professional experience in government operations, public administration, regulatory compliance, government procurement, or a closely related field.
• Demonstrated subject matter expertise in at least one relevant specialization, such as government policy, public records and disclosure requirements, privacy protection, government programs and eligibility, procurement, contracts, or vendor evaluation.
• Experience interpreting, evaluating, auditing, or applying government policies, regulations, administrative requirements, or professional standards.
• Strong analytical and critical-thinking skills, with the ability to identify errors, assess complex information, and recognize unsupported reasoning.
• Excellent written communication skills, including the ability to explain complex findings and professional judgments clearly, concisely, and logically.
• Ability to conduct independent research and verify information using authoritative sources.
• Strong attention to detail and the ability to apply structured evaluation criteria consistently.
• Comfort using digital platforms, online research tools, and project-specific evaluation guidelines.
• Ability to work independently in a remote, project-based environment and meet assignment deadlines.
• Current U.S. residency and authorization to undertake the relevant independent-contractor engagement.
• Experience in roles such as government policy or program analyst, regulatory or compliance analyst, government auditor, quality assurance specialist, public records or privacy compliance officer, procurement or contracting specialist, RFP evaluator, eligibility analyst, public-sector consultant, or regulatory advisor is particularly valuable.
• Previous experience evaluating AI models, working with large language models (LLMs), conducting research, or performing structured quality assessments is beneficial but not required.
• Willingness to complete a skills-based assessment evaluating subject matter expertise, analytical reasoning, and the ability to follow project guidelines.

Benefits:

• Hourly com…