Browse JobsCareer BlogJob Search ResourcesAI Interview PreparationWorkzil HomeJob ListingsPricing PlansContact UsCreate AccountHiring SolutionsSecurity & PrivacyAffiliate ProgramFree CV BuilderAI CV ReviewerFree Resume BuilderAI Resume ReviewerSalary CalculatorSalary Comparison ChartsLayoff TrackerLayoff NewsHiring Trends 2026Startup Funding TrackerCompany Expansion TrackerVisa Sponsorship CompaniesBest Companies to Work ForBlog ArticlesCareer ResourcesAI Interview PrepTerms of ServicePrivacy PolicyCookie PolicyPost a JobAI Candidate ScreeningEmployer PricingEnterprise SolutionsJobs in New YorkJobs in San FranciscoJobs in AustinJobs in SeattleJobs in ChicagoJobs in Los AngelesJobs in BostonJobs in DenverJobs in AtlantaJobs in MiamiJobs in DallasJobs in Washington DCJobs in San JoseJobs in RaleighJobs in NashvilleSoftware Engineer JobsData Scientist JobsProduct Manager JobsData Analyst JobsUX Designer JobsFrontend Developer JobsDevOps Engineer JobsMarketing Manager JobsFinancial Analyst JobsCybersecurity Analyst JobsSoftware Engineer Salary GuideData Scientist SalaryProduct Manager SalaryUX Designer SalaryDevOps Engineer SalaryCloud Architect SalarySoftware Engineer Salary CalculatorData Scientist Salary CalculatorProduct Manager Salary CalculatorSoftware Engineer Salary San FranciscoSoftware Engineer Salary New YorkData Scientist Salary SeattleProduct Manager Salary AustinDevOps Engineer Salary CalculatorUX Designer Salary CalculatorSoftware Engineer Interview QuestionsProduct Manager Interview QuestionsData Scientist Interview QuestionsUX Designer Interview QuestionsFrontend Developer Interview QuestionsRemote Software Engineer JobsRemote Product Manager JobsRemote Data Analyst JobsRemote UX Designer JobsRemote Frontend Developer JobsElectrician JobsPlumber JobsHVAC Technician JobsRegistered Nurse JobsTruck Driver JobsWarehouse Worker JobsCarpenter JobsWelder JobsRestaurant Manager JobsConstruction Manager JobsDental Hygienist JobsReal Estate Agent JobsElectrician Salary GuidePlumber Salary GuideRegistered Nurse SalaryTruck Driver SalaryHVAC Technician SalaryWelder Salary GuideElectrician Interview QuestionsNursing Interview QuestionsTruck Driver Interview QuestionsRestaurant Manager Interview QuestionsLayoffs 2026Layoffs 2025Layoffs 2024Layoffs 2023Google LayoffsMeta LayoffsAmazon LayoffsMicrosoft LayoffsSoftware Engineer Resume BuilderData Scientist Resume BuilderProduct Manager Resume BuilderRegistered Nurse Resume BuilderMarketing Manager Resume BuilderTechnology Industry JobsFinance Industry JobsHealthcare Industry JobsConstruction & Trades JobsRetail & E-Commerce JobsSoftware Engineer vs Data ScientistSoftware Engineer vs Product ManagerData Scientist vs Data AnalystFrontend vs Backend DeveloperProduct Manager vs Project ManagerElectrician vs Plumber
    WorkzilWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    WorkzilWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    Перейти к основному содержимому
    Поиск вакансийУдалённая работаТренировка собеседований
    Что такое WorkzilВойтиНачать
    ВакансииWashingtonSenior AI Engineer - Evaluation & Benchmarking · OpenTeams
    O
    OpenTeamsСотрудников: 10-50

    Senior AI Engineer - Evaluation & Benchmarking

    Washington, DC Metro · Опубликовано 10 нояб. 2026 г.

    Зарплата
    Зарплата не указана
    Где
    Washington, DC Metro
    Уровень
    Не указано
    Опубликовано
    10 нояб. 2026 г.
    Дата из источника

    О должности

    Who We Are Every organization runs on intelligence: years of accumulated knowledge, decisions, and context. As AI takes on more of that work, companies face a choice: rent that intelligence from vendors who keep the data, the context, and the results, or own it. OpenTeams exists to make ownership possible. Founded by Travis Oliphant, creator of NumPy and SciPy, and built by people with deep roots across the open-source ecosystem, including NumPy, SciPy, PyTorch, and Jupyter, we help enterprises and governments build AI they control, govern, and evolve themselves. If that sounds like your kind of work, we'd like to meet you. Senior AI Engineer - Evaluation & Benchmarking Location: Washington, DC Metro - Hybrid Work Authorization: U.S. citizenship required Clearance Requirement: An active TS/SCI clearance is preferred. Candidates may also be considered if they previously held a TS/SCI with CI polygraph or currently hold an active TS or Secret clearance. Candidates that are not eligible or willing to obtain a security clearance will not be considered. Salary Range: $145,000–$250,000 USD, dependent on experience level and location About the Role We're looking for a Senior AI Engineer - Evaluation & Benchmarking to build and operate the benchmarking and evaluation capability at the core of a government AI platform. This is a role for someone who is more interested in what a model gets wrong than in what it gets right. You build the evaluation harnesses — automated metrics paired with structured human expert judgment, applied to candidate models and to the agentic workflows built on top of them. You develop repeatable methodologies for comparing performance against current operational baselines, which means the comparison holds up when someone runs it again in six months with a different model. And you document the limitations and surface the failure modes that matter, including the ones nobody asked about. Your reports go to senior stakeholders and inform decisions about which capabilities are ready to field. That's the weight of the job: a benchmark that looks good and hides a failure mode is worse than no benchmark at all, and you're the check against that. This is hands-on engineering on an open-source toolchain. Key Responsibilities • Design and implement a platform for test & evaluation of AI models and Agentic systems • Develop evaluation methodologies combining human and AI expert judging and multiple input and output modalities • Design and enhance user interfaces such that platform customers can express workflows in an intuitive and generic manner • Collaborate closely with subject matter experts, Model/Agent developers, and evaluation designers to ensure coverage over existing and to be discovered requirements. • Architect and implement robust experiment provenance and result tracking systems. • Ensure performance across integrated tools and scaling systems. • Provide technical mentorship, code review, design guidance, and clear documentation to support team knowledge transfer and user onboarding. • Required Skills & Experience • Proven experience building and deploying software platforms with complex integration surface, preferably handling Machine Learning or agentic workloads. • Deep experience using python, including API frameworks and agentic harnesses. • High level knowledge of Computer vision, language modeling, and/or task specific agent evaluation. • Hands on experience with common frameworks and tooling, eg PyTorch and Hugging Face ecosystem. • Strong communication skills and experience collaborating effectively with cross functional teams including external stakeholders. • Demonstrated experience or potential for leadership, especially in making architectural decisions, coordinating the efforts of other engineers, and developing standards and best practices. Nice to Have • Currently hold or eligible to hold U.S. Security Clearance (Secret or higher) • Prior experience designing test and evaluation systems for AI • Experience deploying complex software systems in IL 4 or higher environments. • Experience participating in security assessment and authorization, hardening systems, and remediating vulnerabilities. • Previous experience contributing to open source projects and participating in open source communities. • Exposure to the intelligence community or department of defense subject matter experts. Grow With Us At OpenTeams, growth isn’t just about the company—it’s about you. We believe the best careers are built at the edge of your potential. That is where new tools, ideas, and technologies change the world. Here, you’ll work alongside pioneers of AI, solving problems that matter: making AI more transparent, more ethical, and more empowering. As your skills grow, our career framework provides a pathway and recognition of that increased impact. Opportunities aren’t limited by geography. You’ll collaborate with global experts, contribute to open source projects that power the world’s technology, and stretch your skills daily. That global perspective and diversity makes our solution more universal and robust. We are committed to continuing to celebrate diversity on our team. Supported people are successful people. We offer 100% employer paid medical premiums for employees and self-managed PTO with a minimum time off requirement, so that our teams are able to do their best work. We invest in curiosity, creativity, and ownership. That means you’ll be trusted to boldly innovate, supported to learn fast, and celebrated for successful collaboration. Commitment to diversity, equity, inclusion, and belonging OpenTeams understands that valuing diverse creative practices and forms of knowledge is crucial to and enriches the company’s core mission. We encourage applications from everyone, including members of all equity-seeking communities, such as (but certainly not limited to) women, racialized and Indigenous persons, disabled people, persons of all sexual orientations, gender identities and expressions. We are an equal opportunity employer - all qualified applicants will receive equal consideration for recruitment, interviews, employment, training, compensation, promotion, and related activities. We do not discriminate based on race, religion, gender, gender identity, gender expression, color, national origin, pregnancy, ancestry, domestic partner status, disability, sexual orientation, age, genetic predisposition, medical condition, marital status, citizenship status, military or veteran status, or any other basis covered by applicable laws. OpenTeams will not tolerate discrimination or harassment based on these characteristics or any other unlawful behavior, conduct, or purpose.
    Откликнуться на сайте работодателяИИ-собеседование

    Откроет страницу отклика работодателя в новой вкладке.

    ИИ-собеседование

    Потренировать это собеседование с ИИ

    Пробное собеседование именно на эту должность и обратная связь, с которой можно работать.

    Workzil

    Workzil это единый цикл: найти работу, понять рынок, который за ней стоит, и нанять сотрудника. У каждой цифры указаны источник и дата.

    Назад на Workzil

    Сайты Workzil

    • WorkzilЧем мы занимаемся: единый цикл от поиска работы до найма.
    • Workzil JobsОткрытые вакансии с настоящей датой публикации и указанной зарплатой.
    • Workzil MarketЗарплаты и найм для вашей профессии и вашего региона, с источниками.
    • Workzil EmployersСтраницы компаний с актуальными вакансиями, подтверждённые рабочей почтой.
    © 2026 WorkzilКонфиденциальностьУсловия