Browse JobsCareer BlogJob Search ResourcesAI Interview PreparationWorkzil HomeJob ListingsPricing PlansContact UsCreate AccountHiring SolutionsSecurity & PrivacyAffiliate ProgramFree CV BuilderAI CV ReviewerFree Resume BuilderAI Resume ReviewerSalary CalculatorSalary Comparison ChartsLayoff TrackerLayoff NewsHiring Trends 2026Startup Funding TrackerCompany Expansion TrackerVisa Sponsorship CompaniesBest Companies to Work ForBlog ArticlesCareer ResourcesAI Interview PrepTerms of ServicePrivacy PolicyCookie PolicyPost a JobAI Candidate ScreeningEmployer PricingEnterprise SolutionsJobs in New YorkJobs in San FranciscoJobs in AustinJobs in SeattleJobs in ChicagoJobs in Los AngelesJobs in BostonJobs in DenverJobs in AtlantaJobs in MiamiJobs in DallasJobs in Washington DCJobs in San JoseJobs in RaleighJobs in NashvilleSoftware Engineer JobsData Scientist JobsProduct Manager JobsData Analyst JobsUX Designer JobsFrontend Developer JobsDevOps Engineer JobsMarketing Manager JobsFinancial Analyst JobsCybersecurity Analyst JobsSoftware Engineer Salary GuideData Scientist SalaryProduct Manager SalaryUX Designer SalaryDevOps Engineer SalaryCloud Architect SalarySoftware Engineer Salary CalculatorData Scientist Salary CalculatorProduct Manager Salary CalculatorSoftware Engineer Salary San FranciscoSoftware Engineer Salary New YorkData Scientist Salary SeattleProduct Manager Salary AustinDevOps Engineer Salary CalculatorUX Designer Salary CalculatorSoftware Engineer Interview QuestionsProduct Manager Interview QuestionsData Scientist Interview QuestionsUX Designer Interview QuestionsFrontend Developer Interview QuestionsRemote Software Engineer JobsRemote Product Manager JobsRemote Data Analyst JobsRemote UX Designer JobsRemote Frontend Developer JobsElectrician JobsPlumber JobsHVAC Technician JobsRegistered Nurse JobsTruck Driver JobsWarehouse Worker JobsCarpenter JobsWelder JobsRestaurant Manager JobsConstruction Manager JobsDental Hygienist JobsReal Estate Agent JobsElectrician Salary GuidePlumber Salary GuideRegistered Nurse SalaryTruck Driver SalaryHVAC Technician SalaryWelder Salary GuideElectrician Interview QuestionsNursing Interview QuestionsTruck Driver Interview QuestionsRestaurant Manager Interview QuestionsLayoffs 2026Layoffs 2025Layoffs 2024Layoffs 2023Google LayoffsMeta LayoffsAmazon LayoffsMicrosoft LayoffsSoftware Engineer Resume BuilderData Scientist Resume BuilderProduct Manager Resume BuilderRegistered Nurse Resume BuilderMarketing Manager Resume BuilderTechnology Industry JobsFinance Industry JobsHealthcare Industry JobsConstruction & Trades JobsRetail & E-Commerce JobsSoftware Engineer vs Data ScientistSoftware Engineer vs Product ManagerData Scientist vs Data AnalystFrontend vs Backend DeveloperProduct Manager vs Project ManagerElectrician vs Plumber
    WWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    WWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    본문으로 건너뛰기
    채용 검색원격 근무면접 연습
    Workzil이란로그인시작하기
    채용San FranciscoSoftware Engineer, AI Evaluation · Nuna
    N
    Nuna직원 200-500명

    Software Engineer, AI Evaluation

    San Francisco · 원격 · 2026년 8월 13일 게시

    급여
    급여 미공개
    위치
    San Francisco · 원격
    직급
    명시되지 않음
    게시일
    2026년 8월 13일
    출처 기준 날짜

    직무 소개

    Chronic disease isn't managed in a clinic. It is managed at home, in relationships, in the everyday. What's on the dinner table, what gets said, and who notices when someone's struggling. For the 130 million Americans managing a chronic condition, the healthcare system has offered the same answer for decades: a 15-minute doctor's visit, a pamphlet, and a portal login they'll never use. At Nuna, we are building an AI health coach that shows up like a person who actually has time: available at 3am, infinitely patient, and never behind a waiting room. We use motivational interviewing to help patients and their families see themselves clearly, design experiments that fit their real lives, and navigate a system that has not historically been on their side. We are building from the ground up around a simple belief: patients don't want to be healthy; they want their lives back. We're not competing with other health apps. We're competing with the moment a person gives up on getting better. If that's a problem you want to work on, we'd like to talk. Your team We are a small, interdisciplinary team - engineers, data scientists, designers, product managers, and clinicians - building Nuna's AI health coach. Our products are only as good as the care and science behind them, and your piece is how we know the coach is safe and working. You'll own the evaluation system for the team building the coach: a data scientist partners with you on the science, clinicians and designers supply the ground truth, and the engineers shipping the agents depend on the signal you produce to decide what ships. The role This is a net-new, build-first role for someone who wants to own how we evaluate our AI agents end to end. You'll build the harnesses, datasets, judges, and release gates that tell us whether the coach is safe and good, and you'll own both that infrastructure and the evals that run on it. This is not a test-execution role - you write the code and own the system, rather than running tests someone else designed. You'll make the day-to-day calls on standards, methods, and trade-offs, often with incomplete information and the freedom to define the right answer yourself. Comfort with ambiguity is part of the job. What you'll do • Build testing harnesses and evaluation infrastructure for our agentic products and our internal agentic tooling • Own our evals end to end - both the architecture and the content - with support from data science and clinical partners • Make every agentic deployment run through the testing apparatus before it ships, and own the release gates that keep unsafe or low-quality behavior from reaching patients • Build the ground truth, judges, and metrics, and validate that the evaluation itself can be trusted: calibration to human labels, reliability, and honest confidence on every number, in partnership with our data scientist • Build functional tooling for labeling and review workflows, so clinicians, coaches, and designers can author and review evaluation scenarios without an engineer in the loop • Help close the loop from evaluation results to model and prompt refinement, working toward systems that iterate safely with less human hand-holding What we're looking for • Significant experience building and shipping reliable production systems and tooling • Deep understanding of how to evaluate AI systems - LLM-as-judge, red-teaming and adversarial testing, synthetic scenario generation, and multi-turn and agentic evaluation - and a clear sense of how evals themselves fail. You've deployed evals and automated AI tooling in production, not just prototyped them • A testing mindset applied to building the measurement system, not running tests against a spec: adversarial instinct, coverage thinking, regression discipline, and documentation others can build on • You use AI in your daily work and build tools that make the people around you more effective • Enough fluency in statistics and experimental design to partner with a data scientist on calibration and reliability • Can design the workflow and build a functional UI for non-engineers like clinicians and labelers • A genuine interest in improving healthcare alongside an interdisciplinary team, with the judgment to tell a launch-blocking issue from a nice-to-have Bonus Points • Experience in healthcare or another regulated, high-trust domain, and familiarity with the regulatory landscape • Hands-on experience with the eval tooling ecosystem (LangSmith, Braintrust, DeepEval, Ragas, Promptfoo, or similar) • Red-teaming or AI safety experience - prompt injection, jailbreaks, adversarial and stress testing • Experience with automated, eval-driven model or prompt optimization • You've built in an early-stage or fast-moving environment Nuna is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, genetics and/or veteran status. #LI-LM1
    고용주 사이트에서 지원하기AI 면접

    고용주의 지원 페이지를 새 탭에서 엽니다.

    AI 면접

    AI로 이 면접 연습하기

    바로 이 직무에 맞춘 모의 면접과 바로 활용할 수 있는 피드백.

    WWorkzil

    Workzil은 하나의 흐름입니다. 일자리를 찾고, 그 뒤의 시장을 읽고, 채용합니다. 모든 수치에는 출처와 날짜가 표시됩니다.

    Workzil로 돌아가기

    Workzil 사이트

    • Workzil우리가 하는 일: 일자리 찾기부터 채용까지 하나의 흐름.
    • Workzil Jobs실제 게시일과 공개된 급여가 있는 채용 공고.
    • Workzil Market내 직무와 지역의 급여와 채용 동향을 출처와 함께 확인하세요.
    • Workzil Employers업무용 이메일로 인증한, 진행 중인 공고가 있는 기업 페이지.
    © 2026 Workzil개인정보 처리방침이용약관