Browse JobsCareer BlogJob Search ResourcesAI Interview PreparationWorkzil HomeJob ListingsPricing PlansContact UsCreate AccountHiring SolutionsSecurity & PrivacyAffiliate ProgramFree CV BuilderAI CV ReviewerFree Resume BuilderAI Resume ReviewerSalary CalculatorSalary Comparison ChartsLayoff TrackerLayoff NewsHiring Trends 2026Startup Funding TrackerCompany Expansion TrackerVisa Sponsorship CompaniesBest Companies to Work ForBlog ArticlesCareer ResourcesAI Interview PrepTerms of ServicePrivacy PolicyCookie PolicyPost a JobAI Candidate ScreeningEmployer PricingEnterprise SolutionsJobs in New YorkJobs in San FranciscoJobs in AustinJobs in SeattleJobs in ChicagoJobs in Los AngelesJobs in BostonJobs in DenverJobs in AtlantaJobs in MiamiJobs in DallasJobs in Washington DCJobs in San JoseJobs in RaleighJobs in NashvilleSoftware Engineer JobsData Scientist JobsProduct Manager JobsData Analyst JobsUX Designer JobsFrontend Developer JobsDevOps Engineer JobsMarketing Manager JobsFinancial Analyst JobsCybersecurity Analyst JobsSoftware Engineer Salary GuideData Scientist SalaryProduct Manager SalaryUX Designer SalaryDevOps Engineer SalaryCloud Architect SalarySoftware Engineer Salary CalculatorData Scientist Salary CalculatorProduct Manager Salary CalculatorSoftware Engineer Salary San FranciscoSoftware Engineer Salary New YorkData Scientist Salary SeattleProduct Manager Salary AustinDevOps Engineer Salary CalculatorUX Designer Salary CalculatorSoftware Engineer Interview QuestionsProduct Manager Interview QuestionsData Scientist Interview QuestionsUX Designer Interview QuestionsFrontend Developer Interview QuestionsRemote Software Engineer JobsRemote Product Manager JobsRemote Data Analyst JobsRemote UX Designer JobsRemote Frontend Developer JobsElectrician JobsPlumber JobsHVAC Technician JobsRegistered Nurse JobsTruck Driver JobsWarehouse Worker JobsCarpenter JobsWelder JobsRestaurant Manager JobsConstruction Manager JobsDental Hygienist JobsReal Estate Agent JobsElectrician Salary GuidePlumber Salary GuideRegistered Nurse SalaryTruck Driver SalaryHVAC Technician SalaryWelder Salary GuideElectrician Interview QuestionsNursing Interview QuestionsTruck Driver Interview QuestionsRestaurant Manager Interview QuestionsLayoffs 2026Layoffs 2025Layoffs 2024Layoffs 2023Google LayoffsMeta LayoffsAmazon LayoffsMicrosoft LayoffsSoftware Engineer Resume BuilderData Scientist Resume BuilderProduct Manager Resume BuilderRegistered Nurse Resume BuilderMarketing Manager Resume BuilderTechnology Industry JobsFinance Industry JobsHealthcare Industry JobsConstruction & Trades JobsRetail & E-Commerce JobsSoftware Engineer vs Data ScientistSoftware Engineer vs Product ManagerData Scientist vs Data AnalystFrontend vs Backend DeveloperProduct Manager vs Project ManagerElectrician vs Plumber
    WorkzilWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    WorkzilWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    본문으로 건너뛰기
    채용 검색원격 근무면접 연습
    Workzil이란로그인시작하기
    채용San FranciscoAI Research Engineer · dscout
    D
    dscout직원 200-500명

    AI Research Engineer

    San Francisco, CA · 2026년 11월 2일 게시

    급여
    급여 미공개
    위치
    San Francisco, CA
    직급
    명시되지 않음
    게시일
    2026년 11월 2일
    출처 기준 날짜

    직무 소개

    At Dscout, we’re building the most flexible and powerful UX research platform on the market—trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us. At Dscout, we're building the human-grounded layer that teaches AI to work in the real world and proves it stays aligned there. We are expanding our smart and driven team and would love for you to join us. Dscout AI Training & Evals builds human data and evals that show whether AI works for real people. For ten years Dscout has captured how people behave in real context, with consent and scientific rigor. Dscout AI Training & Evals points that engine at AI: consented human behavior and judgment, turned into the training data, evals, and benchmarks AI teams trust. Models ace benchmarks and still surprise people in the wild. A benchmark says how capable a model is. It does not say whether the model works for the person using it, across weeks, in the mess of real life. That gap is where we work. We serve AI researchers, the product builders who ship alongside them, and the research teams who partner with both. We are a new unit inside an established company: live customers, a mature platform (React, Elixir, Python, Swift, Kotlin; SOC 2 and HITRUST certified), a small senior team, and room to build. We work AI-native. Agents write code, evals gate changes, and we aim to do in months what used to take years. A note from our Chief AI Officer & GM. The hardest AI problems show up when a model meets real people, with their tools, their interruptions, and their goals. Our customers need a partner who can design the answer, build it, and ship it fast. Ground Truth sits where deployment meets research: what we learn in the field shapes the science, and the science shapes what we ship. Come build it with us. Why this seat • Work on a problem the field has not solved: measuring whether AI works for real people, over real time. • Study something most evals do not have: real participants, doing real tasks in their own context. • Own the benchmark. You are founding it, not joining a team that has one. • Publish. Methods and benchmarks go to the research community, with first authorship on the benchmark. • Join a small senior team with direct access to the Head of AI Research and the GM. This is a research-first role focused on questions where the right rubric, benchmark, or method does not yet exist. You will find the gaps, propose bold directions, and take projects from the first hypothesis through experiments and benchmark construction to publication. You will also build: the science has to run inside live customer programs. What you will do Rubrics and QA science • Design rubrics and test whether they measure what they claim: validity, reliability, and sensitivity. • Measure how reliable human raters are, and when disagreement is noise versus real signal. • Calibrate AI judges against real human judgment, and study when they drift away from it. • Build quality signals that put evidence behind every data point we ship. Long-horizon, real-user benchmarks • Design Dscout’s first benchmark: real users, in real context, over long horizons. Multi-week tasks across tools, not one-shot prompts. • Define the protocol, task design, scoring, and release. Work with our delivery team on fieldwork. • Work out how to keep a living benchmark honest over time: drift, contamination, difficulty, and what counts as a meaningful change. • Write the paper and own the public release. Human judgment as training and eval signal • Study when real-world human feedback improves a model and when it adds noise. • Explore how preference and judgment data from representative people differ from expert data. • Turn findings into methods our forward deployed engineers and delivery team can run in the field. New research directions • These areas are the core, not the whole list. You will have significant latitude to propose new programs, such as calibrating user simulations against real behavior, human-AI collaboration, and behavioral evaluation of agents. • Co-author with outside labs and academics on studies that need real-user data. Help run our paper-reading group. A good first year • A QA and rubric framework running on live customer programs, with documented validity. • Benchmark v0 released, with a paper submitted to a top venue. • At least one external team using or citing our work. • Delivery colleagues using your methods without needing you in the room. How we will hire: a conversation with the Head of AI Research; a research talk on your publication; a design exercise (how would you validate a rubric for a long-horizon task?); a conversation with the GM, forward deployed engineers, and delivery partners. What we care about most. A strong publication record helps. We care most about whether you can find the question that matters, design a rigorous way to answer it, and move fast enough that the answer is still useful. What you bring • Published research in evals, preference learning, reward modeling, human-AI interaction, measurement, or agent evaluation. • A PhD, a PhD in progress, or an MS with two or more strong research internships at labs or top industry groups. If you do not have advanced degrees but have a history of creative machine learning research work, this is just as desirable. • Strong applied statistics: inter-rater reliability, confidence intervals, power, and a nose for when a metric misleads. • Hands-on experience with LLM-as-judge, rubric-based evaluation, and preference data. • Strong Python, and the ability to build research prototypes and evaluation pipelines other people run. You use AI coding tools as a real part of your workflow. • Experience running experiments on messy human data, not only curated datasets. • Clear technical writing, and the ability to explain your work to a lab researcher and to a product manager. • Based in the Bay Area. Nice to have: long-horizon or agentic evaluation work; psychometrics, item response theory, or human-subjects research; open-source benchmark or dataset contributions. Compensation: $250-400K OTE + Equity. Includes a built-in bonus and equity program, publication freedom, a conference budget, flexible PTO, 15 holidays, 12 weeks of paid parental leave, 401k match, and an education stipend. This is an ideal list. If the role excites you and you do not check every box, we would still love to hear from you. Of course, what is outlined above is an ideal set of expectations; however, business needs and other projects and tasks may shift, and additional tasks could be assigned at the discretion of your manager. About Dscout Dscout is a team of passionate, empathetic, and curious professionals. As a recognized leader in the Forrester Wave, we’re at the cutting edge of experience research technology. The power of research drives us - how in-context insights from real people can build more enjoyable products and services. We prioritize learning, sharing, and building. We also deeply value being a diverse and inclusive team and company and look for team members who align with that belief. Join our dynamic team and help shape product roadmaps and business strategies for the world’s most loved brands. It doesn't stop there. When you join the Dscout team, you will get: • A strong and competitive compensation package with a built-in bonus and equity program. • An incredible and progressive benefits package (for both you and your dependents) to support work/life balance, including flexible PTO, 15 company holidays, 12 weeks of paid parental leave, 401k match, and much more. • An education stipend to support your growth & development, and a remote work stipend. • A company that is open and transparent with our team. You will know what is happening and why it matters. Dscout is an equal-opportunity employer that values diversity. We do not discriminate based on identity, including race, color, religion, national origin or ancestry, sex, gender identity and expression, age, physical or mental disability, pregnancy, veteran or military status, unfavorable discharge from military service, genetic information, sexual orientation, marital status, order of protection status, citizenship status, arrest record or expunged or sealed convictions, or any other legally recognized protected basis under federal, state, or local law. If you need reasonable accommodations for any part of the employment process, please email us at accommodations@dscout.com with the nature of your request and your contact information. We'll do everything possible to ensure you're well-prepared for success during our interview process, while also upholding your privacy, including accommodating any special requests. Please note that only inquiries regarding requests for reasonable accommodation will be responded to from this email address. When you apply at Dscout, we will process your job applicant data, including your employment and education history, transcript, writing samples, and references, as necessary to consider your job application for open positions. For more information about our privacy practices, please visit our Privacy Policy. Dscout participates in the E-Verify program in certain locations, as required by law. Location Flexibility: Dscout is proud to support a remote-first workforce and enable employees to work from almost anywhere. At this time, however, we are unable to hire in the following locations: Montana, Hawaii, Alaska, and Washington DC. NOTE: DSCOUT NEVER CONTACTS JOB APPLICANTS VIA TEXT, MESSENGER, OR OTHER SIMILAR APPLICATIONS. BE AWARE OF PHISHING AND SPOOFING SCAMS, BOTH VIA TEXT AND EMAIL. ONLY RESPOND TO EMAILS FROM DSCOUT.COM

    비슷한 채용

    모든 결과 보기
    PResearch Engineer - Plasma EquipmentPrinceton NuEnergyMonmouth Junction, New Jersey급여 미공개정규직
    처음 확인: 3일 전
    CSystem Security Research Engineer – OS and Device ProtectionCMC MicrosystemsMarkham, Ontario, Canada급여 미공개
    처음 확인: 3일 전
    CResearch Engineer - Agentic Software Systems EngineeringCMC MicrosystemsMarkham, Ontario, Canada급여 미공개
    처음 확인: 3일 전
    고용주 사이트에서 지원하기AI 면접

    고용주의 지원 페이지를 새 탭에서 엽니다.

    AI 면접

    AI로 이 면접 연습하기

    바로 이 직무에 맞춘 모의 면접과 바로 활용할 수 있는 피드백.

    Workzil

    Workzil은 하나의 흐름입니다. 일자리를 찾고, 그 뒤의 시장을 읽고, 채용합니다. 모든 수치에는 출처와 날짜가 표시됩니다.

    Workzil로 돌아가기

    Workzil 사이트

    • Workzil우리가 하는 일: 일자리 찾기부터 채용까지 하나의 흐름.
    • Workzil Jobs실제 게시일과 공개된 급여가 있는 채용 공고.
    • Workzil Market내 직무와 지역의 급여와 채용 동향을 출처와 함께 확인하세요.
    • Workzil Employers업무용 이메일로 인증한, 진행 중인 공고가 있는 기업 페이지.
    © 2026 Workzil개인정보 처리방침이용약관