Forward Deployed Engineer

About the company

Braintrust is building the modern platform for evaluating and deploying AI systems. Our mission is to help enterprises build trust in their AI by making it easy to test, monitor, and improve models using real-world evaluation frameworks. We work with cutting-edge customers in finance, healthcare, and tech who are building production-grade AI systems.

About the role

As a Forward Deployed Engineer (FDE) on our Professional Services team, you'll work directly with customers to get them up and running with Braintrust’s platform. You’ll lead hands-on technical engagements, helping teams define, build, and operationalize AI evaluation frameworks that reflect their real-world goals.

This is a hybrid role that blends software engineering, customer collaboration, and delivery excellence. You’ll partner closely with customer ML, data, and engineering teams to implement evaluation pipelines, define metrics, and build custom logic that plugs into Braintrust’s platform.

You’ll also act as a feedback loop for our product and engineering teams, helping shape the future of the platform based on what you see in the field.

What you’ll do

• Deliver professional services engagements for new and existing customers—from kickoff to deployment.

• Lead the implementation of evaluation frameworks for LLM and other model types, tailored to each customer’s use case.

• Build integrations with customer infrastructure, data pipelines, and model endpoints using Python or TypeScript.
  Write custom evaluators, metrics, and logic to test models in real-world conditions.

• Guide customers on best practices for model evaluation, testing, and monitoring using Braintrust.

• Collaborate with internal product and engineering teams to influence roadmap priorities and improve customer workflows.

• Help document reusable patterns, templates, and tools for future engagements.

Ideal candidate credentials:

• 2–5 years of experience in software engineering, ML engineering, or technical consulting.
  Experience working directly with external clients or stakeholders in a delivery or services capacity.
  Proficiency in Python or TypeScript —you’re comfortable building scripts, tools, and integrations with modern software practices.

• Familiarity with machine learning workflows, model evaluation, and LLM development (e.g., prompt engineering, RAG pipelines, quality metrics).
  Strong communication and project management skills—you know how to translate between technical and business needs.

• A self-starter mindset—you enjoy figuring things out in real time and aren’t afraid to roll up your sleeves.

• Bonus: Background in professional services, solutions engineering, or customer delivery at an AI or developer tools company.

Why Join Us

• Be on the ground floor of a fast-growing startup defining the future of AI evaluation.
  Work with top-tier enterprise customers solving real, high-impact problems with LLMs.
  Collaborate with a tight-knit, mission-driven team of engineers, researchers, and operators.

• Influence our services playbook and help scale how we deliver value to customers.

Benefits include

• Medical, dental, and vision insurance

• 401k plan

• Daily lunch, snacks, and beverages

• Flexible time off

• Competitive salary and equity

• AI Stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.