Back to jobs

    Senior Software Engineer - AI Engineering

    Mercury
    San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States Full-Time US employees (any location): $166,600 - $218,700 Canadian employees (any location): CAD 157,400 - 206,650 2026-05-28

    About Mercury

    Mercury is dedicated to building the future of AI by providing shared infrastructure, context, and capabilities that accelerate the development and deployment of AI-powered solutions. We foster an environment where ambitious AI work can thrive and enhance the velocity of teams across the company. Mercury values diversity & belonging and is proud to be an Equal Employment Opportunity employer, committed to providing reasonable accommodations throughout the recruitment process.

    About the Position

    Introduction

    At Mercury, we are making a deliberate, company-wide commitment to AI. This role is crucial for transforming scattered experiments into shared infrastructure, context, and capabilities, multiplying the effectiveness of AI initiatives across the company.

    Responsibilities

    You will join a team actively building Mercury's internal AI platform and enablement layer. Your key responsibilities will include:

    Extend the AI platform foundation:

    • Build and evolve MCP servers to connect internal systems and data sources into a cohesive interface for agents and engineers.
    • Expand and operate our LLM gateway infrastructure, covering routing, rate limiting, cost attribution, and observability for all teams.
    • Convert early patterns into robust defaults, including shared prompt libraries, guardrails, and policy-as-code, to facilitate safe and rapid team development.

    Strengthen the shared company knowledge layer:

    • Develop and maintain structured contextual artifacts that are clean, reliable, and agent-consumable, allowing LLMs to reason accurately about Mercury’s domain.
    • Enhance internal knowledge discoverability and retrieval for both humans and agents to quickly find accurate answers.
    • Collaborate with domain teams to standardize key sources of truth and ensure their freshness.

    Enable faster prototyping and iteration across the company:

    • Build and refine sandbox environments and tools that enable engineers to experiment with AI safely and quickly.
    • Create self-service scaffolding for non-engineers (PMs, ops, finance) to prototype and deploy AI-powered workflows with minimal support.
    • Develop playgrounds and evaluation harnesses to test and iterate internal AI agents in controlled environments before production deployment.

    This list is illustrative. Priorities will shift as we learn; the right person will help choose the next highest-leverage work.

    Requirements

    • 5+ years of backend development experience in complex, production systems, demonstrating experience building systems relied upon by other engineers.
    • Fluency across programming languages and the ability to navigate platform engineering, infrastructure, and developer tooling independently.
    • Hands-on experience building LLM-powered systems, including RAG pipelines, agents, and evaluation frameworks, with at least one shipped to production.
    • Understanding of the practical tradeoffs in AI deployments: cost modeling, observability, latency, and safety.
    • High agency and self-direction, capable of operating effectively without tightly-defined scope, identifying high-leverage work, and executing it.
    • Clear communication across technical and non-technical audiences, with the ability to explain built solutions and their significance.

    Benefits

    The total rewards package at Mercury includes base salary, equity, and benefits. Our salary and equity ranges are highly competitive within the SaaS and fintech industry and are updated regularly using the most reliable compensation survey data for our industry. New hire offers are made based on a candidate’s experience, expertise, geographic location, and internal pay equity relative to peers.

    About Company

    Mercury is dedicated to building the future of AI by providing shared infrastructure, context, and capabilities that accelerate the development and deployment of AI-powered solutions. We foster an environment where ambitious AI work can thrive and enhance the velocity of teams across the company. Mercury values diversity & belonging and is proud to be an Equal Employment Opportunity employer, committed to providing reasonable accommodations throughout the recruitment process.

    How to Apply

    [Apply Now](link to application page)

    Apply Now

    Your data is only shared with Mercury

    Location

    San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States

    Type

    Full-Time

    Keywords

    AI
    Artificial Intelligence
    Software Engineering
    Backend Development
    LLM
    Large Language Models
    RAG
    Agents
    Platform Engineering
    Infrastructure
    Developer Tools
    Fintech
    SaaS
    Remote
    Verified Company

    Senior Software Engineer - AI Engineering

    Mercury