AI Engineer

Ro is a vertically integrated healthcare platform connecting telehealth, diagnostics, pharmacy, and logistics to provide a seamless, end-to-end experience for millions of patients. We are dedicated to building a new healthcare system where the patient is in control, leveraging technology to deliver care efficiently and effectively. Ro has been consistently recognized as a top workplace in Healthcare, New York, and for Women and Parents.

Introduction

Join Tech @ Ro to build the future of healthcare from the ground up! At Ro, we believe that when people achieve their health goals, they can achieve their life goals. The current healthcare system isn’t built to serve patients; it was built to bill. We are building a new system where the patient is in control, designed from scratch for the digital age.

Technology is core to how we deliver care at Ro. We've developed a vertically integrated healthcare platform that seamlessly connects telehealth, diagnostics, pharmacy, and logistics for millions of patients. As an AI Engineer, you'll be part of a new team focused on shipping LLM-powered products across patient experience, clinical operations, and internal tooling, working from prototype through production and learning from experienced AI engineers.

Responsibilities

• Build and ship production LLM-powered features across patient-facing products, clinical workflows, and internal tools.
• Develop the AI application layer, including prompt orchestration, tool calling, retrieval (RAG), agent workflows, and structured outputs.
• Create and iterate on evaluation suites, including synthetic test datasets, LLM-as-a-judge evaluations, regression tests, and human review workflows to enhance quality over time.
• Write code to integrate LLMs with Ro's internal systems, APIs, and operational workflows.
• Collaborate closely with EHR operators, Patient Advocates, and clinical teams to understand workflows and identify AI opportunities.
• Rapidly prototype, deploy early, measure outcomes, and iterate based on real-world usage.
• Contribute to AI infrastructure, tooling, and engineering best practices alongside senior engineers.

Requirements

• 1–4 years of software development experience, with hands-on experience building LLM-powered applications through work, internships, research, school, hackathons, or side projects.
• Strong Python engineering skills with experience building backend services or developer tools.
• Comfortable using AI-assisted development tools throughout the software development lifecycle (or eager to learn).
• Proven experience building at least one LLM-powered application or feature, with the ability to discuss technical decisions and lessons learned.
• Enjoys rapid learning, experimenting with new technologies, and thriving in dynamic environments where best practices are evolving.
• Strong problem-solving skills and comfort navigating ambiguity with support from experienced teammates.

Nice to Have

• Experience with orchestration frameworks (e.g., LangChain, LangGraph, AgentCore).
• Experience with RAG architectures.
• Experience with vector databases.
• Experience with prompt/version management.
• Experience with evaluation and observability platforms (e.g., LangSmith, Braintrust, Arize Phoenix).

Benefits

• Competitive equity and benefits package.
• Opportunity to work in a performance-driven team with a strong sense of ownership and urgency.
• Help define how modern healthcare should be delivered.

About Company

Ro is a vertically integrated healthcare platform connecting telehealth, diagnostics, pharmacy, and logistics to provide a seamless, end-to-end experience for millions of patients. We are dedicated to building a new healthcare system where the patient is in control, leveraging technology to deliver care efficiently and effectively. Ro has been consistently recognized as a top workplace in Healthcare, New York, and for Women and Parents.

How to Apply

Apply directly through the provided application link.