Senior Generative AI Engineer

Dataiku is a leading AI and machine learning platform that helps companies build and deploy AI-powered applications. The ED&A team focuses on internal operations, leveraging advanced AI to enhance efficiency and impact across various departments.

Introduction

As a Senior Generative AI Engineer on the ED&A team, you will be instrumental in building agentic AI systems that transform Dataiku's internal operations. This is a hands-on, end-to-end role focused on translating business challenges into production-ready software solutions and overseeing their implementation from conception to deployment.

Responsibilities

Agentic AI Solution Development & Integration

• Design end-to-end AI solutions on Dataiku's platform, utilizing Dataiku Agent Hub, Prompt Studio, LLM Mesh, Knowledge Banks (Vector Stores), or Python-based frameworks as needed.
• Build and orchestrate multi-agent systems using Dataiku's Visual Agents (simple and structured), alongside code-based frameworks such as LangGraph, CrewAI, Claude Agent SDK, and OpenAI Agents SDK.
• Integrate and optimize LLM APIs across multiple providers (OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure, open-source models via Dataiku's LLM Mesh), applying intelligent model routing strategies to balance cost, latency, and quality.
• Implement Retrieval-Augmented Generation (RAG) pipelines, including agentic RAG and GraphRAG, leveraging Dataiku's Knowledge Banks with reranking, dynamic filtering, and document extraction capabilities.

Stakeholder Engagement & Delivery

• Work primarily with the “Revenue” organization, including Sales, BDR, Customer Success, Solutions Engineering, Professional Services, Sales Operations, and Marketing (75% of the role).
• Apply proven solutions and approaches more broadly across the organization (25%).
• Engage with stakeholders to gather business requirements, identify underlying user pain points, and design solutions that address both stated needs and deeper problems.
• Own projects end-to-end, from requirements gathering and solution design through to build, deployment, and handover.

Agent & Tool Development

• Develop autonomous and semi-autonomous AI agents using Dataiku's Agent Builder, custom Python-based architectures (e.g., LangGraph, CrewAI, Claude Agent SDK), or a combination of both, exercising judgment on leveraging platform capabilities versus custom builds.
• Design and build Agent Tools beyond standard examples, including custom API integrations, data retrieval modules, decisioning logic, and automated workflows, creating tailored solutions for specific business problems.
• Build, publish, and consume MCP (Model Context Protocol) servers to facilitate agent-to-tool integration across systems, including designing custom MCP servers when necessary.
• Develop evaluation and monitoring strategies for agent systems, combining Dataiku's built-in features with custom instrumentation to measure reliability, accuracy, cost, and business impact in production.

AI Governance & Evaluation

• Design and maintain evaluation frameworks (evals) for LLM-based systems, measuring accuracy, latency, cost, and reliability in production.
• Ensure adherence to data governance, security, and regulatory compliance requirements (e.g., EU AI Act awareness, responsible AI practices) for all AI solutions.
• Utilize Dataiku's Cost Guard and Quality Guard features to manage LLM expenditure, enforce usage policies, and maintain output quality standards.
• Collaborate with analytics and data engineering teams to maintain metadata on reference datasets for LLM consumption.

Web Application Development

• Create front-end user interfaces for AI applications using HTML, CSS, and JavaScript within Dataiku's webapp framework, Dataiku Answers for chat interfaces, or standalone applications built with Vue.js and Node.js.
• Collaborate on UX design to ensure internal stakeholders find AI solutions intuitive and responsive.

Continuous Learning

• Provide product feedback to the development team to enhance the platform.
• Stay up-to-date with the rapidly evolving AI engineering landscape, including agent frameworks, model capabilities, evaluation practices, governance requirements, and protocols like MCP and A2A.

Requirements

Technical Proficiency

• Strong Python skills, including familiarity with typical data science and AI engineering libraries.
• Hands-on experience building agentic AI systems, including multi-agent orchestration, tool chaining, autonomous decision-making, and production deployment.
• Experience with modern agent orchestration frameworks (LangGraph, CrewAI, Claude Agent SDK, OpenAI Agents SDK, or similar); familiarity with LangChain is relevant but not solely sufficient.
• Understanding of RAG architectures (vector databases, embedding strategies, agentic RAG, GraphRAG) and their appropriate application.
• Familiarity with MCP (Model Context Protocol) for agent-to-tool integration, or the ability to quickly adopt new integration standards.
• Experience with structured outputs, function/tool calling, and prompt engineering across multiple LLM providers.
• Web development fundamentals (HTML, CSS, JavaScript); experience with Vue.js and Node.js is preferred.
• Exposure to AI evaluation practices, building evaluations, monitoring model/agent performance in production, and iterating based on metrics.
• Comfort with AI-assisted development tools (e.g., GitHub Copilot, Cursor, Claude Code).
• Familiarity with Dataiku is a bonus.

Educational & Professional Background

• Bachelor's or Master's in Computer Science, Data Science, Engineering, or a related field; equivalent professional experience will also be considered.
• Demonstrated ability to integrate diverse technologies, optimize workflows, and deliver user-friendly AI solutions in a production environment.

Soft Skills

• Strong communication and presentation skills, with the ability to collaborate effectively with both technical and non-technical stakeholders.
• A problem-solving mindset and a passion for innovation, focused on delivering measurable business value.
• Openness to learning new tools (e.g., Dataiku) and adapting to a fast-changing AI landscape.

About Company

Dataiku is a leading AI and machine learning platform that helps companies build and deploy AI-powered applications. The ED&A team focuses on internal operations, leveraging advanced AI to enhance efficiency and impact across various departments.

How to Apply

Please apply through the provided application link.