Software Engineer jobs

Lead Agentic AI Engineer

CodeRoadUnited StatesFull-time7+ years experiencePosted 1 month ago

$190k–$250k/yr listed by the employer

This job is closed.

The employer took it down 2 days ago, after 17 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Note: Last seen open 14 days agoLive check
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

Similar open jobs

Lead Full Stack Engineer

AIR Communities · Denver, CO

$130k–$155k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

See more like this

What you’ll do

  • Design and deploy stateful multi-agent orchestration systems with task decomposition, supervisor coordination, human escalation, and error recovery.
  • Build MCP servers and connectors that securely expose Salesforce tools, actions, and enterprise context to agents.
  • Optimize LLM routing across model tiers to balance latency, accuracy, and API costs.
  • Create automated evaluation pipelines to measure grounding, schema validity, and hallucination resistance.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 7+ years of enterprise software engineering in Python, TypeScript/Node.js, Java, or Apex
  • 3+ years of production AI/LLM experience designing, evaluating, and scaling autonomous agent systems and RAG architectures in enterprise environments
  • Direct experience setting up automated evaluation test gates using Promptfoo, Ragas, or LLM-as-a-judge frameworks
  • Hands-on experience with Salesforce APIs (REST, SOQL/SOSL, Platform Events), Salesforce Data Cloud, vector search, Agentforce, containerized MCP deployments, or Spec-Driven Development (preferred)

Skills

  • Deep expertise with LangGraph, LangChain, Anthropic/Claude APIs, MCP, and observability suites
  • Ability to diagnose latency bottlenecks, debug agent routing loops, and translate ambiguous enterprise needs into secure, deterministic technical solutions
  • Advanced English fluency for written and spoken technical leadership and consultation

Other requirements

  • Legal authorization to work in the United States

Benefits

Health insurance
Medical coverage
Dental & vision
Dental and vision coverage
Paid time off
Holidays off and paid time off (PTO)

Also: retirement plan

Full job description

From CodeRoad’s careers site

Engagement Type: Full-Time

About CodeRoad

CodeRoad is a technology execution partner trusted by companies across North America since 2002. We work alongside our clients to engineer, modernize, and scale the technology that powers their businesses, combining deep technical expertise, specialized teams, and shared accountability for outcomes. Our capabilities span product engineering, platform engineering, legacy modernization, and AI engineering.

Show full descriptionShow less

Our engineers, designers, delivery leaders, and technology specialists collaborate through Velocity Studios: specialized teams developed within CodeRoad to deliver complex technology initiatives. Being assigned to a project means you become part of a collaborative environment where you can strengthen your expertise, take ownership of meaningful work, and grow alongside experienced professionals.

Why Build Your Career at CodeRoad?

-

High-Velocity Work & Client Exposure: We work close to the technology, teams and roadmaps that move real outcomes. Direct engagement with U.S. client teams and roadmaps.

-

Career Continuity & Long-Term Opportunity: Your career here can outlast any single project. Continuous multi-project pipeline; long-tenure CodeRoaders.

-

Engineering Autonomy & Technical Mastery: We invest in the skills that shape what's next. Agentic AI tools and training, Coursera Enterprise, Studio practice labs, L1-L7 Career Framework.

-

High-Trust Employee Experience: You grow in an environment built on trust, transparency and recognition. High-touch onboarding, transparent leadership communication, community recognition, psychological safety.

Key Responsibilities

-

Architect Multi-Agent Orchestration Systems: Design and deploy stateful multi-agent coordination graphs using LangGraph or custom DAG loops, enabling dynamic task decomposition, supervisor orchestration, human-in-the-loop escalation, and self-healing error recovery.

-

Engineer MCP Interfaces & Connectors: Build standardized Model Context Protocol (MCP) servers and connectors to securely expose Salesforce tools, custom objects, actions, and enterprise context to autonomous agent runners.

-

Optimize Reasoning, Latency & Token Spend: Architect multi-tiered LLM routing strategies across model tiers (utilizing Claude 3.5 Sonnet/Opus for complex multi-turn reasoning and Haiku for high-throughput utility tasks) to balance latency, accuracy, and API costs.

-

Establish Automated Evaluation Pipelines: Implement automated eval harnesses (Promptfoo, Ragas, DeepEval) within CI/CD pipelines to continuously measure context grounding, schema validity, and hallucination resistance against golden benchmark datasets.

-

Enforce Defense-in-Depth Security & Observability: Implement end-to-end telemetry and security using LangSmith or Langfuse, combined with input sanitization, field-level security (FLS) compliance, and automated PII scrubbing.

-

Lead Technical Strategy & Architecture Standards: Establish specification-driven development patterns, clear API contracts, and architectural blueprints, communicating technical trade-offs directly to engineering teams and C-suite stakeholders.

What You Bring

-

7+ Years of Enterprise Software Engineering: Proven experience building robust software systems in Python, TypeScript / Node.js, Java, or Apex.

-

3+ Years of Production AI / LLM Experience: Demonstrated track record designing, evaluating, and scaling production autonomous agent systems and RAG architectures in enterprise environments.

-

Agentic AI & Tooling Mastery: Deep expertise with LangGraph, LangChain, Anthropic / Claude APIs (tool calling, prompt caching, Claude Code), MCP, and observability suites (LangSmith, Langfuse, OpenTelemetry).

-

Rigorous Evaluation Mechanics: Direct experience setting up automated test gates using Promptfoo, Ragas, or LLM-as-a-judge frameworks to monitor non-deterministic behavior and context degradation.

-

Proactive Ownership & Diagnostic Skills: High autonomy to isolate complex latency bottlenecks, debug agent routing loops, and turn ambiguous enterprise needs into secure, deterministic technical realities.

-

Advanced English Fluency: Exceptional written and spoken English communication skills for direct technical leadership and consultation with U.S.-based client executives.

-

Legal Authorization: Legal authorization to work in the United States.

-

Bonus Ecosystem Exposure: Hands-on experience with Salesforce APIs (REST, SOQL/SOSL, Platform Events), Salesforce Data Cloud, vector search, Agentforce, containerized MCP deployments, or Spec-Driven Development (SDD) is a strong plus.

What You’ll Love

-

Competitive Pay ($190,000–$250,000 USD / year)

-

Comprehensive Benefits Package (Medical, Dental, Vision & Retirement Plan)

-

Holidays Off & Paid Time Off (PTO)

-

Opportunity to work with high-growth US-based companies and cutting-edge tech stacks.

Ready to Build What Actually Ships?

Explore opportunities and submit your application today!

Something wrong with this job? Report it