New Jersey jobs

Context Engineering Experienced Manager, Digital Transformation & Innovation

BDO USAWoodbridge, NJ +1 placeHybridPosted 20 days ago

$150k–$180k/yr listed by the employer

Key facts

Where
Woodbridge, NJ · Grand Rapids, MI · hybrid
Experience
8+ years

This job is closed.

The employer took it down 17 days ago, after 1 day open. Here are similar open jobs.

  • Checked: On the company's own careers siteOracle Recruiting board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundOracle Recruiting board
  • Note: Last seen open 17 days agoLive check
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

Similar jobs

Tax Senior Manager, ASC740

BDO USA · Philadelphia, PA +2 places

$146k–$200k/yr

StrongOpen 3 monthsChecked open todayPosted 3 months ago

See more like this

What you’ll do

  • Design and govern reusable context infrastructure, skill libraries, agent instructions, and knowledge standards across the product portfolio.
  • Curate retrieval corpora and build, tune, and evaluate retrieval and grounding pipelines for accuracy, cost, and latency.
  • Codify assurance-domain knowledge and BDO methodology into governed, retrievable formats, with provenance and traceability.
  • Set context governance, security, lifecycle, and quality standards; guide teams through implementation and remediation.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Microsoft Certified: Azure AI Engineer Associate, or equivalent (preferred)

Experience

  • 8 or more years of experience in software, data, or AI engineering, or related technology fields
  • 4 or more years of experience building LLM context, retrieval-augmented generation (RAG), or knowledge-management systems
  • 3 or more years of experience defining reusable engineering assets, developer-enablement tooling, or technical standards
  • Experience with retrieval and vector technologies, including Azure AI Search, embeddings, hybrid search, and re-ranking
  • Ability to serve as a hands-on context architect while providing standards, governance, and team enablement
  • Experience presenting context and AI governance recommendations to governance bodies such as Architecture Review Boards
  • Experience leading technical teams or directing complex cross-functional initiatives (preferred)
  • Experience extracting and codifying domain knowledge into machine-consumable formats (preferred)
  • Experience delivering enterprise-scale AI or knowledge solutions in professional services, assurance, or accounting industries (preferred)
  • Experience with context governance, prompt management, or AI evaluation frameworks (preferred)
  • Experience with agentic development tooling such as Claude Code and Git-based workflows (preferred)
  • Experience with .NET/C# and/or Python for context and evaluation tooling (preferred)
  • Experience with AI evaluation and observability tooling (preferred)

Education

  • High School Diploma/GED
  • Bachelor’s degree focused in Computer Science, Information Systems, Engineering, or Information Technology (preferred)

Skills

  • Expert-level knowledge of Microsoft Azure AI services, including Azure AI Foundry, Azure OpenAI, and Azure AI Search
  • Extensive knowledge of agent-instruction and skill systems (CLAUDE.md and equivalents) and Markdown-based knowledge structures
  • Expert-level knowledge of context engineering, retrieval design, and grounding for production LLM systems
  • Deep knowledge of information architecture and ability to translate subject-matter expertise into machine-consumable knowledge
  • Knowledge of data privacy, security, and compliance considerations for AI and knowledge systems

Other requirements

  • Ability to travel up to 10%

Full job description

From BDO USA’s careers site

Job Summary:

Show full descriptionShow less

The Context Engineering Experienced Manager serves as the senior context and knowledge lead for all DT&I product and process development, with primary emphasis on the knowledge, skill, and instruction infrastructure that AI systems and engineers consume. This role leads the design, governance, and continuous improvement of reusable skill libraries, agent-instruction standards (CLAUDE.md and equivalents), retrieval-grounding corpora, and domain-knowledge encodings that make AI-accelerated delivery reliable, repeatable, and audit-ready across the DT&I product portfolio. The role works in close coordination with the AI Engineering Experienced Manager and the Data & Analytics Lead to ensure assurance domain knowledge is captured as high-quality, governed, agent-consumable context. The Context Engineering Experienced Manager partners closely with cross-functional teams to align context-engineering practices, knowledge standards, and product delivery with assurance service delivery objectives, firm policies, and security standards.

Job Duties:

Context Architecture & Knowledge Engineering

  • Designs and maintains the firm’s context infrastructure including hierarchical skill libraries (foundation and archetype layers) and agent-instruction standards (CLAUDE.md and equivalents) with defined inheritance, ownership, and versioning
  • Serves as the principal technical authority on prompt and context patterns, reusable scaffolding, and context-as-code discipline across the DT&I portfolio
  • Defines how assurance domain knowledge is captured, structured, and surfaced to AI systems, and codifies BDO methodology (AKB) into retrievable, governed knowledge
  • Evaluates and integrates emerging context-engineering tools, frameworks, and knowledge platforms to continuously improve grounding quality and developer enablement
  • Designs context evaluation, provenance tracking, and citation discipline to ensure traceable, trustworthy grounded outputs
  • Establishes reusable context architectures, templates, standards, and reference implementations for product teams and engineers
  • Provides technical direction for complex context architecture decisions involving scalability, maintainability, security, cost, and operational support

Retrieval & Grounding Engineering

  • Owns retrieval-corpus curation and grounding quality including source selection, chunking strategy, embeddings, and index design using Azure AI Search and vector stores
  • Designs and tunes retrieval pipelines (hybrid search, re-ranking, metadata filtering) for accuracy, cost, and latency across DT&I products
  • Establishes corpus lifecycle management including freshness, versioning, deduplication, and retirement of stale knowledge
  • Partners with the AI Engineering Manager to integrate grounded context into agent and application runtimes
  • Establishes and implements grounding evaluation frameworks, regression tests, benchmark datasets, and quality metrics for retrieval-augmented features
  • Identifies retrieval and grounding deficiencies and leads corrective actions across affected products
  • Guides cross-functional teams through complex retrieval, indexing, and knowledge-representation challenges

Context Governance & Enablement

  • Governs the skill and context catalog as a managed asset with named ownership, review cadence, and change control consistent with the Advantage SDLC and Architecture Review Board
  • Provides governed context scaffolding and standards for the Advantage Forge citizen-engineer program and product teams
  • Coaches engineers on context-engineering practice and maintains documentation so AI-native development scales across the practice
  • Establishes standards for token economics, context-window management, and prompt efficiency across the portfolio

Risk Management

  • Ensures context infrastructure and grounded knowledge comply with firm security policies, privacy requirements, and regulatory standards (SOC 2, PCAOB AS 2201, QC 1000, ISO 27001)
  • Establishes controls that prevent sensitive or restricted data from entering prompts, corpora, or model context, and maintains auditability and traceability of grounded knowledge
  • Partners with risk and compliance stakeholders to maintain alignment between context infrastructure and firm governance requirements

Performs other duties as assigned

  • Willingly accepts share of less desirable assignments

Supervisory Responsibilities:

  • Acts as a direct supervisor to engineering and development team members, as assigned
  • Acts as a career advisor and mentor to engineering and development team members as assigned

Qualifications, Knowledge, Skills, and Abilities:

Education:

  • High School Diploma/GED, required
  • Bachelor’s degree with a focus in Computer Science, Information Systems, Engineering, Information Technology, preferred

Experience:

  • Eight (8) or more years of experience in software, data, or AI engineering, or related technology fields, required
  • Four (4) or more years of experience building LLM context, retrieval-augmented generation (RAG), or knowledge-management systems, required
  • Three (3) or more years of experience defining reusable engineering assets, developer-enablement tooling, or technical standards, required
  • Experience leading technical teams or directing complex cross-functional initiatives, preferred
  • Experience extracting and codifying domain knowledge into machine-consumable formats, preferred
  • Experience delivering enterprise-scale AI or knowledge solutions in professional services, assurance, or accounting industries, preferred
  • Experience with context governance, prompt management, or AI evaluation frameworks, preferred

License/Certifications:

  • Microsoft Certified: Azure AI Engineer Associate, or equivalent, preferred

Technology:

  • Expert-level knowledge of Microsoft Azure AI services including Azure AI Foundry, Azure OpenAI, and Azure AI Search, required
  • Strong understanding of LLM context windows, prompting, retrieval, and grounding, and how each affects accuracy, cost, and reliability, required
  • Experience with retrieval and vector technologies (Azure AI Search, embeddings, hybrid search, re-ranking), required
  • Extensive knowledge of agent-instruction and skill systems (CLAUDE.md and equivalents) and Markdown-based knowledge structures, required
  • Experience with agentic development tooling (Claude Code or equivalent) and Git-based workflows, preferred
  • Experience with .NET/C# and/or Python for context and evaluation tooling, preferred
  • Experience with AI evaluation and observability tooling, preferred

Knowledge, Skills, & Abilities:

  • Expert-level knowledge of context engineering, retrieval design, and grounding for production LLM systems
  • Proven ability to serve as a hands-on context architect while providing standards, governance, and team enablement
  • Deep knowledge of information architecture and the ability to translate subject-matter expertise into machine-consumable knowledge
  • Familiarity with AI application and agent runtimes and the ability to collaborate with engineering teams on context dependencies
  • Excellent problem-solving skills with a focus on accuracy, reliability, and grounding quality
  • Strong communication skills with the ability to convey technical concepts to non-technical stakeholders and leadership
  • Experience presenting context and AI governance recommendations to governance bodies (e.g., Architecture Review Boards)
  • Strong knowledge of data privacy, security, and compliance considerations for AI and knowledge systems
  • Ability to work across technical teams and business stakeholders in complex, fast-paced enterprise environments
  • Self-directed with the ability to manage multiple priorities and competing deadlines
  • Collaborative mindset with the ability to build relationships across all levels of the organization
  • Ability to travel up to 10%, no relocation required

Individual salaries that are offered to a candidate are determined after consideration of numerous factors including but not limited to the candidate’s qualifications, experience, skills, and geography.

National Range: $150,000 - $180,000

Maryland Range: $150,000 - $180,000

NYC/Long Island/Westchester Range: $150,000 - $180,000

Something wrong with this job? Report it