Data Engineer jobs

Senior Data Engineer — Retrieval & RAG Platform

SolvdRemote · US, PolandFull-time4+ years experiencePosted 9 days ago

Pay not listed

Looks real. 1 thing to check before you apply.

On Solvd’s own careers site (Ashby), checked open today.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

What you’ll do

  • Set up Bedrock Knowledge Bases and an OpenSearch Serverless vector collection, then tune hybrid retrieval and metadata filters against an evaluation suite.
  • Build a versioned, authenticated retrieval API with rate limits, usage metrics, structured errors, and citation data; enforce caller entitlements at query time.
  • Provide a retrieve-and-generate endpoint and build a dashboard for retrieval quality, permissions, freshness, API performance, and OpenSearch capacity.
  • Support the contact center pilot by capturing retrieval misses, tuning the system, and rerunning evaluations before changes ship.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • AWS Certified Generative AI Developer Professional or AWS Certified Machine Learning Engineer Associate (preferred)

Experience

  • 4+ years as a software or ML engineer
  • At least one RAG or enterprise search system delivered to production and measured with an evaluation suite
  • Experience shipping Lambda-based APIs behind API Gateway, including authentication, versioning, and throttling
  • CI for deployment into a client-owned account
  • Experience building operational dashboards in CloudWatch or an equivalent tool
  • Experience with RAG evaluation frameworks and metrics, including faithfulness, context precision and recall, and citation accuracy (preferred)
  • Experience integrating with a contact center Agent Assist product as an API provider (preferred)

Skills

  • Hands-on experience with Amazon Bedrock Knowledge Bases, Retrieve and RetrieveAndGenerate APIs, and embedding models
  • Experience with Amazon OpenSearch Serverless vector search, including hybrid queries and metadata filters
  • Python
  • Infrastructure as code with Terraform or AWS CDK
  • Practical understanding of chunking, embedding model selection, reranking, and relevance, latency, and cost trade-offs
  • Familiarity with Bedrock Guardrails and permission-aware retrieval patterns over Microsoft 365 content (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Solvd’s careers site

Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.

Show full descriptionShow less

Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.

We are looking for a Senior / Staff Data Engineer to build what the Agent Assist provider calls: the Bedrock Knowledge Base configuration, the OpenSearch Serverless collection, the versioned retrieval API, and the quality dashboard. You’ll own the retrieval workstream end to end, paired with the ingestion engineer, with technical direction from the Solution Architect.

This role carries the most technical risk in the engagement — entitlement filtering is a severity-one commitment. The mission: ship a retrieval API that returns the right passages, with citations, only to callers entitled to see them, at a latency and cost the client accepts, and that the client can version and operate after week 10.

WHAT YOU’LL DO

  • Stand up the Bedrock Knowledge Base and OpenSearch Serverless vector collection in the client’s account from infrastructure code, with the embedding model, chunking strategy, and metadata fields the architect specified.
  • Implement hybrid retrieval — vector plus keyword — with metadata filtering by taxonomy, source, status, and review date; tune top-k, score thresholds, and reranking against the golden question suite.
  • Build the retrieval API on API Gateway and Lambda per the Integration Blueprint — versioned paths, authentication for the Agent Assist provider, per-client rate limits and usage metrics, structured error responses, and a citation payload with source URL, title, section, and last modified date.
  • Enforce entitlement at query time by filtering on permission metadata the ingestion pipeline captures — no restricted passage is ever returned to an unentitled caller.
  • Provide the Bedrock retrieve-and-generate reference endpoint used for pilot validation in weeks 7–9.
  • Build the quality dashboard — relevance, grounding, and citation scores trended per run; permission test results; freshness lag per source; API latency and error rate; OpenSearch capacity.
  • Support the contact center pilot in weeks 7–9 — capture retrieval misses, tune, and re-run the suite before each change ships.
  • Write the retrieval and API runbooks including model change, re-embedding, and index rebuild procedures with cost implications.
  • Pair with client platform owners in weeks 9–10 and hand over on the transition readiness checklist.

REQUIRED SKILLS & EXPERIENCE

  • 4+ years as a software or ML engineer, with at least one RAG or enterprise search system delivered to production and measured with an evaluation suite — not just demos.
  • Hands-on with Amazon Bedrock — Knowledge Bases, Retrieve and RetrieveAndGenerate APIs, embedding models — and Amazon OpenSearch Serverless vector search including hybrid queries and metadata filters.
  • Python, with experience shipping Lambda-based APIs behind API Gateway including auth, versioning, and throttling.
  • Infrastructure-as-code with Terraform or AWS CDK and CI for deployment into a client-owned account.
  • Practical understanding of chunking, embedding model selection, reranking, and the trade-offs between relevance, latency, and cost.
  • Experience building operational dashboards in CloudWatch or an equivalent tool.

PREFERRED QUALIFICATIONS

  • AWS Certified Generative AI Developer Professional or AWS Certified Machine Learning Engineer Associate.
  • Experience with RAG evaluation frameworks and metrics — faithfulness, context precision and recall, citation accuracy.
  • Experience integrating with a contact center Agent Assist product as an API provider.
  • Familiarity with Bedrock Guardrails and permission-aware retrieval patterns over Microsoft 365 content.

When you join Solvd, you'll…

  • Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.
  • Be part of a global team with equal opportunities for collaboration across continents and cultures.
  • Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.

Ready to make an impact?

If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.

Solvd is an equal opportunity employer.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Senior Data Engineer

Machinify · Remote · US only

$180k–$220k/yr

StrongChecked open todayPosted 18 days ago

Senior Data Engineer

ReSource Pro · Remote · US only

$97k–$164k/yrFull-time

StrongChecked open todayPosted 19 days ago

Senior Data Engineers

Movement Labs · Remote · US only

$120k–$150k/yrFull-time

StrongChecked open todayPosted 8 days ago

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 8 days ago

See more like this