Software Engineer jobs

Backend Engineer _ AI Gateway- Bilingual (Korean/ English)

Woongjin, IncPlano, TXContract3+ years experience

Pay not listed

Looks real. 2 things to check before you apply.

On Woongjin, Inc’s own careers site (SmartRecruiters), checked open today.

  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 89 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design and operate a secure, high-performance gateway routing and governing traffic between enterprise clients and AI service providers.
  • Build and test production REST and streaming APIs, including handling concurrent connections and large real-time inference payloads.
  • Deploy and scale gateway services on Kubernetes and maintain their cloud infrastructure and CI/CD pipelines.
  • Integrate security gateways, identity and SSO systems, AI/LLM workflows, and asynchronous messaging.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of hands-on async Python and network programming experience
  • Experience with streaming and large-payload handling, including chunked transfer, bidirectional streaming, and back-pressure
  • 3+ years designing, developing, and testing production-grade FastAPI REST and streaming APIs
  • Docker and Kubernetes deployment experience, including scaling and rolling updates
  • Production use of Redis Streams, RabbitMQ, or Kafka for asynchronous messaging and event-driven design
  • Experience with cloud networking and security, including load balancing, TLS termination, reverse proxies, mTLS, and certificate lifecycle automation
  • Enterprise security gateway integration with CASB, DLP, WSS, or similar platforms, including centralized logging and audit trails
  • Experience configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO, Conditional Access, and SCIM provisioning
  • Experience building prompt-engineering workflows, PII anonymisation, and monitoring Azure OpenAI or comparable usage, rate limits, and cost
  • Experience with API gateway operations, including webhook and REST integrations, circuit breakers, rate limiting, retries, and health checks
  • End-to-end monitoring, cost optimisation, and 24/7 incident response against SLA/SLO targets

Skills

  • Working familiarity with HTTP/2, HTTP/3, gRPC, and custom protocol parsers
  • Advanced PostgreSQL query tuning, partitioning, and PgBouncer pooling, plus HashiCorp Vault for secrets and encryption
  • Terraform modules for multi-environment infrastructure and CI/CD pipelines with image scanning and canary or blue-green deployments
  • Bilingual Korean/English; Korean is highly preferred (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Woongjin, Inc’s careers site

Company Description

For More Open Positions Visit us at:

http://recruiting.woongjininc.com/

Our Mission

WOONGJIN INC. is a rapidly growing team who provides a range of unique, exceptional, and enhanced services to our clients. We have a strong moral code that includes the service of goodness without expectations of reward. We are motivated by the sense of responsibility and servant leadership.

Job Description

Show full descriptionShow less

We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale.

What we are looking for

  • Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
  • Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
  • Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
  • FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
  • Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
  • Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
  • PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
  • Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
  • IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Qualifications

  • Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
  • IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
  • AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
  • API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
  • Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).
  • Bilingual Korean Highly Prefer

Additional Information

*****NO C2C******

All your information will be kept confidential according to EEO guidelines.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Lead AI Engineer

Perficient · Dallas, TX

$134k–$171k/yrHybrid

StrongChecked open todayPosted 6 days ago

Applied AI Engineer II

Tanium · Addison, TX +1 place

$154k–$236k/yrFull-timeHybrid

StrongChecked open todayPosted 16 days ago

Software Engineer II

Octane · Irving, TX +1 place

$105k–$135k/yr

StrongChecked open todayPosted 9 days ago

Senior Software Engineer

SquareTrade · Dallas, TX

$140k–$170k/yrFull-timeHybrid

StrongChecked open todayPosted 11 days ago

See more like this