Data Engineer jobs

Data Engineer-Integration Specialist

City of PhiladelphiaPhiladelphia, PAFull-timeHybridBachelor's degreePosted 16 days ago

$96k/yr listed by the employer

Strong: looks real and checked open today.

On City of Philadelphia’s own careers site (SmartRecruiters).

  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Work with business partners to understand how their data is produced, stored, and updated, then design improvements to integrations and public data access.
  • Build and refine data pipelines connecting systems of record, centralized databases, and SaaS environments; improve platform components, governance, standardization, enrichment, and data quality.
  • Develop and support enterprise integration and open data systems, including DataBridge, Databridge-Airflow, and AIS.
  • Write technical documentation and communicate technical details to data stewards and non-technical stakeholders.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Demonstrated experience in data engineering or a similar role focused on data management, integration, ETL, or ELT
  • Experience working with a modern data engineering tech stack
  • Experience with cloud services
  • Previous work in a public sector or large organization setting (preferred)
  • Experience working with spatial datasets (preferred)

Education

  • Bachelor’s degree in Computer Science, Data Science, Information Systems, Geography/GIS, or a related field; equivalent work experience may be considered

Skills

  • Proven experience with Python, SQL, and database management
  • Familiarity with custom ETL/CI/CD tool development and ability to learn and adapt to new technologies
  • Proficiency in Python
  • Strong SQL skills and database experience
  • Familiarity with Docker, Bash, and minimal Linux server administration
  • Understanding of Git/GitHub for version control and CI/CD pipelines
  • Experience with or ability to learn Airflow, DBT, Terraform, Kubernetes, and MuleSoft
  • Familiarity with modern Python development practices, such as type annotations, data validation, and automated testing (preferred)
  • Postgres experience (preferred)
  • AWS experience (preferred)

Other requirements

  • City of Philadelphia resident within six months of hire

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Comprehensive health coverage for employees and eligible dependents
Retirement plan
Generous retirement savings options
Paid time off
Paid vacation, sick leave, and holidays
Learning & tuition
25% tuition discount program for City employees, and sometimes spouses and dependents, through area colleges and universities
Wellness & mental health
Wellness program eligibility for a discounted medical plan
Other
Employer qualifies for the Public Service Loan Forgiveness Program

Full job description

From City of Philadelphia’s careers site

Company Description

With a workforce of over 25,000 people, and opportunities in more than 1,000 different job categories, the City of Philadelphia is the fifth largest city in the United States and one of the largest employers in Southeastern Pennsylvania. As an employer, the City of Philadelphia operates through the guiding principles of service, integrity, respect, accountability, collaboration, diversity and inclusion. Through these principles, we strive to effectively deliver services, to resolve the challenges facing our city, and to make Philadelphia a place where all our residents have the opportunity to reach their potential.

Show full descriptionShow less

The Office of Innovation & Technology (OIT) is the central IT agency for the City of Philadelphia headed by the Chief Information Officer (CIO). OIT oversees all major information and communications technology initiatives for the City of Philadelphia - increasing the effectiveness of the information technology infrastructure, where the services provided are advanced, optimized, and responsive to the needs of the City of Philadelphia’s businesses, residents, and visitors. OIT responsibilities include: identifying the most effective approach for implementing new information technology directions throughout city government; improving the value of the city’s technology assets and the return on the city’s technology investments; ensuring data security continuity; planning for continuing operations in the event of disruption of information technology or communications services; and supporting accountable, efficient and effective government across every city department, board, commission and agency.

Job Description

Data Engineering at the City is a unique opportunity for meaningful, exciting work and professional development using state-of-the art technologies and software development best practices. This is a position on a diverse team of engineers, analysts, and GIS specialists, contributing to developing, maintaining, and optimizing our data pipelines and integration strategies, assisting departments and agencies in innovating, and enhancing the City’s service to its residents.

The data engineer/integration specialist will develop an intimate understanding of the City’s diverse data and contribute to improving the City’s data engineering infrastructure, pipelines, models, and integrations. The team uses a blend of open source, custom developed and off-the-shelf tools, including Python, Bash, SQL, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, Github actions, MuleSoft as an iPaaS and SAS API providers like ArcGIS Online and CARTO.

Some prominent services the team is responsible for include DataBridge, OIT’s enterprise data warehouse, AIS, the City’s custom address information systems which supports public address search and internal geocoding, and Databridge-Airflow, a custom workflow generator and orchestrator for departmental integrations (https://metadata.phila.gov/) and open data publishing (https://opendataphilly.org/). Some examples of OIT’s commitment to serving the public through the effective and innovative integration of City open data include:

https://Atlas.phila.gov

https://property.phila.gov

https://Openmaps.phila.gov

https://streetsmartphl.phila.gov/

www.phila.gov/solarmap

www.phila.gov/stressmap

We are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work and data-driven decision-making, we encourage you to apply.

Essential Functions

  • Working with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements to optimize enterprise integrations and public data accessibility.
  • Design and develop new and expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments, improving data platform components, data governance, master data management, data standardization, enrichment and quality assurance.
  • Play a key role in enterprise integration and open data initiatives, developing and supporting critical systems like the City’s DataBridge, Databridge-Airflow and AIS.
  • Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.

Qualifications

  • Bachelor’s degree in Computer Science, Data Science, Information Systems, Geography/GIS, or a related field. Equivalent work experience may be considered.
  • Demonstrated experience in data engineering or a similar role, with a focus on data management/integration/ETL/ELT.
  • Proven track record with Python, SQL, and database management.
  • Experience with working with modern data engineering tech stack.
  • Familiarity with development of custom ETL/CI/CD tools and the ability to learn and adapt to new technologies.

Previous work in a public sector or large organization setting is a plus.

Competencies:

  • Clear and concise writing and communication skills.
  • Creative problem-solving and critical thinking.
  • Ability to work with data from diverse domains.
  • Efficient time management and the ability to manage multiple workflows simultaneously.
  • Ability to seek innovative opportunities and continuous improvement.
  • Curiosity and willingness to learn new tools, packages, and best practices.
  • Eagerness to participate in knowledge sharing and contribute to team discussions on coding standards.

Knowledge and Skills:

  • Proficient in Python
  • Familiarity with modern Python development practices (e.g., type annotations, data validation, automated testing) a plus
  • Strong SQL skills and experience with databases (Postgres preferred).
  • Familiarity with Docker, bash and minimal Linux server administration.
  • Experience with cloud services (AWS preferred).
  • Understanding of Git/GitHub for version control and CI/CD pipelines.
  • Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, Mulesoft.
  • Experience working with spatial datasets a plus.
  • Experience using command line interfaces.

Abilities:

  • To reason about, model and manipulate complex datasets.
  • To maintain clean and secure data environments.
  • To work effectively in a hybrid (on-premises and cloud) environment.
  • To communicate complex technical concepts in understandable terms.

To thoughtfully evaluate new data engineering tools and practices within a public service context.

Additional Information

Salary cannot exceed $95,605

We’re interested in hiring the best possible candidate for the role. We recognize that experience, education, and qualifications can be attained in a variety of ways and that many skillsets are transferable. If you feel you’re a good fit, please don’t hesitate to apply.

Please include:

  • Resume
  • A cover letter

Please note: Applications will not be considered without a cover letter.

Did you know?

● We are a Public Service Loan Forgiveness Program qualified employer : 25% tuition discount program for City employees (and sometimes spouses and dependents as well) in partnership with area colleges and universities

● We offer Comprehensive health coverage for employees and their eligible dependents

● Our wellness program offers eligibility into the discounted medical plan

● Employees receive paid vacation, sick leave, and holidays

● Generous retirement savings options are available

*The successful candidate must be a city of Philadelphia resident within six months of hire

Effective May 22, 2023, vaccinations are no longer required for new employees that work in non-medical, non-emergency or patient facing positions with the City of Philadelphia. As a result, only employees in positions providing services that are patient-facing medical care (ex: Nurses, doctors, emergency medical personnel), must be fully vaccinated.

http://www.phila.gov/humanrelations/Pages/default.aspx

The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at 215-686-4670 or send an email to faqpchr @phila.gov. For more information, go to: Human Relations Website:

Something wrong with this job? Report it

Similar jobs nearby

Data Engineer

Perpay - Career's Page · Philadelphia, PA

Pay not listedFull-timeOn-site

Looks good2 to checkChecked open todayPosted 6 months ago

Principal Data Engineer

Medical Guardian · Philadelphia, PA

Full-time

Looks goodPay not listedLast seen open yesterdayPosted 9 days ago

Snowflake Architect

Bright Vision Technologies · Philadelphia, PA

ContractOn-site

Looks goodPay not listedChecked open todayPosted 8 days ago

See more like this