Design and document data architectures and integrate them with existing systems.
Develop, optimize, and support data pipelines and database designs for performance, scalability, and security.
Collaborate with architects, engineers, product, and business teams to design data-tier solutions aligned with business needs.
Apply enterprise standards and document data processing requirements and data placement.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
Data engineering and development experience or experience in a related job
Experience with SQL and Python or another programming language such as Java
Experience designing and developing with one or more database management systems, such as HBase, Hive, GCP tools, NoSQL, BigTable, BigQuery, Spanner, IMS, DB2 z/OS, Oracle, MS SQL Server, PostgreSQL,或
Experience with NoSQL databases such as MongoDB, Couchbase, Cassandra, and Redis
Experience with data modeling tools such as ErStudio or ErWin
Experience in Big Data performance tuning
Experience with distributed (multi-tiered) systems, algorithms, and application development
Experience developing and supporting databases for online transaction processing and/or online analytical processing systems
Experience with software delivery methodologies such as Agile, Scrum, Agile XP, Test-Driven Development, or Waterfall
Experience designing performance-oriented infrastructure, such as network-attached or local-attached storage integration
Education
Bachelor's degree in Computer Science, Computer Engineering, or comparable experience
Advanced degree (preferred)
Skills
Knowledge of Big Data and NoSQL design and development across data stores such as document, column-family, and graph databases
Knowledge of database management systems and their ecosystems, including storage formats, access algorithms, data management, administration, maintenance, replication, high availability, and encrypt
Knowledge of distributed (multi-tiered) systems, algorithms, and relational and non-relational databases
Full job description
From American Express’ careers site
Joining Amex Tech means discovering and shaping your contribution to something big. Here, you can work alongside talented tech teams and build a unique career with the Powerful Backing of American Express. With a range of opportunities to work with the latest technologies, and a commitment to back the broader engineering community through open source, our mission is to power your success. Because Amex Tech is powered by our technology, our culture, and our colleagues.
Show full descriptionShow less
The Technology organization enables and accelerates the company’s growth strategies, delivering global capabilities and services in support of Amex’s customers and colleagues, while maintaining 24/7 servicing and availability to ensure an uninterrupted, high-quality customer experience. Technology provides the foundation for everything we do in the company while driving differentiation through building and leveraging innovative technology and data insights.
Data Engineer leads the design and optimization of data architectures and pipelines, collaborates with cross-functional teams to ensure alignment with business needs and enterprise standards, fosters innovation and best practices in data infrastructure, and executes Big Data management strategies through partitioning and indexing solutions.
Advances the design and documentation of data architectures, ensuring seamless integration with existing systems and alignment with business requirements
Develops, optimizes, and supports intricate data pipelines and database designs to meet advanced performance, scalability, and security needs
Collaborates with delivery architects, engineers, and business teams to design optimal data tier solutions and support Agile development practices
Ensures adherence to enterprise standards, guidelines, and policies, documenting processing requirements to maintain optimal data operations
Identifies and adopts innovative technologies to enhance data infrastructure, maintaining detailed information about stored data and following data placement procedures
Fosters a collaborative environment and contributes to the development of best practices and consistent development practices
Executes Big Data management strategies by developing and optimizing partioning and indexing solutions
Collaborates and co-creates effectively with teams in product and the business to align technology initiatives with business objectives
Knowledge of Big Data / NoSQL design and development with variety of data stores (document, column family, graph, etc.)
Knowledge of database management system products and ecosystem - e.g., storage formats, access algorithms, data management processes, administration, data maintenance, replication, high availability, encryption, etc
Knowledge of distributed (multi-tiered) systems, algorithms, and relational & non-relational databases
Data engineering and development experience or a related job
Experience in SQL and Python (or any other programming language like Java)
Experience in design and development across one or more database management systems (e.g., HBase, Hive, GCP tools, NoSQL, BigTable, BigQuery, Spanner, IMS, DB2 zOS, Oracle, MS SQL Server, PostgreSQL, Netezza (PDA/DB2AA) as appropriate
Experience in NoSQL databases (e.g., MongoDB, Couchbase, Cassandra, and Redis)
Experience in data modeling tools (e.g., ErStudio, ErWin)
Experience in performance tuning in the Big Data space
Experience in distributed (multi-tiered) systems, algorithms, and application development
Experience in database development and support of online transaction processing and/or online analytical processing systems
Experience in infrastructure design for performance (e.g., network-attached or local-attached storage integration - such as Nutanix)
Depending on factors such as business unit requirements, the nature of the position, cost and applicable laws, American Express may provide visa sponsorship for certain positions.