Responsibilities:
* As a Big Data Engineer, you'll be responsible for designing and building high performance, and scalable data platforms
* You should be a quick learner to understand user needs and guide them towards most suitable path
* You will be required to effectively collaborate with product teams from business group and understand the user needs, requirements, roadmap and vision of different tooling
* You will ride high on creating automated tools that will cater to multiple usecases and speed up the enablement process
* You will work with a variety of teams and individuals, including platform engineers, usecase owners, analytical users to understand their needs and come up with innovative solutions
* You will follow the Amex-way of building engineering products that leads to engineering excellence by adopting DevOps principals
Qualifications:
* Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree would be a plus
* Great to have :- GCP professional certification - Data Engineer/Cloud Architect will be preferable
* 3+ years of software development experience with hands-on expertise in coding in Java/Python/Scala etc
* 2+ years of experience in setting up ETL jobs on low-code UI
* 2+ years of experience in using GCP cloud tools such as BigQuery, Data Proc, Data Flow, Cloud SQL, Pub Sub etc.
* Strong SQL, RDBMS skills. Expert in writing complex SQLs for different databases such as Hive , MySQL , Postgres etc. Proficiency in working with NoSQL databases as well
* Experience working with Spark , Big Data and Hive
* Experience in Git Management including PR reviews, maintaining code hygiene
* In-depth understanding of data warehousing concepts, dimensional modelling, and data integration techniques
* Experience in optimising high volume data processing jobs.
* Hands-on experience on CICD pipelines, Automated test frameworks, DevOps and source code management will be a big plus (XLR, Jenkins, Git, Stash, Jira, Confluence, Splunk etc.)
* Experience working in Agile/SAFe framework for development
* Excellent communication and analytical skills
* Excellent team-player with ability to work with global team
We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include: