Work with Product Managers/Owners to understand how products can be used and should be implemented to solve client problems. 

·      Work with Project Managers to understand client requirements and brainstorm on solutioning it, implement the assets/products as applicable. 

·      Build large-scale batch and real-time data pipelines with data processing frameworks on Microsoft Azure, Google Cloud Platform (GCP), or Amazon Web Services (AWS) 

·      Understanding of Vertex AI configuration/requirements to be able to handle large data (several GB to TB) 

·      Develop data pipelines using Python, PySpark, SQL  

·      Understanding Data science techniques is an added advantage. 

·      Deploy data pipelines into production  

·      Consistently strive to acquire new skills on Cloud, Big Data technologies  

·      Support and coach your team on best coding practices, development tools, and pathfinding and surveys for technologies 

Qualifications and Experience

Required:

·       A bachelor's degree in computer science, Data Engineering, Applied Mathematics, or similar Quantitative Field with a minimum 3+ yrs. of experience as data engineer   

·       3+ years of experience with at least one of the following cloud platforms: Microsoft Azure, Google Cloud Platform (GCP), Amazon Web Services (AWS)  

·       Azure, GCP, and / or AWS Certification preferred  

·       3+ years of experience in SQL, data transformations, statistical analysis, and troubleshooting across more than one Database Platform (Big query, MySQL, Snowflake, PostgreSQL etc.)  

·       3+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines  

·       Proven skills in various programming and database languages i.e., Python, PySpark, SQL  

·       Experience working with either a Map Reduce or an MPP system on any size/scale preferred  

·       Familiarity with consumer related data and a general interest in the retail, consumer products manufacturing, automotive, transportation, or hospitality sectors   

·       A desire to take initiative and continuously provide feedback on improving the products you are responsible for  

·       A general interest in relevant emerging technologies and a constant thirst to further your own technical abilities  

·       Experience working in an Agile development environment  

·       The ability to work well independently and as a team player  

·       Excellent conversational and written communication skills  

·       Experience with BI/analytics tools, such as Tableau, PowerBI, or similar tools