Roles and Responsibility
Hands on with ability to work closely with Product Management, Engineering leadership, Development and DataOPS teams to successfully deliver workable solutions.
Responsibilities Include
? Work with Product Management to define solutions based on requirements.
? Participate in release/sprint planning.
? Contribute/Participate in agile engineering processes and ensure compliance
? Effective interaction with the domain experts on engineering related issues.
? Work with team members to troubleshoot data issues and contribute in the area of data validation.
? Create and maintain Alerts and Dashboards which will be used for monitoring the data pipelines.
? Work with different forms of data
? Generate Data QC stats pre and Post ingestion.
? Identify automation opportunities which can reduce the repetitive work.
Technical Skills Required:
? Experienced Data Engineer - with 3-7 years of professional experience
? Good at troubleshooting data issues.
? Proficiency in Database concepts, Strong knowledge of SQL. Experience with postgres databases will be an added advantage.
? AWS/GCP service provider experience
? Is well acquainted with the industry security best practices.
? Bachelor in Computer Science / Engineering, or demonstrable industry experience
? Should be well versed with Configuration management, knowing Git and its commands will be an added advantage.
? Hands on experience in any ETL tool
? Should have worked on monitoring Data Pipelines.
Following Experience is not required but will help you to stand out
? Python experience, preferably both 2.7 and 3.x
? Has knowledge of APIs
? Experience with cloud infrastructure automation such as cloud formation or similar
? CI/CD experience
? Linux commands.
? Shell Scripts
? Pandas, PY Spark.
Soft Skills Required
? Ability to motivate and mentor junior team members.
? Excellent Verbal and Written communication skills.
? Good Interpersonal skills.
? Demonstrate Ownership and commitment.
