Data Enginner

• Should have experience in Data and Analytics and overseen end-to-end implementation of data pipelines on cloud-based data platforms.
• Strong programming skills in Python, Pyspark and some combination Java, Scala (good to have)
• Experience writing SQL, Structuring data, and data storage practices.
• Experience in Pyspark for Data Processing and transformation.
• Experience building stream-processing applications (Spark steaming, Apache-Flink, Kafka, etc.)
• Maintaining and developing CI/CD pipelines based on Gitlab.
• You have been involved assembling large, complex structured and unstructured datasets that meet functional/non-functional business requirements.
• Experience of working with cloud data platform and services.
• Conduct code reviews, maintain code quality, and ensure best practices are followed.
• Debug and upgrade existing systems.
• Nice to have some knowledge in Devops.

QUALIFICATIONS

• Bachelor’s degree in computer science or related field
• Experience in Snowflake and Knowledge in transforming data using Data build tool.
• Strong programming skills in Python, Pyspark and some combination Java, Scala (good to have)
• Experience in AWS and API Integration in general with knowledge of data warehousing concepts.

Excellent communication and team collaboration skills