About Us:
As an ETL Developer at Kenility, you’ll join a tight-knit family of creative developers, engineers, and designers who strive to develop and deliver the highest quality products into the market.
Technical Requirements:
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
- At least three years of experience working as an ETL Developer, with hands-on use of AWS services including Glue, Redshift, and S3.
- Proficiency in SQL and Python, with a strong preference for experience using PySpark.
- Solid background in building batch ETL pipelines using code-based solutions rather than low-code platforms.
- Familiarity with data warehousing concepts, including operational data stores (ODS), dimensional modeling, and slowly changing dimensions.
- Skilled in identifying and resolving pipeline issues, as well as optimizing for performance and cost.
- Ability to communicate complex technical concepts clearly to non-technical audiences.
- Strong analytical thinking and problem-solving capabilities.
- Highly organized with strong attention to detail.
- Minimum Upper Intermediate English (B2) or Proficient (C1).
Tasks and Responsibilities:
- Design and automate ETL workflows using AWS Glue (Python/PySpark) to process and load data into Redshift and S3.
- Monitor data pipelines to ensure data integrity and compliance with service-level agreements.
- Optimize S3 usage through partitioning strategies and lifecycle policies to manage data lake storage efficiently.
- Collaborate on designing analytical data models, including star schemas and dimensional models.
- Create and maintain clear documentation of data flows, entity-relationship diagrams, and lineage for governance purposes.
- Conduct data profiling and validation to detect and address issues early.
- Support BI teams by troubleshooting discrepancies and enhancing pipeline performance.
- Perform ad hoc data analysis and exploratory investigations as required.
- Assist in documenting system specifications, testing protocols, and support materials.
- Participate in code reviews and help refine development practices.
- Provide production support and help resolve data-related incidents.
Soft Skills:
- Responsibility
- Proactivity
- Flexibility
- Great communication skills
