About Us:
As a Senior Data Engineer at Kenility, you’ll join a tight-knit family of creative developers, engineers, and designers who strive to develop and deliver the highest quality products into the market.
Technical Requirements:
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
- Over 4 years of hands-on experience in data engineering, with a strong command of core concepts and best practices.
- Solid knowledge of data modeling and data warehouse design.
- Proven experience building and maintaining ETL processes and orchestrating data pipelines.
- Familiarity with CI/CD practices and software version control workflows.
- 3+ years of experience working with the Databricks ecosystem, including notebooks, workflows, jobs, asset bundles, cluster setup, CLI, Unity Catalog, Delta Sharing, Lakehouse architecture, Delta Tables, and Delta Live Tables.
- Experience working in Azure environments, including Storage Accounts, Azure Active Directory, and Azure Data Factory.
- Proficiency with GitHub SaaS and GitHub Actions.
- Strong programming skills in Python, PySpark, and SQL.
- Experience developing and maintaining reusable Python libraries.
- Minimum Upper Intermediate English (B2) or Proficient (C1).
Tasks and Responsibilities:
- Lead the end-to-end delivery of data pipeline solutions across every stage of the software development lifecycle.
- Contribute to both internal and client-facing applications, while also supporting process optimization initiatives.
- Design and structure complex systems and operational processes with a scalable mindset.
- Address highly ambiguous technical challenges with effective and well-reasoned solutions.
- Define and support robust solution architectures for data-driven platforms.
- Promote ongoing system enhancements focused on simplification, performance, reliability, and quality.
- Build and apply efficient automated testing approaches for data pipeline solutions.
- Design monitoring strategies that improve pipeline visibility and operational impact.
- Deliver projects with meaningful business and technical value.
- Foster cross-team collaboration with other programs and engineering groups.
- Encourage engineering excellence through code reviews and design review practices.
- Support team growth by mentoring others and contributing to technical evaluations.
- Take part in support rotations as needed.
Soft Skills:
- Responsibility
- Proactivity
- Flexibility
- Great communication skills