Job Description
RAKBANK is hiring a data engineer who can be part of its data analytics team to create scalable, robust, and secure data solutions for analytical purposes, reporting, compliance, operations, and AI use cases. The job entails practical experience in SQL, Python, PySpark, Spark SQL, and Databricks Lakehouse. Being a data engineer, the candidate will be building different data pipelines through their expertise in SQL, Python, PySpark, Spark SQL, and Databricks Lakehouse. The candidate’s responsibilities will entail the development of data ingestion, transformation, and enrichment capabilities in batch, stream, and near real-time pipelines.
Experience: 3–7 Years
Qualification: Bachelor’s Degree/Master’s Degree (Preferred)
Apply: Click Here
Responsibilities
- Construct, design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
- Develop and optimize data ingestion, transformation, and enrichment pipelines for batch, streaming, and real-time usage scenarios.
- Create datasets and models to support BI, analytics, regulation, and machine learning use cases.
- Maintain data quality, data monitoring, data reconciliation, and bug fixing in the production system.
- Work closely with architects, analysts, data governance specialists, and business teams on cloud migrations, Azure DevOps, CI/CD, and Agile delivery.
Qualifications
- Bachelor’s degree and 3-7 years of experience in data engineering, analytics engineering, software engineering, or similar fields.
- Proven experience in working with SQL, Python, PySpark, and Spark SQL.
- Experience in Databricks, Delta Lake, Databricks workflows, and Databricks SQL.
- Familiarity with Azure Data Factory, dbt, CDC, and streaming platforms such as Kafka and Confluent.
- Experience in dimensional modeling, medallion architecture, data quality and governance, Git, CI/CD, and Agile approach.
Preferred Qualifications
- Work experience in a banking or financial services environment.
- Experience with Azure Data Factory and current cloud-based data engineering platforms.
- Experience working with dbt and CDC pipelines for data transformation.
- Experience working with streaming data technology like Apache Kafka and Confluent.
- Certification and hands-on experience with Azure & Databricks to improve the performance of the data platform.