Data Engineer

About the Role:


We are seeking a talented and passionate Data Engineer to play a key role in building and maintaining our cutting-edge data platform. You will be responsible for designing, developing and deploying data pipelines using industry-leading technologies such as Databricks, Snowflake, DBT and Airflow. You will also work closely with our data analysts and other stakeholders to ensure our data is accurate, reliable and accessible.


Key Responsibilities:


  • Design, develop, and deploy data pipelines using Databricks, Snowflake, DBT and Airflow.
  • Develop and implement data quality processes.
  • Migrate existing data pipelines to Databricks.
  • Manage and maintain data infrastructure on AWS.
  • Work closely with data analysts and other stakeholders to understand data needs and requirements.
  • Develop and document data models.
  • Write and maintain Python code.
  • Stay up-to-date on the latest data engineering technologies.


Qualifications:


  • Bachelor's degree or higher in Computer Science, Engineering or a related field.
  • 3+ years of hands-on experience as a Data Engineer or in a similar role.
  • Strong experience with Databricks, including Delta Lake and Spark.
  • Expertise in data warehousing and ETL processes, with proficiency in Snowflake and DBT.
  • Proven ability to orchestrate workflows using Airflow. Practical knowledge of AWS Cloud services, including EC2, S3 and IAM.
  • Familiarity with infrastructure as code (IaC) principles and Terraform.
  • Proficiency in Python, SQL, and other relevant scripting languages.
  • Excellent communication and collaboration skills.
  • Strong analytical and problem-solving skills.
تاريخ النشر: ٢٠ أكتوبر ٢٠٢٤
الناشر: LinkedIn
تاريخ النشر: ٢٠ أكتوبر ٢٠٢٤
الناشر: LinkedIn