Senior data engineer
Sunbury-On-Thames, London, United Kingdom
Hybrid / WFH Options
Hybrid / WFH Options
BP Energy
reliable ETL/ELT data pipelines using Python, PySpark, and SQL. Develop and manage data workflows and orchestration using tools such as Airflow or similar. Optimize data processes for performance, scalability, and cost-efficiency, particularly in cloud environments. Collaborate with data scientists, analysts, and product teams to understand data needs and deliver high-quality data sets. Implement and uphold … years of experience in data engineering or a related field. Proficiency in Python and PySpark for data processing and automation. Strong command of SQL for data querying, transformation, and performance tuning. Deep experience with cloud platforms , preferably AWS (e.g., S3, Glue, Redshift, Athena, EMR, Lambda). Experience with Azure or GCP is a plus. Experience building and managing data More ❯
Employment Type: Work From Home
Posted: