3 of 3 Apache Spark Jobs in West Yorkshire

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

Experience building and deploying cloud data platforms Infrastructure-as-Code and CI/CD practices (GitHub, CodeBuild, pipelines) Strong coding experience in Python (Pandas), Apache Spark, and/or Apache Iceberg Expertise in SQL and advanced data manipulation and analysis Experience with data warehouse design and data ...

transformation through to modelling and optimisation — working closely with analytics, reporting, and business stakeholders. Key Responsibilities: Design, build, and maintain data pipelines using Databricks (Spark/PySpark/SQL). Support the migration of on-premise data sources to a cloud-based Databricks platform. Develop and optimise data models … sprint planning, delivery, and issue tracking using Jira. Help establish and promote data engineering standards, governance, and documentation. Tech Stack & Tools: Core Technologies: Databricks Apache Spark (PySpark/Spark SQL) Delta Lake SQL Focus Areas Databricks platform development Cloud data migration Data modelling & analytics-ready datasets Modern ...