4 of 4 Apache Spark Jobs in the Midlands

Ecosystem (Preferred/Good to Have) Azure data services experience in one or more: Azure Synapse Analytics/Dedicated SQL Pools Azure Databricks/Spark ADLS Gen2, Azure SQL DB, Managed Instance Event Hub/Kafka, Stream Analytics (if real-time involved) Monitoring & observability: Azure Monitor, Log Analytics, Application ...

engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards, analytics, ML or LLM concepts is beneficial, but not essential. ...

Ensure high standards of data quality, governance, security and accessibility across data platforms Develop scalable data transformation logic using Python, SQL and Spark-based frameworks Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency Work closely with data scientists, analysts and engineering teams to support advanced … data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building and maintaining data pipelines, data lakes and data warehouses Strong understanding of data modelling, metadata management ...

Senior Data Engineer- Spark & Databricks Optimisation- Up to £55K North Lincolnshire/Hybrid (2 days onsite) Major performance, optimisation & AI-driven projects Are you a Data Engineer who loves solving performance challenges, optimising compute, and getting stuck into large-scale data environments? This one is very much … understands what "good" looks like across modern data platforms. Someone who knows Python and SQL inside out, and who can improve pipelines, optimise Spark workloads, and make smart architectural decisions that genuinely impact runtime and cost. Tech-wise, you'll have hands-on experience with a modern cloud ecosystem. ...