6 of 6 Apache Spark Jobs in the Midlands

Ecosystem (Preferred/Good to Have) Azure data services experience in one or more: Azure Synapse Analytics/Dedicated SQL Pools Azure Databricks/Spark ADLS Gen2, Azure SQL DB, Managed Instance Event Hub/Kafka, Stream Analytics (if real-time involved) Monitoring & observability: Azure Monitor, Log Analytics, Application ...

engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards, analytics, ML or LLM concepts is beneficial, but not essential. ...

didn't hate it. A background in behavioural science, organisational psychology, or psychometrics — the company works heavily with survey data and measurement validation. Spark, Databricks, or distributed computing experience. Published research or an academic background in statistics, ML, or a quantitative field. What's on Offer Salary ...

Ensure high standards of data quality, governance, security and accessibility across data platforms Develop scalable data transformation logic using Python, SQL and Spark-based frameworks Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency Work closely with data scientists, analysts and engineering teams to support advanced … data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building and maintaining data pipelines, data lakes and data warehouses Strong understanding of data modelling, metadata management ...

Gen2). Optimize data storage formats (Delta, Parquet, Avro, ORC) for performance and cost. Maintain and optimize Synapse SQL Pools, Dedicated SQL Pools, and Spark Pools. Implement and monitor data quality rules, validation frameworks, and error handling. Ensure compliance with data governance, security, RBAC, and privacy standards. Work with … years of professional experience in data Engineer or a related field, with a proven track record of delivering impactful solutions. SQL Pools, serverless SQL, Spark Pools Strong SQL, performance tuning, query optimization Data modeling & warehouse concepts (Kimball/Inmon) Pipelines, triggers, linked services, integration runtime Data flows & orchestration ...

Senior Data Engineer- Spark & Databricks Optimisation- Up to £55K North Lincolnshire/Hybrid (2 days onsite) Major performance, optimisation & AI-driven projects Are you a Data Engineer who loves solving performance challenges, optimising compute, and getting stuck into large-scale data environments? This one is very much … understands what "good" looks like across modern data platforms. Someone who knows Python and SQL inside out, and who can improve pipelines, optimise Spark workloads, and make smart architectural decisions that genuinely impact runtime and cost. Tech-wise, you'll have hands-on experience with a modern cloud ecosystem. ...