101 to 125 of 160 Databricks Jobs in the North of England

Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Role Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake … formats Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge of structural data formats including Parquet, JSON, and CSV Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment Familiarity with unit testing data pipelines and implementing automated data quality checks Role ...

structure and lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands‐on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practice Credibility to lead long‐tenured individual contributors while ...

user, know what great looks like, and hold the bar for it. Bonus: data domain knowledge. Exposure to data integration, warehousing (Snowflake, Databricks), or analytics is a plus, not a requirement. At Matillion, we are committed to providing compensation in line with market standards based on the role, job family ...

that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that enables self-service … that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that enables self-service ...

/ETL workflows within a Fabric Lakehouse environment Work with OneLake, Lakehouse architecture, and modern data engineering best practices Utilise PySpark, SQL and Databricks for complex data transformation and engineering workloads Create robust data ingestion, orchestration and monitoring processes Support the development of enterprise-wide analytics solutions and Power … production-grade ELT/ETL pipelines Strong skills in PySpark and SQL Experience working with OneLake, Delta formats or modern Lakehouse architectures Exposure to Databricks and distributed data processing environments Understanding of data modelling, governance and optimisation principles Experience delivering data solutions that support analytics, reporting and business intelligence Passion ...

Engineer within complex technical environments. Strong knowledge of data management principles, including data modelling, integration, quality, and governance. Strong commercial experience with Snowflake and Databricks essential. Experience assessing existing data management systems and recommending improvements. Experience with modern data architectures, including cloud-based and distributed systems. Strong proficiency … ensuring that all applicants have a fair and accessible recruitment experience. Apply Now If you are an experienced Data Engineer with strong Snowflake and Databricks experience and are looking for your next opportunity within a technically challenging and high-impact environment, we would be keen to hear from you. Apply ...

doing Deliver large-scale data migrations from on-premises or legacy platforms to cloud-native AWS architectures, including Lakehouse implementations using Databricks or Snowflake. Design, build, and optimise low-latency data pipelines that process real-time betting events, odds updates, and market data at scale. Implement robust data quality, validation … Kinesis, Apache Kafka/MSK, Apache Flink, Spark Streaming Languages Python, SQL, Spark Pipeline tools dbt, Airflow/AWS MWAA, AWS Glue Platforms Databricks, Snowflake, Amazon Redshift Data quality Great Expectations, dbt tests, custom reconciliation frameworks IaC/DevOps Terraform, AWS CDK (desirable) What we’ll offer you We trust ...

agnostic when it comes to the technology we work with and we support clients in a range of data cloud partnershipsincludingAWS, Azure, Snowflake and Databricks to name but a few. We are interested in individuals who are passionate and curious about what is next. As a Senior Consultant AWS Data … Certified Data Engineer – Associate, AWS Certified Solutions Architect - Associate, or AWS Certified Developer - Associate Experience withstreaming data architecturesand real-time analytics Familiaritywithdata platformssuch asSnowflake, Databricks is a bonus Experience with ML/AI engineering, including building or integrating production-grade machine learning or generative AI solutions. Experience with agentic development ...

Crewe (4 days per week on site) | Competitive + Bonus + Benefits Gravitas are partnering with a global organisation to recruit an experienced Lead Data Engineer. This is an exciting opportunity for a hands‐on ...

An exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working ...

journey. Let’s create tomorrow, together, today. About the role and team: Role overview CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform, working alongside AWS. The Senior Data Engineer (ML) sits in the Databricks workstream team (Delivery Manager, Lead … platforms. This is hands‐on delivery in a regulated iGaming environment: production pipelines, not notebooks. Key responsibilities Migrate ML data pipelines from Databricks (Spark/Delta Lake) to the SageMaker-based "golden template" architecture, working to the pattern set by the Lead ML Ops Engineer Build and amend feature engineering ...

journey. Let’s create tomorrow, together, today. About the role and team: Role overview CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform, working alongside AWS. The Senior Data Engineer (ML) sits in the Databricks workstream team (Delivery Manager, Lead … platforms. This is hands‐on delivery in a regulated iGaming environment: production pipelines, not notebooks. Key responsibilities Migrate ML data pipelines from Databricks (Spark/Delta Lake) to the SageMaker-based "golden template" architecture, working to the pattern set by the Lead ML Ops Engineer Build and amend feature engineering ...

data science adoption Key Skills and Experience Own end-to-end EMEAPAC data platform across design, delivery and steady-state operation Strong understanding of Databricks and Fabric architecture, including Lakehouse patterns Ability to oversee ingestion, transformation and reporting layers across enterprise data flows Working knowledge of Databricks (Delta Lake, pipelines ...

Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. You will implement Delta Live Tables, write PySpark and SQL in Fabric Notebooks … Databricks clusters, and ensure data access control, quality checks, and governance through Unity Catalog. #J-18808-Ljbffr ...

optimising data pipelines, ensuring high-quality, business-ready data is available across the organisation. The role offers exposure to the latest Microsoft Fabric and Databricks technologies, with responsibility spanning data ingestion, transformation, Lakehouse development and platform optimisation. Working closely with stakeholders across the business, you will help deliver scalable data … solutions that support enterprise reporting, analytics and future data initiatives. Key Responsibilities Build and maintain scalable data pipelines using Microsoft Fabric and Databricks, supporting the ongoing development of the organisation's modern data platform. Develop and maintain Medallion Architecture data layers, ensuring data is available for reporting and analytics. Create ...

quality checks. Performance Optimization: Optimize queries and improve performance of data retrieval operations. Technology Stewardship: Stay updated with the latest advancements in AWS, Databricks, and the data engineering field in general. Provide recommendations on the adoption of new tools and technologies. Requirements: AWS Services: Proficiency in AWS services like Lambda … Kinesis, and Glue. Databricks & Delta Lake: Hands-on experience with Databricks and Delta Lakehouse architectures. Programming: Proficient in Python, Scala, and SQL for data engineering tasks. ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes. Data Modelling: Experience in logical and physical data modelling with large datasets. Problem ...

Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business click apply for full job details ...

scalable pipelines and platforms that power reporting and analytics across the whole organisation. You'll be working hands-on with Microsoft Fabric and Databricks, building out a new Lakehouse architecture and introducing data products that people across the business can actually trust and use. Essential Skills & Experience: Hands-on experience … with Databricks and Microsoft Fabric Experience building and running production-grade pipelines Strong PySpark and SQL skills Experience with Delta Lake and Lakehouse architectures Good grasp of data modelling, orchestration and workflow automation Comfortable working with structured and semi-structured data (Parquet, JSON, CSV) Solid understanding of CI/ ...

needs and translate them into clear, deliverable requirements Design, build and maintain semantic models, datasets and reporting solutions using Power BI, paginated reports and Databricks Improve report and dataset performance by reviewing data models, DAX calculations, queries and refresh approaches Apply data validation, reconciliation and testing to ensure analytics outputs … technical audiences Experience with AI-assisted development tools and copilots to improve productivity and delivery outcomes is advantageous Familiarity with Tabular Editor and Databricks is desirable Familiarity with specialty (re)insurance or Lloyd’s market data such as bordereaux, delegated authority, underwriting and claims is advantageous Core Competencies Demonstrates expertise ...

/Bronze, Silver & Gold patterns Delta tables SQL Azure Git/source control CI/CD Testing, monitoring and data quality Experience with Azure Databricks is particularly relevant and transfers well into what the team is building within Fabric. You don't necessarily need commercial Fabric experience … worked in a modern Databricks/Spark/Python engineering environment. Equally, we're open to strong Python Data Engineers who have built production-grade data solutions through code and are looking to move deeper into PySpark, distributed processing and Fabric. What makes this different? The business isn't simply ...

+ package Active SC or DV Clearance required 2-stage virtual interview process Experience required in Python, SQL, Spark, Databricks and Customer Consultancy We're working with a fast-growing, high-performing technical consultancy seeking an experienced Data Engineer to join a team specialising in data, AI and software solutions … Experience designing and building data-intensive applications and pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication ...

from diverse data sources and formats Hands‐on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross‐functional stakeholders, with strong communication skills for both technical and non‐technical audiences Awareness … support highly scalable data engineering solutions that power Moody’s next‐generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody’s technical teams ...

from diverse data sources and formats Hands-on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross-functional stakeholders, with strong communication skills for both technical and non-technical audiences Experience applying … build, and support highly scalable data engineering solutions that power Moodys next-generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moodys technical teams ...

strategy, architecture and hands-on delivery, you will: Help define and deliver the data platform roadmap Design and deliver solutions using Azure Data Lake, Databricks, SQL and Python Lead the transformation and migration of existing systems and data services Translate the wider programme into practical workstreams covering migration, integration, governance … engineers and is ready for greater responsibility. You must be able to demonstrate: Hands-on experience with Azure Data Lake Strong practical experience with Databricks and SQL Experience using Python within a data engineering environment Data platform design and architecture experience A track record of taking systems or platforms through ...

data systems You Will Demonstrate: Deep knowledge of the Azure data stack (Azure SQL Server, CosmosDB, Azure Data Factory, Purview, Synapse, Event Hub, Azure Databricks/Fabric) Extensive data modelling experience: both normalised relational models and de-normalised Star Schema/dimensional models Excellent relational database design skills with expertise … architectural practices Industry specialisation in specific sectors (Engineering, Manufacturing, Healthcare etc.) Public sector or defence experience Experience with modern unified data platforms like Databricks or Microsoft Fabric Understanding of data mesh or data fabric architectural approaches Relevant industry certifications such as TOGAF 9, CDMP (Certified Data Management Professional), or Microsoft ...