26 to 45 of 45 Contract Databricks Jobs

both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and storage in cloud environments.* Troubleshoot and optimise data workflows for performance … Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions.* Solid understanding of data modeling, ETL/ELT processes, and data warehousing.* Excellent communication skills and More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially a 3-month … week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform using batch and streaming processes, adhering … and Skills: * Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions. * Strong understanding of SQL, database design, and data architecture. * Experience with Databricks and/or Spark. * Knowledgeable in data governance, data cataloguing, data quality principles, and related tools. * Skilled in data extraction, joining, and aggregation tasks, especially with big data and real More ❯

A/B tests and other statistical modelling techniques. Proficiency in Python and/or R. Excellent proficiency in SQL to and working with data warehousing technologies (e.g. Snowflake, Databricks). Ability to use data visualisation tools such as Looker/Tableau. Ability to convert technical outputs into succinct and compelling presentations with clear narrative and actionable recommendations. Strong clarity More ❯

and Excellent. What you'll need to succeed Strong proficiency in SQL, Excel, Power BI, and DAX is essential. Experience with cloud-based data platforms such as Snowflake or DataBricks is preferred. Expertise in T-SQL to write complex queries and stored procedures. Understanding of database optimisation, data mining, auditing, and segmentation. Skilled in data visualisation and statistical techniques such More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across the pipeline. Automate pipeline orchestration using Databricks Workflows … and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure … access control, and metadata management across data assets. Ensure data security best practices, such as encryption at rest and in transit, and role-based access control (RBAC) within Azure Databricks and Azure services. Performance Tuning & Optimization: Optimize Spark jobs for performance by tuning configurations, partitioning data, and caching intermediate results to minimize processing time and resource consumption. Continuously monitor and More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across the pipeline. Automate pipeline orchestration using Databricks Workflows … and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure … access control, and metadata management across data assets. Ensure data security best practices, such as encryption at rest and in transit, and role-based access control (RBAC) within Azure Databricks and Azure services. Performance Tuning & Optimization: Optimize Spark jobs for performance by tuning configurations, partitioning data, and caching intermediate results to minimize processing time and resource consumption. Continuously monitor and More ❯

experience working in an agile environment and part of a multi-disciplinary team. * Advanced data visualisation for understanding large, complex, or high-dimensional data. * Experience using Azure toolset including Databricks and PowerBI for data analysis is beneficial. * Competent with SQL * Worked collaboratively with diverse stakeholders and team members across Technology and the broader business. * Demonstrated a level of comfort with More ❯

in a regulated environment e.g. FCA, PRA and wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Working knowledge of Enterprise and Solution Architecture frameworks and methodologies (e.g. TOGAF) Professional Qualifications More ❯

in a regulated environment e.g. FCA, PRA and wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Working knowledge of Enterprise and Solution Architecture frameworks and methodologies (e.g. TOGAF) Professional Qualifications More ❯

Experience Azure Data Engineer required for my global client. Due to a major increase in workload, my client is in need of an Experienced Data Engineer with very strong experience around Data Engineering, Azure and Microsoft Dynamics 365 F & O. More ❯

Senior Data Engineer l Modern Azure stack l Snowflake l Databricks l Oracle l Bigquery l ETL l Financial services l Real time data l £600 PD l Outside IR35 l 5-6 months l London - Remote Method Resourcing are partnering with a Top-Tier consultancy supporting one of their most important clients to modernise and rebuild their data platform. … Key skills: Strong Azure background across the modern stack Experience across a range of data platforms such as snowflake, databricks, big query, Oracle etc to be able to help with the modernisation, whichever way it goes Strong Stakeholder management and communication skills Dealt with Real time data Ideally come from a financial services Bonus points if you've worked in … If you're interested in the role and would love more information please send me your CV ASAP at Senior Data Engineer l Modern Azure stack l Snowflake l Databricks l Oracle l Bigquery l ETL l Financial services l Real time data l £600 PD l Outside IR35 l 5-6 months l London - Remote RSG Plc is acting More ❯

/item data sets for reporting and analytics Work with Informatica P360 (Product 360) to manage and optimise product data pipelines Develop data workflows and perform advanced analysis using Databricks and Azure Data Services Collaborate with cross-functional teams to gather requirements and translate business needs into technical specs Ensure high data quality, consistency, and alignment across systems Create dashboards … Strong hands-on experience with Informatica/P360 for MDM or product-related data initiatives Proficient in Azure Stack (Azure Data Factory, Azure SQL, Synapse, etc.) Solid experience with Databricks for big data processing and analysis Excellent SQL skills and ability to manipulate, interpret, and present complex data sets Understanding of data governance, data quality, and data modelling principles Strong More ❯

Engineers and tell the Architect what you need in the Data Model - and you'll define the data platforms roadmap. You will also have good experience around ADF, Azure DataBricks, and Snowflake - plus your knowledge will include ETL processes, Data Governance, Data Warehouses, Data Marts, and Data Lakes. Key Skills & Experience: Product Owner Data Platforms Roadmap User Stories Snowflake Azure More ❯

Engineers and tell the Architect what you need in the Data Model - and you'll define the data platforms roadmap. You will also have good experience around ADF, Azure DataBricks, and Snowflake - plus your knowledge will include ETL processes, Data Governance, Data Warehouses, Data Marts, and Data Lakes. Key Skills & Experience: Product Owner Data Platforms Roadmap User Stories Snowflake Azure More ❯

end. The work will be split 50/50 between Angular and .Net. Experience/Skills: Angular - version 14+ .Net V8/C# Azure DevOps Azure experience (Functions, DevOps, databricks, data factory) Industry experience within financial services Desirable experience with AI/ML, such as Search Index, Azure Machine Learning If this role is of interest to you or you More ❯

broader project roadmap. Work across two distinct ecosystems, balancing BAU and forward-looking platform development. Contribute to the design and implementation of new solutions, with potential use of Azure, Databricks, and Python for cloud and data processing tasks. Profile The Backend Developer will have strong expertise in .NET/C# development. Advanced SQL skills, including performance tuning and working with More ❯

experience in data science, ideally in eCommerce or marketing analytics. Proven experience working with either Robyn or Meridian Strong skills in Python, SQL, and working with large-scale data (Databricks, PySpark). Proven experience with MMM, A/B testing, and causal inference. Comfortable with experimentation design, time series analysis, and working with imperfect data. Bonus: Experience with R and More ❯

results are communicated effectively Support the team's use of tools like Robyn (Meta's open-source MMM tool) and Meridian, taking solutions beyond prototype Skills & Experience Python, SQL, Databricks, PySpark Familiarity with Robyn or Meridian Dashboarding experience is beneficial Proven track record of deploying marketing mix models or causal models into production Strong hands-on experience with Python and More ❯

Azure, or PCF) and Microservices. Expertise in RESTful Web Services, authentication techniques, and security best practices . Strong troubleshooting skills, proactive mindset, and excellent communication skills. Bonus: Experience with Databricks, NiFi, and Hadoop is a plus. *For this position, you need to be based within commutable distance to Dublin and hold an EU/UK passport ot Stamp More ❯

drives every decision and you bring strong communication skills to match your technical expertise, this one's for you. Please note: Candidates must have excellent communication skills Tech Stack: Databricks SQL Python PySpark Robyn Meridian/Light MMM Nice to Have: R Dashboarding experience PyMC Requirements: Proven Marketing Mix Modeling (MMM) experience Solid grasp of causal inference techniques Ability to More ❯