401 to 425 of 747 Remote Databricks Jobs

experience across coding/configuration/automation/monitoring/security is necessary. Significant AWS or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. The role comes with an extensive benefits … sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Lead Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and storage in cloud environments.* Troubleshoot and optimise data workflows for performance … Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions.* Solid understanding of data modeling, ETL/ELT processes, and data warehousing.* Excellent communication skills and More ❯

across the organisation by lifting data literacy and nurturing a self-serve culture Guide your team through a data transformation journey, creating a reliable single source of truth using DataBricks Develop and scale meaningful data models, including AI/ML opportunities, that unlock tangible value for our customers and business Champion and manage impactful, reliable data products that support commercial … conversations Experience creating and delivering data roadmaps with strong prioritisation and impact focus A passion for sustainable, well managed data products that make a difference Hands on knowledge of DataBricks and experience with data transformation programmes A genuine interest in leading and developing people, building happy and high performing teams A belief in strong data foundations and pragmatic delivery over … lead, space to innovate, and a team who values support, balance and shared success. Technologies EON Next loves: Languages: Python, SQL & Spark (PySpark, SparkSQL) Tools: Git (GitHub/GitLab) DataBricks, AWS services (inc. Athena/Glue, S3, SageMaker, Lambda, Transcribe, EC2) & Tableau Datastores: Postgres, DataBricks, Parquet/Delta Here's what else you need to know: Role may close earlier More ❯

across the organisation by lifting data literacy and nurturing a self-serve culture Guide your team through a data transformation journey, creating a reliable single source of truth using DataBricks Develop and scale meaningful data models, including AI/ML opportunities, that unlock tangible value for our customers and business Champion and manage impactful, reliable data products that support commercial … conversations Experience creating and delivering data roadmaps with strong prioritisation and impact focus A passion for sustainable, well managed data products that make a difference Hands on knowledge of DataBricks and experience with data transformation programmes A genuine interest in leading and developing people, building happy and high performing teams A belief in strong data foundations and pragmatic delivery over … lead, space to innovate, and a team who values support, balance and shared success. Technologies EON Next loves: Languages: Python, SQL & Spark (PySpark, SparkSQL) Tools: Git (GitHub/GitLab) DataBricks, AWS services (inc. Athena/Glue, S3, SageMaker, Lambda, Transcribe, EC2) & Tableau Datastores: Postgres, DataBricks, Parquet/Delta Here's what else you need to know: Role may close earlier More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially a 3-month … week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform using batch and streaming processes, adhering … and Skills: * Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions. * Strong understanding of SQL, database design, and data architecture. * Experience with Databricks and/or Spark. * Knowledgeable in data governance, data cataloguing, data quality principles, and related tools. * Skilled in data extraction, joining, and aggregation tasks, especially with big data and real More ❯

you will do it We appreciate technologies are always evolving, but we would like to hear from you if you have proven hands-on knowledge of the following technologies: Databricks Dedicated SQL Pools Synapse Analytics Data Factory To set yourself up for success you should have in-depth knowledge of the languages Apache Spark, SQL, Python, along with solid development … practices. Additionally, you will be required to have in-depth knowledge of supporting Azure platforms such as Data Lake, Key Vault, DevOps, within Databricks your experiences should include Delta, Unity Catalog, in-depth Cluster knowledge along with performance tuning and debugging. Why choose Arreoblue? As a Microsoft, Databricks, and Datometry partner, we have a vast array of training, knowledge, and More ❯

technologies are always evolving, but we would like to hear from you if you have solid working, architectural, and platform knowledge of 2 or more of the following technologies: Databricks Dedicated SQL Pools Synapse Analytics Data Factory To set yourself up for success, you should have in-depth knowledge of the languages Apache Spark, SQL, and Python, along with solid … development practices. Additionally, you will be required to have in-depth knowledge of supporting Azure platforms such as Data Lake, Key Vault, and DevOps. Within Databricks, your experiences should include Delta, Unity Catalog, in-depth cluster knowledge, along with performance tuning and debugging. Why choose Arreoblue? As a Microsoft, Databricks, and Datometry partner, we have a vast array of training More ❯

Services team. Reporting to our Head of Data Platform and Services, you'll not only maintain and optimize our data infrastructure but also spearhead its evolution. Built predominantly on Databricks, and utilizing technologies like Pyspark and Delta Lake, our infrastructure is designed for scalability, robustness, and efficiency. You'll take charge of developing sophisticated data integrations with various advertising platforms … with data-driven insights and informed decision-making What you’ll be doing for us Leadership in Design and Development : Lead in the architecture, development, and upkeep of our Databricks-based infrastructure, harnessing Pyspark and Delta Lake. CI/CD Pipeline Mastery : Create and manage CI/CD pipelines, ensuring automated deployments and system health monitoring. Advanced Data Integration : Develop … governance standards. Data-Driven Culture Champion : Advocate for the strategic use of data across the organization. Expertise in Apache Spark Advanced proficiency in Python and Pyspark Extensive experience with Databricks Advanced SQL knowledge Strong experience in building and managing CI/CD pipelines. Experience in implementing data integrations with multiple advertising and analytics platforms. Solid understanding of data governance and More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. … Document data processes and pipelines to support knowledge sharing and onboarding. To be successful in the role you will have • Solid experience designing and delivering data solutions focused on Databricks • Strong ETL experience with tools such as ADF or SSIS • Experience working with Azure technologies – Synapse, Fabric, Data Lake • Knowledge of data architecture principles and data modelling What is on More ❯

pricing actions. Collaborate with cross-functional teams to deliver the platform in an agile manner. Provide guidance on the implementation and management of Azure Cache (Redis), Postgres, Azure Redis, Databricks Delta Live tables, and Snowflake. Ensure the platform supports microservices and API-driven architecture with sub-2-second calls. Develop and maintain documentation, architecture diagrams, and other technical artifacts. Manage … What you'll need: Proven experience in ML Ops engineering, with a focus on Azure and Databricks. Strong knowledge of Postgres, Azure Cache (Redis) and Azure Redis. Experience with Databricks Delta Live tables and Snowflake. Experience with Docker and Azure Container Services. Familiarity with API service development and orchestration. Experience in Data (Delta) Lake Architecture (Azure). Excellent problem-solving More ❯

Time and batch processing of financial data. This is a long-term contract opportunity. The following skills/experience is essential: Strong Power BI (DAX, Power Query, data modelling) Databricks, Python, SQL, Spark are highly desirable Experience with investment banking data (trades, positions, market data, reference data) Excellent communication skills Rate: Up to £800/day Duration: 6 months + More ❯

Time and batch processing of financial data. This is a long-term contract opportunity. The following skills/experience is essential: Strong Power BI (DAX, Power Query, data modelling) Databricks, Python, SQL, Spark are highly desirable Experience with investment banking data (trades, positions, market data, reference data) Excellent communication skills Rate: Up to £800/day Duration: 6 months + More ❯

including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions. Requirements: AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure Terraform Databricks Data Lake, Warehouse, Lakehouse architecture and design Python/Pyspark Data platforms and notebooks: Jupyter, Databricks, Azure Gitlab: repository and CI/CD Java (Spring Boot) experience is a plus More ❯

timing, and budget requirements. Your coaching style enables you to elevate other project members to a higher level. Required Skills & Knowledge: Data Lake - Azure SQL Server - Data Factory -Azure Databricks - Azure Databricks -Azure Synapse Azure Data Explorer - Azure DevOps - Microsoft Fabric -Python & PySpark You have a strong background and min 5 years of experience working with Microsoft Azure Data Services More ❯

with the Data & Ops team to stay on top of key changes that may impact the ML frameworks and to own the release of ML products. We use Azure Databricks as our platform. To be successful in the role, you will need to be experienced in cross-team collaboration to deliver data science projects, whilst promoting best practices. You will … knowledge, and strong knowledge of ML packages and frameworks Skilful in writing well-engineered code using Spark, and advanced SQL and Python coding skills Experienced in working with Azure Databricks Proven experience working with Data Scientists to deliver best in-class solutions for model deployment and monitoring Great technical and communication skills, with a high degree of proactivity Passion for More ❯

machine learning, and deep learning to extract actionable insights. This role requires strong expertise in Python-based AI/ML development, big data processing, and cloud-based AI platforms (Databricks, Azure ML, AWS SageMaker, GCP Vertex AI). Key Responsibilities Data Exploration & Feature Engineering Perform thorough Exploratory Data Analysis (EDA) and identify key variables, patterns, and anomalies. Engineer and select … adopt best practices for responsible AI. Qualifications Technical Skills Programming: Python (NumPy, Pandas), R, SQL. ML/DL Frameworks: Scikit-learn, PyTorch, TensorFlow, Hugging Face Transformers. Big Data & Cloud: Databricks, Azure ML, AWS SageMaker, GCP Vertex AI. Automation: MLflow, Kubeflow, Weights & Biases for experiment tracking and deployment. Architectural Competencies Awareness of data pipelines, infrastructure scaling, and cloud-native AI architectures. More ❯

thinking culture, and help drive the energy transition for the UK. Code & create - Develop complex SQL and ABAP CDS views for analytics and reporting Transform & optimise - Use PySpark and Databricks to manipulate big data efficiently Automate & schedule - Manage workflows, jobs and clusters for scalable data processing Collaborate & deliver - Engage across agile teams to build high-impact solutions What You'll … into structured insights. Experience in building data pipelines and models in SAP Datasphere or SAP BW4/Hana Advanced skills in SQL, data modelling, and data transformation Familiarity with Databricks, Apache Spark, PySpark, and Delta Lake Agile mindset with experience in DevOps and iterative delivery Excellent communication and stakeholder engagement abilities Sound like a fit? Let's build the future More ❯