1 to 25 of 265 Databricks Jobs in the UK

/Cosmos) Knowledge of data governance and modern concepts e.g., data mesh and data lake houses Knowledge of data science and ML platforms e.g., Databricks, Vertex, Fabric Applicants must be within commutable distance of Llandysul for 3 days a week working in office (working 2 days a week at home more »

learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP, AWS, and/or Azure services Cloud Database Management: BigQuery, Snowflake, Databricks, and Redshift Architect data models and schemas in BigQuery to support analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best more »

science applications – from data engineering to ML operations (training, serving, monitoring), and microservice/web application engineering. Our tech stack: Azure Data Lake, Azure Databricks (Notebooks, APIs, Workflows), MLflow, dbt, Harness CI/CD, OpenShift, Docker, GitHub, JIRA DISCOVER your opportunity What will your essential responsibilities include? · Set engineering standards … tangible track record of instituting change. · Software development experience in Python, or Scala. Familiarity with all, and expert in some of the below: SQL, Databricks or Spark, data warehousing, feature store design, Kubernetes, orchestration tools, monitoring tools, IaC, Docker, data streaming technologies. · Substantial experience as a Data Engineer/Software … Engineer/ML Engineer on an open-source tech stack with Python, Scala, Spark, ‘modern data’ platforms such as Databricks, Snowflake etc., cloud platforms, database technologies. · Track record of leading and motivating high performance engineering staff through ‘leading by example’ hands-on approach. Senior EM would have the following: · Clear more »

This is a brand new Electronic FX Engineering Lead (Director level) opening at a leading investment bank headquartered in the City of London. This critical role is positioned within a very high-performing Front Office department and this person will more »

bring your knowledge and experience of Azure data processing services to our platform, this will include some of the following: Data factory, Data Share, Databricks, Event hubs and Stream analytics to build data ingestion and processing pipelines that deal with highly confidential data securely and efficiently advise and assist with more »

You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge more »

efficient scrum teams Be a subject matter expert in the data platform domain, demonstrating proficiency in: Data lakes, data marts, and data warehousing (Azure Databricks, ADF, Azure Synapse, HD Insight). SQL, NoSQL, and Graph databases. Processing both structured and unstructured data, data modelling, and achieving a single customer view. more »

SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc. Experience being customer-facing on numerous data focused projects with a consultative approach Ability to deliver high to low-level more »

performance, driving improved targeted promotions, which in turn aligns with their hyper personalisation strategy for the end customer. Technically they operate a Snowflake and DataBricks environment, leveraging SQL to extract data and R and Python for modelling and statistical analysis, building code and tools. They also have PowerBI for data more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to start interviewing ASAP. … Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If you have the above, please do more »

SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc. Experience being customer-facing on numerous data focused projects with a consultative approach Ability to deliver high to low-level more »

challenges your customers face and how you can help them. You’ll bring wide experience of the data ecosystem, including: numerous data platforms e.g. Databricks; data modelling approaches; public cloud services including AWS and Azure; a deep knowledge and focus on security and privacy and their applications on data platform more »

pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning, Optimization, Governance and Security of Databricks platform. Experience in designing scalable solutions using Azure Data more »

software development principles. Extensive experience with Azure AI solutions, including Azure Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or more »

with clients and working on large-scale projects Knowledge of a selection of the following technologies including hands on experience is preferable: Python, Azure Databricks, Microsoft Power Platform (PowerAutomate & PowerBI) Proven high quality delivery and attention to detail Experience working as a team and leading project teams or workstreams Willingness more »

Senior Data Engineer Luton/Hybrid Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced … for data pipelines using tools such as Airflow, Jenkins and GitHub actions. · Highly competent hands-on experience with relevant Data Engineering technologies, such as Databricks, Spark, Spark API, Python, SQL Server, Scala · Help the business harness the power of data within easyJet, supporting them with insight, analytics and data science. more »

project uses Java to ingest the data into the platform. The Consultant would be helping to build out the Data Lake and Lakehouse on Databricks, working with AWS. Stack: AWS: ECS, KMS, SNS, SQS, Lambda, Python, Databricks, MongoDB, Spring Boot AWS, Java (to support ingestion), Databricks - experience in PowerBi would … Storage Mechanisms: MongoDB, Redshift, AWS S3 Cloud Environments/Infra: AWS (required), [AWS Lambda, Terraform] (nice to have) Data Platforms: Creating data pipelines within Databricks or equivalent such as Jupyter Notebook, PowerBI (nice to have) Understanding of Enterprise Models for Engineering: microservices, APIs, AWS services to support models (SQS, SNS more »

data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data pipelines on Azure cloud platforms. Strong data modeling and analysis skills. Experience across functional areas such as Clinical, Finance, Procurement, Operations, HR more »

Full-time Employee Status: Regular Role Type: Home Department: Information Technology & Systems Schedule: Full Time Company Description Our uniqueness is that we truly celebrate yours. Experian's culture and people are key differentiators. We take our people agenda very seriously. more »

and data and information systems design Experience with data management, database management systems, data services (including APIs), and enterprise data platform technologies (e.g. Fabric, Databricks, Snowflake, etc.) Experience architecting data-centric solutions at a conceptual, logical and physical level Experience in architecting, designing and implementing solutions on AWS and Microsoft more »

Big Data Analysis - Machine Learning, LLMs, NLP models (sentiment analysis, entity recognition, language generation etc). - Hands-on experience in SQL., Python, Microsoft Azure, Databricks, Azure OpenAl Services - Focus on Microsoft technologies for data manipulation, analysis, visualization, machine learning using ML/Al algorithms • Tests the solutions and applies refinements more »

time series analysis and have had hands-on experience in their application. · You’ve had some experience using cloud based analytical platforms such as Databricks, Snowflake, Google BigQuery etc. · Proven experience of working with customer data. · You’ve a strong commitment to accuracy and rigour in the analysis produced. · You more »

of database structure systems, data mining, data analysis, and strong software engineering skills. Strong understanding of Data Engineering Proficiency in AWS, data warehousing (Snowflake, Databricks, Redshift), big data frameworks (Spark, Kafka), container orchestration platforms (Kubernetes), and data integration/ETL tools. Strong written and verbal communication skills, with the ability more »

hands-on. Collaborate with cross-functional teams to understand requirements and translate them into technical solutions. Architect and implement data platforms using Microsoft and Databricks technologies to support analytics, AI, machine learning, and other data-driven applications. Key Responsibilities for the Head of Data Engineering 10 years+ Data Engineering experience … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data warehousing, data architecture, data modelling, integration, ETL/ more »

Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading Azure-based data solutions and helping more »