1 to 25 of 58 Databricks Jobs in Central London

frameworks and tools such as Microsoft Purview Experience with cloud infrastructure and networking in Azure Hands-on experience with Microsoft Fabric implementations Familiarity with Databricks Exposure to machine learning and AI concepts Python for data engineering tasks Experience with DevOps practices Knowledge of Power BI data modelling Certifications (Optional) Fabric ...

into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps ...

Cost/capacity optimisation. Desirable Skills & Experience Experience across adjacent Microsoft services often paired with Fabric (e.g., Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure Data Lake). Familiarity with Microsoft Purview and broader governance practices. Dynamics 365 CE and FO integration and analytics. Exposure to AI/ ...

Product Owner, Data Analyst, or Technical Business Analyst. Excellent understanding of modern data platform technologies, including: Data lakes and data warehouses (e.g., Snowflake, Azure Databricks, Azure Data Factory). ETL pipelines and enterprise data modelling. SQL and data profiling. Structured and unstructured datasets. Schema design and methods (e.g., YAML ...

reporting and analytics Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Data technician (level ...

highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building … maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex ...

Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation tools (Databricks, Azure Data Factory) and ML platforms (Azure ML, TensorFlow). Experience with data visualisation tools such as Power BI. Strong commercial acumen with the ability to translate ...

data integration Experience within banking or financial services ideally regulatory reporting Strong understanding of data quality and governance Nice to Have Exposure to Azure Databricks Experience with middleware tools Kafka MQ IIB Knowledge of AQR ECB reporting Personal Skills Strong analytical and problem solving ability Excellent communication skills with both ...

Experience in implementing data governance, including data cataloging, data lineage tracking, and metadata management to ensure data accuracy, accessibility, and compliance. Preferred: Experience with Databricks Understanding of how data platforms interact with marketing and customer engagement platforms. Knowledge of service-oriented architecture, including exposing and consuming data via APIs, streams ...

Data Engineer (Azure & Databricks) - 6-month Contract We are seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design … build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions using Delta Lake and medallion architecture (bronze, silver, gold) Optimise performance, data quality ...

translating requirements • Familiarity with Python, SQL, able to engage with data teams without coding • Cloud platforms (AWS, Azure, GCP) and modern data stacks (Databricks, Snowflake) • AI/ML-driven platforms, translating capability into business use cases Role Requirements • Background in Solutions Engineering, Technical Consulting, or Customer Success • Experience with data ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

e.g., segmentation, attribution, propensity modelling) is beneficial but not required Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and data warehousing technologies (e.g., Databricks, BigQuery, Redshift) is a big plus Comfortable using Git for versioning and collaboration Our Commitment to You: Competitive salary 25 days holiday, plus an additional ...

looking for: ✔ Experience in a data, operations, or analytics-focused role ✔ Familiarity with BI and reporting platforms such as Power BI, Datorama, Data Studio, Databricks, SQL ✔ Strong communication skills and a collaborative, solutions-focused mindset ✔ An organised, proactive approach—comfortable working across teams and timelines ✔ Excitement for new technology, data ...

standards Qualifications ✔ Experience in a data, operations, or analytics-focused role ✔ Familiarity with BI and reporting platforms such as Power BI, Datorama, Data Studio, Databricks, SQL ✔ Strong communication skills and a collaborative, solutions-focused mindset ✔ An organised, proactive approach—comfortable working across teams and timelines ✔ Excitement for new technology, data ...

scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive … Refinitiv), tick data, trade history, reference data, or instrument master management * Apache Spark or Flink for large-scale stream and batch processing beyond the Databricks ecosystem * dbt or equivalent SQL transformation layer; experience building and maintaining dbt projects in a production data warehouse * Event streaming with Kafka or Confluent Platform ...

full ML lifecycle Working knowledge of GitHub, including version control and CI/CD practices Experience with cloud platforms such as Azure, AWS or Databricks Strong communication skills with the ability to explain complex concepts to non-technical stakeholders ...

data quality practices, as well as experience working within financial markets or a similar data-intensive environment. Exposure to modern data platforms (e.g. Databricks) is highly desirable. To secure the most relevant hire, my client is prepared to offer highly competitive compensation with market-leading bonuses, alongside excellent benefits ...

capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong engineering mindset, with a focus on reliability, testing and maintainability Proven ability to mentor others and provide technical ...

frameworks, data management principles, and data quality best practices Experience working with modern data architectures and cloud-based data platforms (e.g. AWS, Azure, Snowflake, Databricks) Background working across data, analytics, BI, or data engineering teams within transformation programmes Why apply? Opportunity to lead a high-impact data transformation within ...

implementation of data architecture and data engineering frameworks across ingestion, data layers, semantic layers, and consumption. • Own policies and standards for data platforms, including Databricks, integration, data management, and access controls. • Ensure platforms are designed for performance, scalability, reliability, and security. Data Governance, Quality & Compliance • Implement frameworks for data quality ...

Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda is a plus. Direct experience in building and applying large-scale (100M+ users) machine learning solutions for personalizing ...

. Build and optimize batch and real-time data pipelines across underwriting, pricing, claims, reinsurance, and bordereaux data. Develop scalable solutions using Python, PySpark, Databricks, and/or Snowflake . Integrate data from policy administration systems, claims platforms, broker systems, third-party providers, and market feeds. Ensure strong data quality … Insurance , ideally within the London Market ecosystem. Deep knowledge of underwriting, claims, delegated authority, pricing, and reinsurance. Hands-on expertise in Python, PySpark, Databricks, Snowflake, SQL . Experience with Azure, AWS, or GCP . Strong understanding of batch/streaming pipelines and data modelling. Familiarity with DevOps practices, CI/ ...

through to modelling, experimentation, and presenting insights to stakeholders. What they’re looking for: Strong SQL & Python skills, ideally within cloud environments (GCP, AWS, Databricks) Experience building or applying models such as LTV, churn, propensity, MMM or forecasting Exposure to experimentation (A/B testing, incrementality, Bayesian methods, causal inference ...

data product management, including work with data platforms, models, or analytics products Strong technical understanding of data systems, analytics, and data governance principles SQL, databricks, AI/ML product experience Ability to collaborate effectively with both technical and non-technical stakeholders Experience with agile methodologies, product lifecycle management, and roadmap ...