1 to 25 of 84 Databricks Jobs in the City of London

Databricks | Competitive Salary | UK (Remote) Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands‐on experience with Databricks, PySpark, Python and SQL? The role 7Dxperts is looking for a Senior Data Engineer to join our UK team. Key Responsibilities … Build scalable pipelines using Databricks, Spark and PySpark. Develop ETL/ELT and data transformation workflows using Python and SQL. Create and maintain Databricks notebooks, jobs, workflows and clusters. Work with Delta Lake and lakehouse architectures. Monitor, troubleshoot and optimise pipeline performance. Maintain high standards of data quality and reliability. ...

engineering projects, workstreams or technical teams. Strong knowledge of cloud data platforms and modern data services. Experience with platforms such as Snowflake, Microsoft Fabric, Databricks or equivalent. Strong understanding of data modelling, data warehousing, Lakehouse and modern data architecture. Experience with data governance, data quality and metadata management. Exposure ...

SKILLS AND EXPERIENCE: You will bring strong capability in: Microsoft SQL Server and data warehousing (Synapse/Fabric/Azure SQL) Azure Data Factory, Databricks, and modern ETL tooling Data modelling, data migration, and large-scale data transformation Building and maintaining cloud-based data platforms Working within Agile delivery environments ...

with front‐end web technologies and frameworks such as React and Next.js. Experience with nextgen datawarehouse/data analytics platforms such as Snowflake or Databricks Your First 6 Months You can expect to quickly become involved in meaningful production work, including: 1. AWS Cloud Migration Support key elements ...

/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across GCP, AWS, or Azure . Experience with Databricks, Snowflake, or Hadoop ecosystems . Knowledge of data ingestion, ETL/ELT frameworks, and batch/real-time processing. Applications are now open. #J-18808-Ljbffr ...

solutions and mentor junior engineers. We’re looking for someone who can offer the following skills & experience. Strong experience in Python, PySpark/Spark, Databricks, Azure Data Factory, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest. Experience designing, building and supporting scalable data pipelines and data products ...

expectations on Data Engineering and AI. Exposure to data platforms, programming languages and AI tools, such as Alteryx, Knime, Power BI, Microsoft Fabric, Tableau,Databricks, Snowflake, Microsoft Purview, Collibra, Informatica,Claude, Chat GPT,Microsoft Copilot,Python and SQL among others, to deliver practical and impactful analytics assurances and solutions. Experience ...

guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data pipelines ...

building data pipelines. Knowledge of Python for data analysis and automation. Experience building automated reporting solutions or data workflows. Hands-on experience using Databricks for analytics and reporting workflows ...

identify trends and business opportunities. Excel Advanced Excel skills, including: Power Query Power Pivot Complex formulas and modelling techniques Preferred Skills: Experience working with Databricks in a modern data platform environment. Knowledge of dbt (Data Build Tool) for data transformation and modelling. Familiarity with cloud-based data platforms, particularly Microsoft ...

expectations on data and AI. Experience with using data platforms, programming languages and AI tools, such as Alteryx, Knime, Power BI, Microsoft Fabric, Tableau, Databricks, Snowflake, Microsoft Purview, Collibra, Informatica, Claude, Chat GPT, Microsoft Copilot, Python and SQL among others, to deliver practical and impactful analytics assurances and solutions. Experience ...

Python and SQL and the ability to write complex SQL queries. Use of GitHub and CI/CD practices. Support development of the Azure Databricks Lakehouse platform, shaping frameworks and solutions that other engineering teams will adopt in future data projects. Build, optimise, and maintain data processing frameworks using Python … deliver approved solutions. Take ownership of requirements, communicate effectively across teams, and deliver high quality solutions. Experience of DevOps and infrastructure deployments (Azure and Databricks). A proactive awareness of industry standards, regulations, and developments. Multi-skilled experience in one or more of the following disciplines: Data Management, Data Engineering ...

performing Analytics & Data Science team. This role focuses on delivering advanced analytics, ML, and generative AI solutions across diverse projects, using Python, R, Azure, Databricks, SQL, Power BI and Tableau. You will influence business decisions and collaborate with senior stakeholders in a cloud-based environment. #J-18808-Ljbffr ...

microservices. Contribute to Disaster Recovery planning and platform resilience. Implement Identity and Access Management (IDAM) and enterprise security architecture. Support data architecture using Databricks, Snowflake, ETL pipelines, and Big Data tools. Champion Data Governance practices including classification, cataloging, and lineage. Ensure compliance with ISO 27001, GDPR, PCI DSS, and other ...

. Key Responsibilities Azure Platform Support & Monitoring Support and maintain Azure-based data solutions, including Azure Data Factory pipelines, datasets, linked services, triggers; Azure Databricks (Spark jobs, notebooks, clusters); Azure Machine Learning models and endpoints; Power BI dashboards and dataset refreshes. Monitor and troubleshoot failures in pipelines, jobs … workflows using Azure Monitor, Log Analytics, and custom alerting. DevOps & Automation Maintain CI/CD pipelines using Azure DevOps, GitHub Actions, etc., for ADF, Databricks and ML model deployments. Develop automation scripts in Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse Operations ...

genuine interest in developing into an architectural role Experience working closely with Data Engineers, Analytics teams, and business stakeholders Exposure to Microsoft Fabric, Databricks, Python, PySpark, or dbt would be beneficial Experience with data modelling tools such as Sparx EA, Sparx Enterprise Architect, Enterprise Architect, ER/Studio, ERwin, Erwin ...

Skills/Experience Although not essential, the following skills are desired by the client: Asset/investment management or financial services experience. Aladdin experience. Databricks experience.Working knowledge of Informatica. Experience with cloud migration and Modern Data Stack environments. Disclaimer Notwithstanding any guidelines given to level of experience sought, we will ...

essential. Desirable Experience Experience working with cloud platforms such as Azure, AWS or Google Cloud. Knowledge of modern data technologies including Azure Data Factory, Databricks, Microsoft Fabric, Synapse Analytics, Snowflake or similar platforms. Experience within digital transformation or data modernisation programmes. PRINCE2, AgilePM, PMP or Scrum qualifications. Consultancy or client ...

Strong experience with core data science and machine learning libraries such as scikit-learn, pandas, PyTorch and/or TensorFlow . Practical experience with Databricks , including MLflow and Spark-based data processing. Hands-on knowledge of Generative AI and LLMs , including prompt engineering, RAG architectures and vector search. Strong understanding ...

client sites as needed. Ideal candidate has FS regulatory experience, data governance expertise, and hands-on use of tools such as Alteryx, Power BI, Databricks, Snowflake, Python and SQL to deliver practical analytics assurances and audits. #J-18808-Ljbffr ...

Python, PostgreSQL, DynamoDB, OpenSearch Experience with APIs, webhooks, and system integrations Familiarity with cloud platforms (AWS, Azure, or GCP) Experience working with Snowflake, Databricks or similar data warehouses Knowledge of AI/ML concepts and how they apply to business processes Customer-Facing Skills Excellent communication skills with both technical ...

with some combination of: Data architecture, modelling, integration, governance or migration Cloud technologies such as Azure, AWS or GCP Modern data platforms such as Databricks or Snowflake Application and integration architecture AI, ML or GenAI Technology transformation and modernisation Architecture frameworks, roadmaps and solution design Working directly with clients ...

operations datasets. Experience working with data governance frameworks, data quality management and data ownership principles. Experience of working with Microsoft Azure Data Services and Databricks Experience with a BI visualisation tool Comfortable with AI-assisted tools and effective prompting Ability to engage effectively with both business and technical stakeholders Experience ...

join our Data & Business Intelligence team and help develop, maintain and optimise our cloud-based data platform. Working within a modern Azure and Databricks environment, you'll design and maintain scalable data pipelines, transform and model data, and ensure our data architecture provides a reliable foundation for business intelligence, reporting … understand data requirements and deliver effective solutions. Ensure data quality, accuracy and consistency through validation and monitoring processes. Design and maintain data models within Databricks and Azure SQL environments. Transform and prepare data for reporting, analytics and business intelligence. Support Power BI reporting and dashboard solutions alongside the BI team. ...

complex operational challenges into scalable insights across modules of the Elizabeth Line and beyond. The role requires hands-on experience with Power BI, Azure Databricks and Python, plus automation via Power Automate and Power Apps. Hybrid work arrangement with a mix of office/home, salary around £60k. #J ...