176 to 200 of 823 ETL Jobs in the UK

work smarter, and produce high-quality research more efficiently. Key responsibilities: Design, build, and maintain scalable data pipelines and servicesDevelop batch and ELT/ETL data workflows for ingesting and processing large datasetsWork with technologies such as Python, Java, Spark, SQL, and AirflowApply good software engineering practices, including testing, documentation ...

enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to ML training and prediction. The data team at OEV is growing at speed. We have invested time and resources on establishing a core data platform ...

organisations leverage data and insights to make better decisions, faster. Customers rely on Databricks for the full range of data workloads, including data engineering, ETL, near real-time streaming, machine learning, SQL analytics, and advanced analytics. The Solutions Architect (EDW Migrations) executes on Databricks’ strategic product lines to develop, establish ...

within Agile delivery environments using tools such as Jira and Confluence. Experience supporting applications through release, production transition and hypercare. Exposure to data engineering, ETL, analytics or data visualisation technologies. Previous experience within technology consulting or delivering solutions for large, complex organisations. A degree in Computer Science, Software Engineering ...

Engineer, Data Products, you will be responsible for: Supporting Data Pipelines: Assisting in the design and maintenance of scalabledata ingestion and processing systems using ETL/ELT methodologies. Cloud Resource Management: Learning to deploy and maintain software utilizingGCP services such as Pub/Sub, BigQuery, Cloud Storage Cross-functional Collaboration ...

underlying data models will unlock more insights for our team and more value for our customers. You have a strong passion for data modelling, ETL projects, and Big Data. You enjoy working with data streams from various services, such as financial, transactional, and operational systems. SQL and data modelling ...

underlying data models will unlock more insights for our team and more value for our customers. You have a strong passion for data modelling, ETL projects, and Big Data. You enjoy working with data streams from various services, such as financial, transactional, and operational systems. SQL and data modelling ...

flows, and anticipate the downstream consequences of design decisions. You translate business problems into elegant technical solutions. Key Responsibilities Design and develop data pipelines, ETL processes, and backend services using Python Build and maintain APIs and microservices that serve data products to internal and external consumers Work with large-scale ...

ingestion process from source to reporting layer with appropriate validation and error handling. Analyse and streamline existing on-premise relational databases (SQL Server) and ETL packages (SSIS). Build and maintain both API-based and browser-based automations Work closely with department heads across the division to support any projects ...

proposal development, and client-facing sales activitiesMust be eligible for SC clearance Nice to Have: Multi-platform technology stack - Experience with Snowflake, Databricks, modern ETL/ELT tools, and relevant certifications (SnowPro, AWS/Azure Data)Data governance & compliance - Strong background in security frameworks, regulatory compliance (GDPR), data lineage, and ...

years as a Data Engineer working on scalable data platforms, ideally in product-led or high-growth environments. Solid experience designing, building, and operating ETL/ELT pipelines and large-scale data architectures. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg ...

Financial Services & Insurance experience. Domain & Technical Expertise Data & AI Architecture Fluency: Deep understanding of modern data stacks (Data Lakehouses, Data Mesh, Real-time Streaming, ETL/ELT pipelines) and AI/ML lifecycle management (MLOps, GenAI integration, Model Governance). Ability to challenge architectural patterns and supervise technical teams without ...

help transform raw data into meaningful insights that support strategic decision-making across the organisation. Key responsibilities will include: Designing and developing data pipelines, ETL processes, and data integrations. Building and maintaining data warehouse solutions and data repositories. Developing robust data models, including fact and dimension tables for reporting and … years' experience in a Data Engineering or similar data-focused role. Strong SQL skills, including T-SQL and exposure to relational database technologies. Proven ETL experience, with SSIS being essential. Experience with scripting languages such as Python or PowerShell. Strong understanding of data modelling, warehousing concepts, and dimensional modelling. Experience ...

Data Technologies: Azure Data Factory (ADF), Azure Databricks, Azure Data Lake (ADLS), Azure SQL, Azure Synapse Analytics and Azure PaaS. Data Engineering: data ingestion, ETL/ELT, transformation, integration, SQL, Python and/or PySpark. Platform Engineering: Azure DevOps, CI/CD, monitoring, performance optimisation, security, governance and cost optimisation. … Architecture, Data Engineering, Microsoft Azure, Azure Data Factory, ADF, Azure Databricks, Databricks, Azure Data Lake, ADLS, Azure SQL, Azure Synapse, Synapse Analytics, Azure PaaS, ETL, ELT, Data Pipelines, Data Integration, SQL, Python, PySpark, Azure DevOps, CI/CD, Data Governance, Data Quality, Cloud Security, Microsoft Fabric, Power BI, Power Platform. ...

data quality, integrity, and security throughout the data lifecycle. Drive the adoption of best practices and industry standards for data engineering, including data architecture, ETL processes, and data warehousing. Manage and optimise Azure‐based infrastructure and services, ensuring high availability, scalability, and cost efficiency. Keep abreast of industry technical best … environment, with a strong focus on Azure and Salesforce technologies, operating at a similar level. In‐depth knowledge of data concepts, including data modelling, ETL processes, data integration and data warehousing. Extensive hands‐on experience with Azure cloud services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and ...

architecture and data governance. Experience in leading data modelling, database design, data warehousing, master data management, data governance practices. Strong skills in data modelling, ETL processes and data integration, having worked with data … platform teams. Experience in securing and protection of sensitive information Experience in AEC industry is great to have. Developed data pipelines to extract, transform, and load engineering platform data for analysis and reporting. Experience in implementing decentralized data products within a Data Mesh architecture Proven experience with cloud platforms such ...

experience of Scaled agile delivery. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and cloud-native integration solutions. Knowledge of data integration and ETL (Extract, Transform, Load) processes. Familiarity with DevOps practices and tools for continuous integration and continuous deployment (CI/CD). Relevant certifications in enterprise architecture ...

meet deadlines. Excellent stakeholder management and communication skills, with the confidence to work across different business functions. Experience with SQL, VBA, data warehousing or ETL concepts would be advantageous. A continuous improvement mindset and a genuine interest in using data to create business value. What's in it for youYou ...

moving away from container-orchestrated workflows toward managed cloud services. Platform Operations: Develop robust scalable data pipelines and optimise data storage solutions on GCP.Implement ETL processes and CI/CD pipelines to ensure clean, structured data ready for use. Work with data scientists to integrate synthetic models into production environments ...

Luxoft in the United Kingdom is seeking a senior data engineer to design, build and optimize large-scale ETL/ELT pipelines on Azure Databricks, Spark, and cloud data platforms. You will integrate data from diverse sources, implement complex SQL and data models, mentor teammates, and contribute to architecture and ...

engineering. Key requirementsManaging and growing a team of analystsStrong experience in data analysis and reporting with extensive experience of SQL, PowerBI or similar tooling, ETL pipelinesLeading the analytics strategy, while still being hands on in terms of analysisEnsuring that relevant insight and analysis is provided to drive growthExperience of Synapse ...

code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure as Code Container technologies Experience working in secure or regulated environments Security Requirement: Applicants must be eligible to obtain ...

code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure as Code Container technologies Experience working in secure or regulated environments Security Requirement: Applicants must be eligible to obtain ...

Skills & Experience: Experience as a Data Engineer, Data Developer or similar . Strong Python and SQL skills. Commercial Databricks experience. Experience with data pipelines, ETL/ELT or data processing. Understanding of cloud data engineering. Active SC or DV Clearance Desirable: AWS, Google Cloud, Defence/Central Government, large-scale ...

with highly sensitive data in a regulated environment. Key Skills: Azure Data Architecture/Data Warehousing Microsoft Fabric, Azure SQL & Data Factory Data Modelling & ETL/ELT Power BI & Data Lakehouse Data Governance, Security & Compliance What you'll bring: Strong Azure Data Architecture experience, ideally across greenfield programmes Experience building ...