351 to 375 of 457 ETL Jobs in the UK

extraction Infrastructure : AWS (Lambda, ECS/EKS, API Gateway, S3) DevOps : Terraform, GitHub Actions, Helm, Infrastructure-as-Code Data Science : Graph analytics, data pipelines, ETL workflows, Jupyter notebooks Required Qualifications Software Development 5+ years of professional software engineering experience Strong proficiency in Python (3.10+) with deep understanding of async programming … Understanding of service deployment, monitoring, and troubleshooting Data Science/Analytics Experience with data analysis using Python (pandas, numpy) Understanding of data pipelines and ETL processes AI/LLM Engineering Experience integrating LLM APIs (OpenAI, Anthropic, Gemini, or open-source equivalents) into production applications Understanding of core LLM concepts: context ...

extraction Infrastructure : AWS (Lambda, ECS/EKS, API Gateway, S3) DevOps : Terraform, GitHub Actions, Helm, Infrastructure-as-Code Data Science : Graph analytics, data pipelines, ETL workflows, Jupyter notebooks Required Qualifications Software Development 5+ years of professional software engineering experience Strong proficiency in Python (3.10+) with deep understanding of async programming … Understanding of service deployment, monitoring, and troubleshooting Data Science/Analytics Experience with data analysis using Python (pandas, numpy) Understanding of data pipelines and ETL processes AI/LLM Engineering Experience integrating LLM APIs (OpenAI, Anthropic, Gemini, or open-source equivalents) into production applications Understanding of core LLM concepts: context ...

evidence of the rewarding and engaging nature of the work. What you will deliver: User research: Engage with users, observe and analyze their workflows, and extract relevant insights about how they perform a process and interact with a product or system. This involves uncovering pain points, process mapping, pattern recognition … Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving Legal Disclaimer: We are an equal opportunity employer. We do not discriminate on the basis of protected characteristics like race, religion ...

integrate externally produced data back into live systems, ensuring it behaves as native system output. Strong focus on XML, SQL, and VB.NET , with light ETL-style data handling. Key Skills XML (structured outputs, schemas, validation) XSLT transformations VB.NET system posting/integration logic SQL (data loads, reconciliation, fixes) Experience integrating ...

closely with data scientists and business to design and implement AI algorithms,frameworks and architectures. AI model Data Preprocessing: Design, build, and maintain robust ETL/ELT pipelines to ingest, transform, and loaddata from various sources. AI model Feature Engineering: Integrate structured and unstructured data from internal and external systems ...

will work closely with clients, understanding their requirements, and guiding them through the implementation process. A minimum of 5 years of software development and ETL experience is essential. #J-18808-Ljbffr ...

IDMC Developer to design and implement robust cloud data integration solutions using Informatica IDMC (CDI and CAI). Key Requirements: 6-8 years of ETL/Data Integration experience. 2-3 years of hands-on experience with Infor... LFWQ1_UKTJ ...

find the best team to suit your skillset/interests but you could be working on: • Some of the world’s most performant ETL pipelines that deal with billions of data points every second • Software solutions/products with scale, reliability and latency considerations in mind • R&D work ...

/ODBC Experience in supporting legacy applications and handling L3 support Working knowledge of Elasticsearch Desirable Skills: Spring Boot Docker Git Jenkins Cloud technologies ETL processes What you'll get in return Opportunity to work on high-impact, secure government projects Flexible remote working with structured on-site training Potential ...

plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will … deliver modern cloud-based transformation for clients across a range of sectors. In this role, you will design and build data pipelines, develop ETL/ELT processes, and create innovative data solutions using the latest cloud technologies and frameworks across AWS. Some responsibilities include: Build data pipelines to ingest, process ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

Data Architect/Databricks Architect (Databricks, Azure, Lakehouse, ETL/ELT, Data Architecture) Permanent Reading (Hybrid) Charles Simon Associates are currently recruiting for a Databricks Architect on behalf of a global organisation delivering large-scale Azure Databricks data platform transformations. This is a key role where you will take ownership … Skills/Requirements for the Databricks Architect: Proven experience as a Databricks Architect/Data Architect Strong hands-on experience with Azure Databricks (ETL/ELT pipelines) Experience working across Azure Data Lake, Azure Data Factory and cloud platforms Understanding of Databricks Lakehouse architecture Experience designing enterprise-level data architectures ...

data platforms Python, SQL, Snowflake , and the Microsoft Power Platform (Power BI, Power Apps, Power Automate). Do you have experience in data engineering, ETL/ELT pipelines, data cleansing, data modelling, CRM data (ideally Salesforce) , and supporting analytics across a business? Are you confident developing automated workflows, dashboards, and … responsibilities and tasks for this job include supporting high-priority data engineering and analytics workstreams across the business. You will develop and maintain ETL pipelines, manage enterprise data quality, support KPI reporting, and help deliver automation and integration solutions across Power Platform and Salesforce. If you feel you can cover ...

best practices. Data Engineering & Platform Modernization Lead BI platform migrations (e.g., Tableau to Power BI, SAP BO to Power BI). Design and implement ETL pipelines and optimized enterprise data models . Manage cloud data modernization programs , including source migrations (e.g., Amazon Redshift to Databricks). Visualization & Analytics Solutions Architect … data, platform, and business functions. Support pre‐sales, solutioning, and new analytics pursuits . Required Skills & Expertise Technical Skills Data Analytics & Visualization Data Engineering & ETL Design Microsoft Power BI , Microsoft Fabric Azure , Databricks Python ServiceNow Analytics Cloud Data Platforms & BI Modernization Process & Frameworks IT Service Management (ITSM) ITIL ...

cutting-edge real-time data solutions that support automation and business intelligence. What you'll do: Design, develop and maintain scalable data pipelines and ETL processes using AWS technologies such as Glue, Lambda, S3, and Redshift. Playing a key role in the migration of their existing SQL Server data warehouse … experience with AWS services including Glue, Lambda, S3, Redshift, and EMR. Proficiency in Python and SQL. Proven experience designing and building data pipelines and ETL solutions. Strong understanding of data warehousing principles and modern data architecture patterns. Experience with pipeline orchestration and workflow management tools. Excellent communication skills and ...

using a mixture of, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies (SQL Server, PL/SQL, T-SQL, SQL Server Management Studio - SSIS), ETL, Integration Platforms, Agile and Frontend Development (JavaScript/jQuery, React, Blazor) and Software Testing. This is a hands-on role, so you MUST … Software Engineer, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies, SQL Server, PL/SQL, T-SQL, SQL Server Management Studio, SSIS, Power BI, ETL, Integration Platforms, Agile, Frontend Development, JavaScript, jQuery, React, Blazor, Software Testing, AWS, Azure, Cloud, CI/CD, DevOps, Software Architecture, Design Patterns. The role comes ...

customer data interacts with these technologies. Designing scalable enterprise architectures, not ad-hoc integrations. Modern Data Architecture Lakehouse, data mesh, ELT/ETL patterns, MDM and dimensional modelling. Steering the "doers" in the team-architecting the solution, not building it yourself. Team & Practice Growth Mentoring and guiding a growing data … Knowledge of Dynamics 365, DevOps pipelines and Agile delivery. Experience with ML, generative AI and cognitive services. Expertise in lakehouse, data mesh, ELT/ETL, MDM and modelling techniques. Ability to guide delivery teams without being the hands-on builder. Willingness to travel for client sessions (primarily London). Ready ...

using a mixture of, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies (SQL Server, PL/SQL, T-SQL, SQL Server Management Studio - SSIS), ETL, Integration Platforms, Agile and Frontend Development (JavaScript/jQuery, React, Blazor) and Software Testing for this long-term and critical development programme. This … Software Engineer, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies, SQL Server, PL/SQL, T-SQL, SQL Server Management Studio, SSIS, Power BI, ETL, Integration Platforms, Agile, Frontend Development, JavaScript, jQuery, React, Blazor, Software Testing, AWS, Azure, Cloud, CI/CD, DevOps, Software Architecture, Design Patterns. The role comes ...

ETL Systems Ltd in the United Kingdom is seeking a Senior Embedded Software Engineer to enhance its digital RF and connected product portfolio. This position involves designing and maintaining embedded software for Linux-based platforms, focusing on low-level driver development and backend services. Ideal candidates bring robust C and ...

Contract – Remote/Cardiff VIQU have partnered with an NHS organisation to recruit a hands-on Data Engineer to support critical data integration and ETL workloads across a Microsoft-based environment. This Data Engineer role is focused on stabilising, improving and enhancing existing data pipelines, alongside supporting ongoing modernisation and … cloud migration activities. The Role The successful Data Engineer will play a key role in ensuring the reliability and performance of existing ETL processes, working across a hybrid on-premise and Azure-based data platform. Key responsibilities include: Testing, troubleshooting and supporting existing ETL and data ingestion processes Investigating and ...

while balancing your involvement across various initiatives to provide direction, technical leadership and oversight wherever it’s needed. Skills & Experience Strong consultancy background across ETL/ELT, data warehousing and big‐data solutions, with hands‐on delivery experience and proven leadership/mentoring in an onshore–offshore model. Proficiency with … ETL tools and cloud data services (AWS preferred — e.g., Glue; with exposure to Azure Data Factory), plus experience implementing CI/CD for data; knowledge of Informatica tools is beneficial. Experience working with major databases such as Postgres, Redshift, Oracle, SQL Server or Snowflake, along with strong SQL capability and ...

with Lockton’s culture. At Lockton we value the following principles: Client first Results and impact driven Self-motivated Continuous improvement Role Responsibilities Extract, interrogate and analyse data to support business decision making. Engaging with the wider business to understand their data/reporting requirements. Provide insight to help … that they are self-motivated and have a hunger to continuously learn and develop. Must have skills: End to end development of PowerBI Reports (ETL, Data Modelling, Expression writing and Report creation) Good practices in SQL development Good understanding of relational databases Advanced Excel (Power Query, Power Pivot etc.) Strong ...

data engineering, architecture, and business transformation, delivering mission-critical solutions using the Palantir platform. Key Responsibilities Design, build, and optimise data pipelines and ETL workflows within Palantir Foundry Develop scalable data models and architect robust Foundry solutions Transform complex, multi-source data into structured, high-quality assets Implement data governance … solutions that deliver measurable outcomes Required Experience & Skills Hands-on experience with Palantir Foundry and/or Gotham Strong background in data engineering, including ETL and pipeline development Experience working with batch, streaming, and unstructured data Proficiency in Python and/or TypeScript Understanding of data modelling, system design, and ...

solve complex data warehousing and big-data processing challenges using AWS technologies, delivering self-service analytics, infrastructure-as-code, and high-performance ETL/ELT workflows. You will also develop automated data quality frameworks that validate accuracy, detect anomalies, and increase trust in downstream data products. In this role … rapid growth and evolving business needs. Key job responsibilities Build and optimize data pipelines to ingest and transform data from various sources, including traditional ETL pipelines and event data streams. Utilize data from disparate sources to build meaningful datasets for analytics and reporting, focusing on consolidating data from various systems. ...