476 to 500 of 550 ETL Jobs in the UK

Need: Experience in architecture & design and consulting services focused on enterprise solutions, data analytics platform, lake houses, data engineering, data processing, data warehousing, ETL, Hadoop & Big Data. Experience in BFSI Industry is required. Experience in defining and designing data governance, data management, and data security solutions for an enterprise across … changes. Open to frequent travel to meet with customers and attend internal and external events across the Americas and Europe. Skills Required: Data Warehousing, ETL, Big Data, Presales, BFSI Role: At Impetus, you will operate at the intersection of business and engineering, engaging with engineers, managers, sales teams, and ...

onsite in Warwick. Key Responsibilities Define and maintain data architecture principles and standards Design data models and integration patterns across Azure and Snowflake Oversee ETL/ELT processes and ensure data quality and governance Collaborate with engineering teams to implement robust data pipelines Provide guidance on monitoring and performance optimisation … Skills & Technologies Cloud: Azure Data Warehousing: Snowflake ETL & Orchestration: Azure Data Factory (ADF), DBT Programming: Python Monitoring: Prometheus Data Engineering: ETL/ELT best practices Requirements Proven experience as a Data Architect in enterprise environments Strong understanding of modern data platforms and cloud architecture Hands-on experience with Azure and ...

team. This is a great opportunity for someone with 12 years experience in SQL Server who wants to develop their skills in data engineering, ETL, and analytics. Youll be responsible for: Building and optimising SQL Server queries, views, and stored procedures Supporting ETL/data pipelines (SSIS or similar) Helping … and improving validation Working with stakeholders to deliver accurate, reliable data Were looking for someone with: Hands-on experience with T-SQL Exposure to ETL tools and basic data modelling Experience using Git in a team environment Strong attention to detail and problem-solving skills ...

Automation Test Analyst SQL Automation Test Analyst - Test Automation Frameworks, BI Solutions, SQL, Power BI, ETL, Agile, Data Testing, Data Pipelines, Data Platforms, Dashboards, Reports - Warrington - 6 months Initially - Outside IR35 - £450-475 per day A specialist SQL Automation Test Analyst with strong BI, SQL and Data expertise is urgently … ensure its accuracy, completeness, and integrity - Compare data between systems, applications, and environments to ensure consistency and integrity - Validate the performance of data pipelines, ETL processes, and database queries to ensure they meet performance benchmarks SQL Automation Test Analyst Skills and Experience: - In-depth experience of automated SQL data testing ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

Venture) Information Management Team (IM), where your responsibilities will include ensuring systems integration, designing data modelling processes, and developing algorithms and predictive models to extract the data required by the project. You will also collaborate with teams across the project to support data analysis and share insights. Candidates need … checks. Use FME to support information sharing and provide basic training on FME to project teams. Ensure project team members receive essential instruction on ETL tools (FME). Drive digital transformation by identifying and implementing process and workflow efficiency improvements. Support the integration of project systems with internal and client ...

engineering excellence. Key Responsibilities: Break down complex client problem sets and design innovative solutions using Palantir technologies. Build and maintain robust data pipelines and ETL processes. Develop operational workflows and decision-support tools that transform client operations. Collaborate with colleagues to implement AI and machine learning models. Apply strong software … role. Strong skills in Python, SQL, and TypeScript. Experience with Palantir Foundry, Gotham, or comparable data platforms (preferred). Solid understanding of data engineering, ETL pipelines, and workflow orchestration. Interest in AI, machine learning, and emerging technologies. Strong communication skills and a collaborative, consulting mindset. Curiosity, adaptability, and a desire ...

regulated environment Strong understanding of pension products, processes, and regulatory requirements. Demonstrable experience in data analysis, data migration, and defining data extract requirements. Hands-on experience with transformation and onboarding of third-party systems. Solid understanding of system integration principles and data quality assurance. Excellent analytical, problem-solving, and communication … Desirable Skills Experience with pension administration platforms and data models. Familiarity with data governance frameworks and best practices. Knowledge of data transformation tools or ETL processes. Proficiency in using tools such as SQL, Excel, Visio, or data modelling software. Relevant certifications (e.g., BCS Business Analysis, Agile BA, or similar). ...

ensure reliable, scalable, and high-quality data solutions. What you’ll be doing: Designing and building data pipelines, models, and architectures Developing and maintaining ETL/ELT processes using modern tools Implementing data storage solutions across relational, non-relational, and cloud platforms Ensuring data quality, reliability, and operational excellence Leading … beneficial) Strong SQL skills and experience with relational databases Python development experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data ...

from the ground up, working directly from Databricks data sources Deliver dashboards covering: Campaign performance Customer health metrics Marketing impact and effectiveness Perform simple ETL and data shaping tasks (circa 20-40% engineering, remainder Power BI) Gather requirements directly from client stakeholders via regular calls Provide clear updates … Power BI experience, including building dashboards from scratch Experience working with Databricks SQL or Python for data extraction and transformation Ability to perform light ETL and data modelling tasks Strong stakeholder communication skills Previous experience delivering new dashboard builds, not just maintaining existing reports Experience working with marketing or customer ...

include but are not limited to : Supporting the design, development and maintenance of Business Intelligence solutions to enable accurate, timely decision-making Assisting with ETL processes (Extract, Transform, Load), ensuring data is transferred from source systems to reporting environments with accuracy and integrity Helping to develop and maintain a robust ...

logistics and online services optimisation. Extend functionality of our Bread GPT service (Large Language Model insight synthesis engine). Data engineering: build and develop ETL processes in Microsoft Fabric to support reporting, insight and applied AI models A hands-on role working with other staff and partners. Utilize data science … Computer Science, Analytics, Engineering, or a related field. Minimum of 3+ years of experience within excellent knowledge of Python and preferably R. Knowledge of ETL processes - ideally basic understanding of Microsoft ETL (Data Factory/Synapse/Fabric) Knowledge of databases (SQL & NoSQL) and API development/integration. Understanding ...

Data Engineer (Strong SQL, ETL, Python) - SC Cleared OR Eligible Stevenage (Hybrid) 2-3 days onsite Up to 80,000 High-impact programme - Revolutionary platform I am looking for a Security-Cleared Data Engineer to take the reins on a range of highly ambitious Data Migration projects supporting a range … process Key Responsibilities Analyse existing data structures and understand business and technical requirements for migration initiatives. Design and deliver robust data migration strategies and ETL solutions. Develop automated data extraction, transformation, and loading (ETL) processes using industry-standard tools and scripts. Work closely with stakeholders to ensure seamless migration and ...

candidate will work closely with business users and technical teams to translate business processes and requirements into data extraction, mapping, and transformation specifications, including ETL considerations across multiple source systems. Key Responsibilities * Act as a senior functional Subject Matter Expert (SME) for JD Edwards EnterpriseOne (E1)* Provide functional expertise across … understand end-to-end processes and cross-system data flows.* Translate business processes and functional requirements into clear **data extraction, transformation, and load (ETL) specifications.* Support data extraction from JDE E1 and ancillary financial systems for loading into other Oracle ERP systems.* Use advanced Excel skills to analyze, validate, and ...

Design & Solve: Break down client challenges and design innovative, data-driven solutions. Engineer Data: Build and maintain robust data pipelines and ETL processes. Create Workflows: Develop operational workflows and decision-support tools that transform enterprise operations. Apply AI: Collaborate on AI and machine learning models applied to real-world challenges. … Python, SQL, and TypeScript . Experience with Palantir technologies (Foundry, Gotham, or similar) is preferred but not essential . Solid understanding of data engineering, ETL pipelines, and workflow design. Passion for AI, machine learning, and emerging technologies. Excellent problem-solving, collaboration, and communication skills. Curiosity, adaptability, and a drive ...

pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple sources, ensuring consistency and quality Design and implement ETL/ELT processes (e.g., using Apache NiFi) Produce reusable, maintainable code with a test-driven approach Maintain and enhance existing data platforms and services Investigate … actionable technical tasks Monitor and optimise system performance for reliability and efficiency Required skills Apache Kafka Apache NiFi SQL and NoSQL databases (e.g., MongoDB) ETL/ELT development using Groovy, Python, or Java Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and ...

expert within Azure Databricks and PySpark. You'll help to upskill our teams knowledge of Databricks, get involved in data modelling and ETL pipeline development, integrations, and performance tuning. This is an ever evolving project as the business becomes more and more data driven and your knowledge of Databricks will … platform project.What you’ll be doing: Leading the design and implementation of a new Databricks-based data warehousing solution Designing and developing data models, ETL pipelines, and data integration processes Large scale data processing using PySpark Monitoring, tuning, and optimising data platforms for reliability and performance Upskilling the wider team ...

and develop StoryMaps Automation & Workflow Optimization Build automated workflows using ModelBuilder, Python scripts, and geoprocessing models Work with tools like FME for spatial data ETL and data transformation processes Your Profile Essential Skills/Knowledge/Experience 10+ years in GIS Web Application Development & Deployment Desirable Skills/Knowledge/… technologies Experience with: ArcGIS Experience Builder (COTS & custom tools) ArcGIS Portal content migration Service publishing Web map and StoryMap creation Strong understanding of spatial ETL workflows using ...

and help us develop and maintain our data warehouse infrastructure. Using your expertise in SQL Server and SSIS, you'll design, build, and optimise ETL processes, from data ingestion through to transformation, ensuring high-quality, reliable data is available for the Business Intelligence Team and other stakeholders. You'll work … about leveraging data to deliver insight, improve services, and support better decision-making, and have strong technical skills in SQL Server data warehousing and ETL development, we'd love to hear from you. Main duties of the job In addition to the brief overview below, please ensure you review ...

configuration and data extraction . Understanding of Asite data model and metadata . Experience with transformations and automation for large datasets . Proficiency in ETL tools and scripting for API-based migrations. Ability to understand and design logical/physical data models for capital delivery software's and align with … business processes, document control). Help in building and executing ETL pipelines using APIs, scripts (PowerShell/Python), and integration tools to extract, transform, and load data into Unifier. Support rigorous data quality checks , reconcile migrated data, and produce audit logs for compliance and sign-off. Help in configuring Unifier ...

processKey Responsibilities Analyse existing data structures and understand business and technical requirements for migration initiatives. Design and deliver robust data migration strategies and ETL solutions. Develop automated data extraction, transformation, and loading (ETL) processes using industry-standard tools and scripts. Work closely with stakeholders to ensure seamless migration and minimal … issues promptly. Collaborate with wider engineering and architecture teams to ensure migrations align with organisational and regulatory standards.Relevant exposure; Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL. Proficient-level SQL skills for complex query development, performance ...

strategies Cloud Migration & Hosting: Lead PostgreSQL migration from on-premises/mainframe to cloud platforms (AWS Aurora preferred), ensuring performance, security, and scalability Integration & ETL Pipelines: Build robust pipelines using CDC Kafka/S3 Aurora with UPSERT/MERGE patterns; guarantee idempotency, ordering, and reliable delivery Data Encoding & Validation: Manage … data modelling Expertise in CDC tools (IBM CDC or similar) and data migration strategies Proven experience in PostgreSQL cloud hosting and migration Proficiency in ETL/ELT pipelines, Kafka, and AWS ecosystem Solid understanding of data encoding, transformation, and validation techniques Familiarity with IaC, CI/CD, and observability frameworks ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...