251 to 275 of 468 ETL Jobs in the UK

and structured data * Reinforcement Learning from Human Feedback (RLHF) for model alignment Production ML Systems: * Apache Airflow/Dagster for ML workflow orchestration and ETL pipeline management * Model versioning and experiment tracking (MLflow, Weights & Biases) * Real-time model serving and edge deployment strategies * A/B testing frameworks ...

data architecture. Key Responsibilities Support critical data processing between core systems and the Enterprise Data Warehouse, ensuring accurate and timely reporting Manage and monitor ETL pipelines, identifying and resolving data issues and performance bottlenecks Act as a technical point of contact during financial close periods (monthly, quarterly, year-end) Perform … automate and optimise manual workflows Contribute to the design of a cloud-based “Single Source of Truth” data platform Design, develop and maintain ETL workflows using modern tools (e.g. Azure Data Factory, Databricks) Optimise database performance through query tuning, indexing and partitioning strategies Support CI/CD practices using Azure ...

Prefect). Proven track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Strong proficiency in relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra). Deep knowledge … data transformation and ETL pipelines and APIs. Security cleared or ability to obtain (SC or above). Desirable Skills and Experience: Degree in Data Engineering or equivalent professional accreditation such as CEng. Experience with graph databases and advanced query languages (e.g., Neo4j, Gremlin). Knowledge of machine learning data pipelines ...

full data lifecycle — engineering secure, high-performance pipelines and modern data platforms that enable analytics, AI, and enterprise insights. Key Responsibilities Build and optimise ETL/ELT pipelines Design and manage data warehouses, lakes, and cloud-native platforms Implement monitoring, governance, security, and regulatory compliance frameworks Deliver high-quality datasets … and advanced analytics initiatives Requirements Degree in IT, Computer Science, Software Engineering, or related field (minimum 2:1 classification ) Strong SQL & Python Hands-on ETL/ELT experience (e.g., Matillion, Talend, Fivetran, ADF) Experience with Snowflake (AWS/Azure/GCP beneficial) Strong data modelling knowledge Understanding of data governance ...

C++). • Develop clean, responsive front-end interfaces using frameworks like Vue.js or React • Collaborate with data scientists and engineers to integrate ML models, ETL pipelines, and cloud-based data storage solutions. • Implement secure, compliant and scalable data access layers, ensuring compliance with data privacy standards. • Contribute to system architecture … e.g. Docker compose, Swarm or Kubernetes) in a Linux-based environment. • Solid understanding of RESTful API design, microservices architectures, and asynchronous workflows. • Familiarity with ETL processes, data warehousing and distributed systems. • Ability to obtain UK Security Clearance (SC). We’d love it if you also have: • Experience with data ...

C++). • Develop clean, responsive front-end interfaces using frameworks like Vue.js or React • Collaborate with data scientists and engineers to integrate ML models, ETL pipelines, and cloud-based data storage solutions. • Implement secure, compliant and scalable data access layers, ensuring compliance with data privacy standards. • Contribute to system architecture … e.g. Docker compose, Swarm or Kubernetes) in a Linux-based environment. • Solid understanding of RESTful API design, microservices architectures, and asynchronous workflows. • Familiarity with ETL processes, data warehousing and distributed systems. • Ability to obtain UK Security Clearance (SC). We'd love it if you also have: • Experience with data ...

and analytics workloads. Develop and maintain scalable data architectures including Azure Data Lake, Azure SQL Data Warehouse, and Synapse Analytics. Build and maintain reliable ETL/ELT workflows, ensuring high data quality, accessibility, and performance. Collaborate with data scientists and analysts to translate business and data requirements into production-grade … TensorFlow, PyTorch, Scikit-learn MLOps & Model Management: MLflow, Model versioning, CI/CD Cloud & Big Data: Databricks, Databricks APIs, MCP, Blob Storage Data Engineering: ETL/ELT pipelines, DLT, Delta Lake Infrastructure as Code (IaC): Terraform, ARM templates, Ansible Version Control & DevOps: Git, Azure DevOps, Jenkins Experience 3+ years ...

with Risk and Compliance teams to translate regulatory needs into technical design. Data Integration & Enterprise Connectivity: - Design and govern enterprise data integration architectures using ETL/ELT frameworks, API-based integration, event-driven and streaming integration, message queues and middleware. - Define integration patterns for real-time, near real-time, and … with at least 5+ years of hands-on experience in enterprise data architecture, design, governance, and implementation. - Strong experience designing and implementing enterprise-grade ETL/ELT data pipelines. Hands-on experience with tools such as SQL, NoSQL Datastores, Talend, Informatica, IBM DataStage, or equivalent platforms, Collibra, Data Lineage, Alfresco. ...

interfaces using frameworks like Vue.js or React, to present complex datasets and user workflows. • Collaborate with data scientists and engineers to integrate ML models, ETL pipelines, and cloud-based data storage solutions. • Optimise system performance and reliability for high-volume data operations across distributed environments. • Implement secure, compliant and scalable … e.g. Docker compose, Swarm or Kubernetes) in a Linux-based environment. • Solid understanding of RESTful API design, microservices architectures, and asynchronous workflows. • Familiarity with ETL processes, data warehousing and distributed systems. • Ability to obtain UK Security Clearance (SC). We’d love it if you also have: • Experience with data ...

and Web Applications Designer. Expert knowledge of Business Warehouse (BW), InfoProvider setup, and Data Modeling analysis. Extensive experience in Data Extraction, Transformation, and Loading (ETL), including Report-to-Report Interfaces. Ability to perform BW job scheduling analysis and provide proposals for BW redesign to improve performance. Design and optimization ...

Description: Design and develop data models and ETL processes to support business intelligence and analytics initiatives. Ensure data accuracy, consistency, and integrity within the BI environment. £65000 - £85000/year Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink act as an employment agency for permanent ...

involves designing and implementing scalable data pipelines and mentoring a cross-functional team. The ideal candidate will have extensive experience with distributed data systems, ETL designs, and backend development using Python and Scala. Competitive compensation, flexible working hours, and a commitment to diversity and inclusion are offered. #J-18808-Ljbffr ...

Description: Design and develop data models and ETL processes to support business intelligence and analytics initiatives. Ensure data accuracy, consistency, and integrity within the BI environment. £65000 - £85000/year Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink act as an employment agency for permanent ...

Domain : Telecom Domain experience - MUST HAVE Role Overview We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with data architects, business ...

enabling data-driven decision-making across operations. Ideal candidates will have extensive experience in a regulated environment and strong knowledge of data modelling and ETL processes. The position offers hybrid working arrangements and benefits like free parking and subsidised transport. #J-18808-Ljbffr ...

design and optimize data solutions Troubleshooting and performance tuning skills Desirable Skills/Knowledge/Experience Knowledge of cloud-based data platforms Experience with ETL and data integration tools Understanding of data security and compliance Exposure to Agile methodologies Familiarity with scripting for automation ...

closely with consultants and stakeholders, you’ll translate business requirements into scalable, well-engineered solutions. Role: SQL Developer, Data Integration Developer, SQL Integration Developer, ETL Developer, Database Integration Developer, Database Developer, Integration Developer Salary: £50k - £55k base per annum + Bonus and Benefits. Benefits: 5% pension, 25 days holiday ...

international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with a wide range of visibility from day one For more information ...

/SQL Solid understanding of Oracle ERP database architecture Experience with joins, subqueries, analytic functions, and performance tuning of data extractions Knowledge of ETL techniques and methods Experience in Oracle 11i data structures or Oracle Cloud environments Previous experience of data migration in a similar role Background This ...

/HTML/CSS Desirable Spring Webflux/Project Rector Reactive programming Cloud Native Development (AWS SDK/CDK) CI/CD Automation (Jenkins) ETL/Real Time Analytics/Database Modelling Writing Automated Testing Frameworks Manufacturing/Supply Chain Experience Further information: £50,000-£55,000 depending on experience ...

test data Applying Risk-Based Testing methodologies Working closely with stakeholders to identify and manage risks/issues What we're looking for: Strong ETL testing experience (Talend highly desirable) Experience testing Oracle RDS solutions Proven background in Functional/System testing Comfortable working in Agile environments Familiarity with tools ...

Skills 5+ years professional Python experience; youve shipped and owned production systems. Built/owned a real-time/low-latency system (not batch ETL) with measurable performance goals. Strong understanding of async + multiprocessing trade offs and performance profiling. Comfortable owning an existing codebase: refactors, tests, architecture improvements. Experience ...

used production environments. Mapping, tracing and reconciling data across legacy and target systems. Validating migrated datasets to ensure accuracy, completeness and regulatory fit. Running ETL processes within tightly-governed production frameworks. Technical Environment A key element of this role is deep hands-on expertise with IBM DB2 on Mainframe, including ...

Zapier, Workato) API design, integration, authentication Python, JavaScript or similar scripting languages AI/ML models (LLMs, embeddings, classification, summarisation) Data wrangling and ETL tools Cloud platforms and serverless architectures RPA or orchestration frameworks They are in a great position, strong financially and with clients already signed up thats what ...

insight to life through Power BI. Build and maintain the Redshift-based Enterprise Data Warehouse and S3 Data Lake. Develop and optimise ELT/ETL pipelines across diverse data sources. Develop Power BI datasets, dashboards, and reports. Build strong semantic models using DAX and best-practice design. Work with stakeholders … warehousing. Amazon Redshift. Data Lake architectures (S3, lakehouse patterns). SQL and Power BI development experience. DAX/Data Modelling Familiarity with ELT/ETL tools. Knowledge of data governance, security, and access control. Scripting skills Agile The company have an excellent reputation within their sector, and have experienced ...