101 to 125 of 262 ETL Jobs in England

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

Strong SQL skills for data validation and defect investigation Hands-on experience testing Power Apps, Dataverse, SharePoint and APIs Exposure to data engineering/ETL pipelines Ability to design test cases, structure test cycles, and manage execution end-to-end Experience testing front-end web applications and back-end systems ...

Power BI reporting environment. What you'll be doing: Reviewing the current Microsoft Fabric and Lakehouse setup, including data models, semantic models, dataflows/ETL, and overall reporting architecture Recommending improvements around performance, scalability, governance, security, and usability Integrating data from core line-of-business systems into the reporting platform ...

and modern data platform technologies. Expertise in data architecture, data warehousing, and large-scale data platforms. Strong knowledge of Data Mesh , database design, and ETL/ELT methodologies. Experience designing scalable, secure, and governed data solutions. Understanding of data security, compliance, and GDPR requirements. Excellent analytical and problem-solving abilities. ...

and modern data platform technologies. Expertise in data architecture, data warehousing, and large-scale data platforms. Strong knowledge of Data Mesh , database design, and ETL/ELT methodologies. Experience designing scalable, secure, and governed data solutions. Understanding of data security, compliance, and GDPR requirements. Excellent analytical and problem-solving abilities. ...

with C#, JavaScript or other languages advantageous) * Experience building software applications, automation workflows, and data-processing tools * Proficiency in designing and operating data pipelines, ETL workflows, and data-validation systems * Experience with cloud platforms such as AWS, Google Cloud or Azure * Data analysis skills including statistical evaluation, uncertainty analysis and ...

staff engineer role - Python and TypeScript/Node, with solid React/Next.js and NestJS/FastAPI experience - PostgreSQL, including schema design, query performance, ETL/ELT, and analytical workloads at scale - LLM/AI features shipped to production users, covering evals, guardrails, prompt versioning, and cost control - LangChain and ...

Data & Cloud SQL/NoSQL databases—Snowflake; cloud platforms: AWS (S3, RDS, Glue), Azure (ADLS, Purview), GCP (BigQuery) Data cataloguing tools—Collibra, Alation, Informatica ETL pipelines and data lineage concepts SIEM/DLP tools integration (Splunk, Microsoft Purview) Identity & Access Management basics (IAM, RBAC) Encryption, tokenization, data masking techniques Python ...

documentation. Understanding of data governance and compliance requirements. Knowledge of supply chain data structures and PLM systems highly desirable. Experience with data mapping and ETL processes. Proficiency in data analysis and ability to assess data quality and completeness. Personal attributes and qualities Client-focused mindset with strong relationship-building capabilities. ...

with enterprise applications, including relational databases (SQL Server/Oracle), data warehouses, OMS/EMS, risk, and portfolio systems. Strong technical skills: SQL, ETL, data modelling, stored procedures, data ingestion, messaging systems. Excellent communication skills: capable of consulting with business stakeholders and translating business requirements into robust technical specifications. Experience ...

deploying machine learning models, or getting involved with client pitches. What you'll be working on Building, optimising, and deploying price optimization machine learning ETL/ELT pipelines and data processes. Improving and adapting our data infrastructure and code base as we scale – including collaboration, security, scalability, efficiency, automation and ...

Microsoft's fastest-growing data platforms, this is a fantastic opportunity. You Will Work With Designing, building and maintaining scalable data pipelines. Developing ETL/ELT processes to ingest and transform data from multiple sources. Apache Airflow for workflow orchestration, scheduling and automation. Azure SQL and cloud-based data platforms. … Excellent opportunity for a Data Engineer looking to develop towards a more senior position over time. Key Experience Previous experience in a Data Engineer, ETL Developer or similar role. Strong SQL skills, ideally within Azure SQL or SQL Server environments. Experience building, maintaining and optimising data pipelines. Knowledge of ETL ...

and high-performing environment. Key responsibilities include: Designing and building enterprise-scale Microsoft Fabric solutions Creating Lakehouses, Data Warehouses and Semantic Models Developing robust ETL/ELT pipelines and real-time data integrations Designing and managing the OneLake architecture Establishing data governance, security and access controls Supporting Power BI, self … Microsoft Fabric expertise (Lakehouse, Warehouse, Pipelines, Notebooks) OneLake architecture and management Advanced SQL/T-SQL PySpark and Spark optimisation Data warehousing, modelling and ETL/ELT development Power BI semantic modelling Experience delivering enterprise cloud data platforms Experience integrating multiple business systems Strong stakeholder engagement and communication skills Ability ...

business-critical data initiatives within a complex global environment. Description Design, build and maintain scalable data pipelines using Python and Databricks Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake Create robust data models and data architectures within modern Lakehouse environments Implement and manage data workflows across … Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake Strong knowledge of Apache Spark/PySpark Experience designing and delivering large-scale ETL/ELT pipelines Advanced SQL skills and experience with relational databases Experience working with cloud technologies such as AWS, Azure or GCP Knowledge of modern ...

business scales. Responsibilities: Design, build, and deliver scalable cloud-based data platforms and data engineering solutions. Develop robust, high-performance data pipelines and modern ETL/ELT frameworks. Contribute to the architecture and technical design of secure, scalable, and resilient data platforms. Build and optimise cloud-native data solutions across … architecture and technical solution design. Strong programming skills in Python, Scala, or Java. Advanced SQL skills, including optimisation and performance tuning. Experience building modern ETL/ELT pipelines and distributed data processing solutions. Strong understanding of data warehousing, data modelling, and cloud-native architectures. Experience working with Infrastructure as Code ...

both greenfield initiatives and the enhancement of existing data capabilities. Key Responsibilities Design, build and maintain a modern cloud-based data platform. Develop scalable ETL/ELT pipelines to integrate data from multiple operational systems, ERP platforms and high-volume transactional sources. Build reliable, high-performance data solutions for reporting … both relational and NoSQL databases. Experience building cloud-based data platforms using Azure, AWS, GCP or similar. Strong Python experience. Solid understanding of ETL/ELT processes and modern data warehousing principles. Experience with dimensional modelling, data governance and data architecture. Experience with Power BI and DAX. Experience integrating ...

stakeholders to ensure successful delivery. Follow governance, security, and quality standards throughout project delivery. Your Skills: Understanding of Oracle Data Integration concepts. Knowledge of ETL (Extract, Transform, Load) processes and data integration practices. Strong analytical and problem-solving capabilities. Ability to work effectively within a team environment. Good communication and ...

stakeholders to ensure successful delivery. Follow governance, security, and quality standards throughout project delivery. Your Skills: Understanding of Oracle Data Integration concepts. Knowledge of ETL (Extract, Transform, Load) processes and data integration practices. Strong analytical and problem-solving capabilities. Ability to work effectively within a team environment. Good communication and ...

experience building production AI applications in a cloud environment Hands on expertise with LLMs, prompt engineering, and agent based workflows Data engineering capability, including ETL processes, orchestration, and working with large datasets Ability to design and deploy scalable, reliable systems Experience working with modern AI tooling and development workflows Strong ...

Experience handling large‐scale HPC clusters using Kubernetes and Slurm for job scheduling, resource allocation, and workload orchestration Data Engineering: Expertise with data pipelines, ETL systems, and large‐scale data processing frameworks Systems-Level Programming: Experience with low‐level systems programming such as storage systems, Kubernetes operators, OS-level software ...

support data transformation and integration initiatives that underpin critical business operations. Key Skills & Experience: Strong SQL Server and data manipulation experience. Proven expertise in ETL development using SSIS. Hands-on experience delivering data migration, conversion, and onboarding projects. Solid understanding of data quality, validation, and reconciliation. Strong analytical and problem ...

maintain service continuity while sharing knowledge Skills and experience: • Proven hands-on experience with the Quantexa platform• Strong data engineering background (pipelines, data modelling, ETL)• Experience with data profiling and optimisation techniques• Familiarity with APIs for data access and integration• Ability to work closely with stakeholders in a delivery-focused ...

and MI solutions within Lloyd's, London Market, MGA or Specialty Insurance . Advanced SQL Server, SSIS and SSRS skills. Experience developing and supporting ETL processes, data warehouses and reporting solutions . Understanding of data modelling, data quality and reconciliation. Knowledge of underwriting, claims, exposure or bordereaux data. Strong stakeholder ...