1 to 25 of 31 Permanent ETL Jobs in the South West

and/or AWS. Knowledge of authentication and authorisation technologies including SSO, OAuth, OpenID Connect and SAML. Experience with Power BI, data integration and ETL processes. Experience supporting data migration or modernisation initiatives. Awareness of AI-enabled applications, including LLMs and prompt engineering concepts. Knowledge of Docker and Kubernetes. Experience ...

data warehousing, data lakes, and lakehouse architectures. Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise ...

Looking For Commercial experience delivering Data Engineering solutions Strong Python and SQL skills, with experience of Java or Scala beneficial Experience building large-scale ETL/ELT and data processing pipelines Hands-on experience with Apache Spark and distributed data processing technologies Experience designing and operating cloud-native data platforms ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

looking for: 24 years' experience in data engineering Strong SQL, Python and DBT skills Experience with AWS and/or Databricks Experience building ETL/ELT pipelines and data warehouses Knowledge of AWS services such as S3, Lambda and Glue Familiarity with Git and infrastructure-as-code tools such ...

design, performance optimisation, and modelling best practices. • Hands-on experience designing and implementing Power BI datasets, dashboards, and paginated reports. • Proven track record delivering ETL pipelines, data warehousing, and modern visualisation platforms end-to-end. • Strong commercial acumen - the ability to translate data into decisions that drive growth, not just ...

lakehouse technologiesbased on business and technical requirements. End-to-End Data Flows: Architect operational and analytical data pipelines across APIs, streaming, CDC, batch and ETL/ELT, embedding data quality, lineage, metadata, security, testing and observability throughout. Technical Leadership & Delivery: Work closely with engineering and product teams in fast-paced ...

Engineering: Proficiency in SQL and relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). ...

candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing and peer review of ETL code in Oracle ODI and Snowflake Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing … when required. Adaptable, with a strong appetite for technical challenges and continuous learning. Minimum criteria Experience designing and building data warehouses/lakehouses using ETL/ELT tools, preferably Oracle ODI Strong database development experience with Snowflake, Oracle and/or PostgreSQL Strong understanding of dimensional modelling and star schema ...

data drift and performance degradation. Develop generative AI and large language model (LLM) systems, including retrieval augmented generation (RAG) and fine-tuning. Build scalable ETL/ELT pipelines using tools such as Spark or dbt, so data is high quality, time-stamped, and ready for both training and real-time ...

build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development ...

processing Provide technical leadership and guidance to cross-functional teams, ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large ...

M365 identity integration experience. AWS-hosted application or platform experience. API gateway, LDAP, directory services, data feeds and enterprise integration experience. Experience with microservices, ETL patterns, workflow engines or complex integration platforms. Experience of service transition, BAU readiness and operational handover. Experience modernising or simplifying legacy-to-cloud services. Familiarity ...

M365 identity integration experience. · AWS-hosted application or platform experience. · API gateway, LDAP, directory services, data feeds and enterprise integration experience. · Experience with microservices, ETL patterns, workflow engines or complex integration platforms. · Experience of service transition, BAU readiness and operational handover. · Experience modernising or simplifying legacy-to-cloud services. xehkeey ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission ...

QUALIFICATION Hands-on experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team ...

Hands-on experience with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team ...

Hands-on experience with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

help shape the growing architecture function. You will likely have the following skills/experience: Data architecture on Snowflake Strong SQL and ELT/ETL knowledge Strong understanding of data governance Stakeholder management, and communicating technical ideas to non-technical people Currently working as a Data Architect, or a Data ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity ...

responsibilities Lead and support data migration activities as part of a major business system implementation. Develop, rebuild and maintain data warehouse pipelines and ETL processes. Write, optimise and maintain complex SQL queries and stored procedures. Support data transformation, validation and reconciliation to ensure accuracy and consistency during migration. Develop and … developing and maintaining stored procedures. Experience working with relational databases, ideally Microsoft SQL Server and T-SQL. Experience with data warehouses, data pipelines and ETL processes. Previous involvement in data migration or system implementation projects. An understanding of data modelling, data quality, validation and reconciliation. Experience developing reports and dashboards ...

within complex technical environments. Requirements Key Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines for the ingestion, transformation and delivery of structured and unstructured data. Develop robust data processing workflows using Python and modern data engineering … engineering decisions. Skills & Experience: Significant commercial experience developing Python applications and services. Strong experience in data engineering, including the design and development of scalable ETL/ELT pipelines. Proven experience working with SQL, relational databases and large datasets. Experience with data processing technologies such as PySpark, Spark or Pandas. Strong ...

engineering challenges while developing your technical skills in a collaborative environment. What youll be doing Building, improving and maintaining data pipelines to extract, transform and load data. Developing reliable, high-quality data solutions using software engineering and DataOps best practices. Working with cloud services to host data infrastructure and manage … opportunities available across mid and senior levels. Strong technical skills in SQL and Python, or similar programming languages. Experience building and maintaining data pipelines and ETL processes. Understanding of data modelling, data management and orchestration. Experience with cloud platforms and data infrastructure. Knowledge of software engineering principles, CI/ ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

core of data delivery, designing and building robust data pipelines and platforms used across complex, secure environments. Key responsibilities: Design, build and maintain scalable ETL/ELT data pipelines Develop and optimise data integration and ingestion frameworks Model data structures, flows and architectures to support analytics and operational use cases … data governance, metadata management and security controls What theyre looking for Strong experience in Data Engineering (not just analysis) Hands-on with: Python, SQL, ETL/data pipeline tooling Experience working with large, complex datasets Understanding of data modelling, orchestration and data lifecycle management Exposure to cloud platforms (AWS) Mentoring ...