1 to 25 of 48 ETL Jobs in the South West

and/or AWS. Knowledge of authentication and authorisation technologies including SSO, OAuth, OpenID Connect and SAML. Experience with Power BI, data integration and ETL processes. Experience supporting data migration or modernisation initiatives. Awareness of AI-enabled applications, including LLMs and prompt engineering concepts. Knowledge of Docker and Kubernetes. Experience ...

ensure data quality while creating and maintaining optimal data pipelines. Preferred QualificationsAdvanced Pipeline Engineering: Advanced expertise in designing, building, and optimizing scalable data pipelines, ETL/ELT workflows, and distributed data processing frameworks. Reporting & Visualization: Experience designing and creating reporting and visualization solutions to communicate data insights and directly link ...

data warehousing, data lakes, and lakehouse architectures. Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience ...

reporting efficiencyWhat You'll BringExperience in data engineering, analytics, or a related roleExperience with BI tools (e.g. Power BI)Understanding of data pipelines and ETL processesAbility to work with stakeholders to deliver actionable insightsA proactive approach to problem-solving and continuous improvementExposure to data science workflows or advanced analyticsKnowledge ...

Looking For Commercial experience delivering Data Engineering solutions Strong Python and SQL skills, with experience of Java or Scala beneficial Experience building large-scale ETL/ELT and data processing pipelines Hands-on experience with Apache Spark and distributed data processing technologies Experience designing and operating cloud-native data platforms ...

data architecture, strategy, and engineering principles, both from a hands-on and leadership perspective. Strong familiarity with enterprise data warehousing — dimensional/semantic modeling, ETL, SQL performance tuning, and warehouse platforms (e.g., SAP BW, Progress, Snowflake, Synapse, or similar).Hands-on experience building and delivering solutions in Databricks, including working ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot data issues and ensure solutions are secure, scalable and ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

looking for: 24 years' experience in data engineering Strong SQL, Python and DBT skills Experience with AWS and/or Databricks Experience building ETL/ELT pipelines and data warehouses Knowledge of AWS services such as S3, Lambda and Glue Familiarity with Git and infrastructure-as-code tools such ...

design, performance optimisation, and modelling best practices. • Hands-on experience designing and implementing Power BI datasets, dashboards, and paginated reports. • Proven track record delivering ETL pipelines, data warehousing, and modern visualisation platforms end-to-end. • Strong commercial acumen - the ability to translate data into decisions that drive growth, not just ...

lakehouse technologiesbased on business and technical requirements. End-to-End Data Flows: Architect operational and analytical data pipelines across APIs, streaming, CDC, batch and ETL/ELT, embedding data quality, lineage, metadata, security, testing and observability throughout. Technical Leadership & Delivery: Work closely with engineering and product teams in fast-paced ...

based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners to translate business requirements into technical specifications and solution designs that satisfies the data ...

Engineering: Proficiency in SQL and relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). ...

teams to influence data strategy and architecture. Required Experience Strong hands-on experience building and operating production-grade data platforms. Expertise in data architecture, ETL/ELT pipelines, data modelling and orchestration. Experience working with large-scale or complex datasets. Background delivering analytics and business intelligence solutions. Experience designing secure ...

data drift and performance degradation. Develop generative AI and large language model (LLM) systems, including retrieval augmented generation (RAG) and fine-tuning. Build scalable ETL/ELT pipelines using tools such as Spark or dbt, so data is high quality, time-stamped, and ready for both training and real-time ...

data drift and performance degradation. Develop generative AI and large language model (LLM) systems, including retrieval-augmented generation (RAG) and fine-tuning. Build scalable ETL/ELT pipelines using tools such as Spark or dbt, ensuring data is high quality, time-stamped and ready for both training and real-time ...

Data Engineering and cloud platforms. Key skills and responsibilities: Strong proficiency in Python Extensive experience with cloud platformsExperience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworksSoftware development best practicesContainerisation toolsExperience with Infrastructure as Code toolsStrong understanding of data modelling and ...

processing Provide technical leadership and guidance to cross-functional teams, ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large ...

build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development ...