1 to 25 of 85 ETL Jobs in the South West

Engineer high‐performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

Engineer high-performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

data requirements across complex environments. Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness. Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data. Develop and maintain scalable data pipelines to support analytics and operational decision-making. Implement ...

Initial 6 months + extensions. Job Purpose: The BI Engineer will be responsible for the requirements analysis and design of solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL … data warehouses. Collaborate with data visualization and analysts' teams to understand data requirements and translate them into technical specifications. Data Processing: Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure. Optimize data processing and storage for performance and cost-effectiveness. ...

complex environments. Broad understanding of modern data technology domains, including: Cloud data platforms (Azure, AWS, GCP). Data lakes, warehouses and lakehouse architectures. ETL/ELT processes and tooling. Streaming and event‐driven architectures. API‐led integration and data virtualisation. Understanding of data security‐by‐design, privacy, compliance and governance ...

Looking For Commercial experience delivering Data Engineering solutions Strong Python and SQL skills, with experience of Java or Scala beneficial Experience building large-scale ETL/ELT and data processing pipelines Hands‐on experience with Apache Spark and distributed data processing technologies Experience designing and operating cloud-native data platforms ...

advanced analytics and intelligence operations. What you'll be doing: Develop, optimise, and support scalable data pipelines (batch and streaming) within secure environments. Manage ETL/ELT processes for diverse datasets, ensuring data quality, lineage, and governance. Collaborate with technical and business teams to translate complex requirements into effective data ...

multi-functional teams. A strategic approach to problem-solving and technical decision-making. Core Areas (must have): Strong Python and SQL skills Experience with ETL flows, data pipelines, and orchestration tools Understanding of database architecture (SQL and NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/ ...

skills and a good understanding of relational databases Proven Snowflake and AWS skills Experience with data modelling and data transformation concepts Understanding of ETL/ELT pipelines and data warehousing principles Strong analytical and problem-solving skills Excellent communication and stakeholder engagement skills #JuniorDataEngineer #DataEngineering #AWS #Snowflake #dbt #Analytics #RemoteWorking ...

skills and a good understanding of relational databases Proven Snowflake and AWS skills Experience with data modelling and data transformation concepts Understanding of ETL/ELT pipelines and data warehousing principles Strong analytical and problem-solving skills Excellent communication and stakeholder engagement skills #JuniorDataEngineer #DataEngineering #AWS #Snowflake #dbt #Analytics #RemoteWorking ...

skills and techniques to effectively transform unstructured data and present it back in an informative fashion. Apply knowledge of data cleansing, Exact, Transform, Load (ETL) processes, database design, application, and visualization tools. Engage with clients to gather requirements and present findings in a clear and compelling way. Develop and maintain ...

business and technical stakeholders. Key Responsibilities Design scalable, secure and high-performance GCP/BigQuery data architectures Lead migration of Legacy data warehouses and ETL workloads to GCP Define end-to-end architecture across ingestion, transformation, storage, governance and reporting Design and optimise BigQuery schemas, partitioning, clustering, performance and cost ...

enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to ML training and prediction. The data team at OEV is growing at speed. We have invested time and resources on establishing a core data platform ...

skills. Desirable Skills Experience supporting applications hosted within Microsoft Azure. Azure DevOps and CI/CD pipeline exposure. Power Platform. Logic Apps. SSIS and ETL processes. Oracle databases. Experience supporting integrations with third-party systems. Experience working within public sector environments. Microservices architecture. ITIL Foundation certification. Microsoft Azure certifications. Security ...

skills. Desirable Skills Experience supporting applications hosted within Microsoft Azure. Azure DevOps and CI/CD pipeline exposure. Power Platform. Logic Apps. SSIS and ETL processes. Oracle databases. Experience supporting integrations with third-party systems. Experience working within public sector environments. Microservices architecture. ITIL Foundation certification. Microsoft Azure certifications. Security ...

data pipelines, optimizing data storage and processing, and enabling data-driven decision-making across the organization. This role requires expertise in Azure data services, ETL/ELT processes, database technologies, and cloud-based data architectures. Your role Design, develop, and maintain scalable data pipelines and integration solutions on Azure. Build … and optimize ETL/ELT processes using Azure Data Factory, Databricks, and Synapse Analytics. Manage and enhance data lakes, data warehouses, and data storage solutions. Develop and optimize SQL queries, data models, and database objects for performance and scalability. Ensure data quality, security, governance, and compliance with organizational standards. Implement ...

design, performance optimisation, and modelling best practices. Hands-on experience designing and implementing Power BI datasets, dashboards, and paginated reports. Proven track record delivering ETL pipelines, data warehousing, and modern visualisation platforms end-to-end. Strong commercial acumen - the ability to translate data into decisions that drive growth, not just ...

verbal communication skills Great attention to detail Excellent organisational skills. Strong analytical and problem-solving abilities Experience using Microsoft packages, including Excel Knowledge of ETL tools and data pipelines, SQL, Java and GitHub is required Applicants should be educated to degree level or possess solid work experience in related field. ...

based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event‐driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners to translate business requirements into technical specifications and solution designs that satisfies the data ...

based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners to translate business requirements into technical specifications and solution designs that satisfies the data ...

engineers. Operating at true enterprise scale across multiple environments and subject area communities, you will bring deep expertise in Python and SQL data engineering, ETL, cloud data platforms and orchestration at scale. Working with TA&I sponsors and Technology product owners, you will define, design and implement the data engineering … using advanced Python (Pandas, web scraping and machine learning libraries), SQL (including advanced optimisation techniques) and Apache Airflow. Lead the extraction, transformation and loading (ETL) of large and complex datasets, including time series data, from various sources (web APIs, databases, real-time streams). Leverage Generative AI platforms and frameworks ...

machine learning, and business analytics Practical experience in coding languages eg.?Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg.?SQL, ETL, No-SQL, DW, and Big Data technologies eg.?pySpark, Hive, etc. Experienced working with structured and also unstructured data eg.?Text, PDFs, jpgs, call recordings ...

Home/Malvern (onsite 3 days a week) Rate: £550 - £600 per day (Inside IR35) Skills: SC Clearance, Python, SQL, Databricks, AWS, Data Engineering, ETL/ELT, Data Pipelines We are looking to recruit an SC Cleared Data Engineer for a leading technology consultancy to join a long-term Central ...

data scientists and consultants on projects tackling real-world challenges. From a technical perspective, we're looking for someone comfortable with: Building and maintaining ETL pipelines and integrations Working with SQL and Python ( R is a bonus) Experience working with AWS or Azure Supporting analytical workflows and collaborating with data ...

areas. Current demand Cloud, DevOps & Platform Engineering - AWS/Azure, Terraform, Kubernetes, CI/CD, Linux, automation, DevSecOps and SRE Data Engineering - Python, SQL, ETL/ELT, modern cloud data platforms, Spark/Databricks and data architecture AI & Machine Learning - ML Engineering, MLOps, Python, model deployment, evaluation, LLM/GenAI ...