1 to 25 of 133 ETL Jobs in the South East

drift, and anomalies using Azure Monitor or other observability tools.* Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. More ❯

organisation to recruit a Junior Data Engineer. Hybrid working - London based Role The Junior Data Engineer will assist in the design, development, and maintenance of scalable data pipelines and ETL/ELT processes in Azure. Write efficient and reliable SQL queries for data extraction, transformation, and analysis. Support data integration from various sources (internal systems, third-party vendors) into centralised More ❯

discuss how your expertise could strengthen our growing data practice. As a data engineer/scientist, you will: Data Engineering Focus: Design, implement, and maintain scalable data pipelines and ETL processes Develop and maintain data warehouses and data lakes Implement data quality monitoring and validation systems Create and maintain data documentation and cataloguing systems Optimize data storage and retrieval systems More ❯

initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding of statistical analysis and predictive modelling Experience More ❯

initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding of statistical analysis and predictive modelling Experience More ❯

error handling strategies. Optional scripting skills for creating custom NiFi processors. Programming & Data Technologies: Proficiency in Java and SQL. Experience with C# and Scala is a plus. Experience with ETL tools and big data platforms. Knowledge of data modeling, replication, and query optimization. Hands-on experience with SQL and NoSQL databases is desirable. Familiarity with data warehousing solutions (e.g., Snowflake More ❯

error-handling strategies. Optional scripting skills for creating custom NiFi processors. Programming & Data Technologies: Proficiency in Java and SQL. Experience with C# and Scala is a plus. Experience with ETL tools and big data platforms. Knowledge of data modeling, replication, and query optimization. Hands-on experience with SQL and NoSQL databases is desirable. Familiarity with data warehousing solutions (e.g., Snowflake More ❯

and management Proficient SQL and/or Python capabilities - minimum 2-3 years hands-on experience Comprehensive Data Engineering background - proven track record in enterprise data solutions Experience with ETL processes and data transformation, preferably using Databricks Strong foundation in Data Warehousing architectures and dimensional modeling Familiarity with batch processing from relational database sources Communication & Collaboration Skills of the Data More ❯

knowledge of Microsoft Fabric, Azure Data Factory, Power BI, and related Azure tools Strong proficiency in SQL, Spark SQL, and Python for data processing and automation Solid understanding of ETL/ELT workflows, data modelling, and structuring datasets for analytics Experience working with large, complex datasets and APIs across formats (CSV, JSON, Parquet, etc) Familiarity with workflow automation tools (eg More ❯

frameworks, regulatory compliance (e.g., GDPR, CCPA), and data security best practices. Proven experience in enterprise-level architecture design and implementation. Hands-on knowledge of database systems (SQL/NoSQL), ETL/ELT processes, and data modeling techniques. Exceptional leadership, communication, and stakeholder management skills. Ability to work in fast-paced, agile environments and balance long-term strategy with short-term More ❯

build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders More ❯

that support decision-making. 2+ years using Business Intelligence tools (Power BI essential; Looker is a plus but not required). Strong SQL skills and a solid understanding of ETL processes and data pipelines. Experience working with data platforms (e.g., Snowflake , Azure, AWS ) is highly desirable. Exposure to or interest in the financial services, or purpose-driven sectors is a More ❯

vibrant organisation. What You'll Do: Coding DAX Measures and Dimensional Models Developing & delivering visually compelling Power BI Dashboards & Reports to specification Developing and maintaining SSRS reports Developing & maintaining ETL pipeline solutions in Azure Data Factory and SSIS, utilising Azure Data Lake & Dev Ops Providing second & third line support for Data Team and own allocated support tickets Monitoring the Data More ❯

Experience Expertise in cloud platforms: Azure : Data Factory, Synapse, Monitor, ARM GCP : BigQuery, Dataflow, Cloud Composer, Pub/Sub Strong knowledge of data warehousing, storage, and modelling Experience with ETL/ELT processes and performance tuning Hands-on scripting (Python, PowerShell) for automation Familiarity with CI/CD tools (Azure DevOps, GitHub Actions) Infrastructure as Code: Terraform, ARM templates Working More ❯

technologies (Azure, AWS, GCP) and tools like Databricks, Snowflake, Synapse. Shape cloud migration and modernization strategies with a strong focus on DevOps practices. Architect scalable data models and robust ETL/ELT pipelines using industry-standard frameworks. Implement data governance and quality frameworks to ensure data integrity and compliance. Collaborate with clients’ senior leadership to influence data-driven transformation initiatives. More ❯

and DevOps practices related to database development. Desirable Skills: Experience working with legal systems and understanding the data requirements within the legal industry. Knowledge of data warehousing concepts and ETL processes. Experience with automation and scripting (e.g., PowerShell) for database management tasks. Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience). More ❯

Fabric or expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication and stakeholder management skills, with the ability to explain complex technical concepts to non-technical audiences. A proactive, client-focused mindset with More ❯

Fabric or expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication and stakeholder management skills, with the ability to explain complex technical concepts to non-technical audiences. A proactive, client-focused mindset with More ❯

Fabric or strong expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience with Power BI and DAX, and ideally some exposure to Notebooks, Pipelines, or Lakehouses within Fabric. Strong communication and stakeholder management More ❯

Relevant Microsoft certifications in Dynamics 365 and/or Power Platform. Experience working in agile delivery environments, particularly at scale. Knowledge of SSRS, FetchXML, SSIS, or other reporting and ETL tools. Experience with Power Pages (Portals) and customer-facing apps. Familiarity with data compliance standards (e.g., GDPR) and security models within Dynamics. Soft Skills & Traits A confident problem-solver with More ❯

Relevant Microsoft certifications in Dynamics 365 and/or Power Platform. Experience working in agile delivery environments, particularly at scale. Knowledge of SSRS, FetchXML, SSIS, or other reporting and ETL tools. Experience with Power Pages (Portals) and customer-facing apps. Familiarity with data compliance standards (e.g., GDPR) and security models within Dynamics. Soft Skills & Traits A confident problem-solver with More ❯

implementing data engineering best-practice (e.g., source-to-target mappings, coding standards, data quality, etc.), working closely with the external party who setup the environment . Create and maintain ETL processes, data mappings & transformations to orchestrate data integrations. Ensure data integrity, quality, privacy, and security across systems, in line with client and regulatory requirements. Optimize data solutions for performance and … up monitoring and data quality exception handling. Strong data modelling experience. Experience managing and developing CI/CD pipelines. Experience with Microsoft Azure products and services, and proficiency in ETL processes. Experience of working with APIs to integrate data flows between disparate cloud systems. Strong analytical and problem-solving skills, with the ability to work independently and collaboratively. The aptitude More ❯

patterns, and data quality issues. Collaborate with cross-functional teams to define data needs and deliver insights. Build dashboards and reports using tools like Power BI or Tableau. Support ETL workflows and contribute to data pipeline development. Ensure accuracy and consistency of data throughout transformation. Present findings clearly to both technical and non-technical stakeholders. Play a key role in More ❯

data warehouses and ensuring data quality on GCP Strong hands-on experience with BigQuery, Dataproc, Dataform, Composer, Pub/Sub Skilled in PySpark, Python and SQL Solid understanding of ETL/ELT processes Clear communication skills and ability to document processes effectively Desirable Skills: GCP Professional Data Engineer certification Exposure to Agentic AI systems or intelligent/autonomous data workflows More ❯

Fabric or expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication and stakeholder management skills, with the ability to explain complex technical concepts to non-technical audiences. A proactive, client-focused mindset with More ❯