systems, enhancing CI pipelines for swift and secure deployments, and architecting a Python API to integrate data science models seamlessly. Operating within the GCP ecosystem, you'll harness Python, ETL pipelines and Datadog for observability. Furthermore, as a Senior, you will take the lead with regard to the architectural optimisation, directing how things should be done and championing best practices. More ❯
Work closely with clients and cross-functional teams. Mentor colleagues and contribute to capability building. What We're Looking For: Strong Snowflake cloud platform experience Experience in Python, scripting, ETL/ELT pipelines. 2+ years in Data & AI, ideally within consulting. Proven experience in client management, project leadership, and team collaboration. If you've got solid experience in Snowflake, andMore ❯
with the product team to provide customer feedback and contribute to the product roadmap Identify and document data types, rules, mapping, and conversion requirements Work with system integration andETL processes Coordinate and design system and user acceptance testing Maintain system documentation for internal and external use Identify and escalate deficiencies in technical work and implementation plans Participate in ongoing More ❯
supporting systems in production, especially in public or hybrid cloud environments Demonstrated ability to troubleshoot, monitor, and enhance large-scale systems Strong understanding of cloud architectures, service-oriented design, ETL frameworks, and security principles Capable of designing moderately complex systems and choosing appropriate technologies based on use cases Familiarity with compliance requirements and secure software design Effective communicator with the More ❯
innovation in overcoming challenges. 5+ years of professional experience in software engineering roles such as Data Engineer, DevOps Engineer, or Integration Engineer, utilizing modern back-end technologies. Experience with ETL tools such as SnapLogic, Boomi, or MuleSoft or experience building your own ETL pipelines. Experience building enterprise API Gateway solutions based around Rest or GraphQL. Experience with SQL, NoSQL or More ❯
environment - they'd love to meet you. 5 days on site | £30,000 per year What You'll Be Doing Assist our Data Engineer in developing Python scripts to extract, transform, and validate data against our MySQL database. Upload and structure data for our platform to support efficient reporting and analysis. Collaborate with stakeholders and our BI Analyst to understand … functionality, workflows, and changes clearly and consistently. Follow agile development principles and contribute to sprint planning and tracking. Participate in planning, designing and developing our future migration of automated ETL processing of our data on a chosen cloud platform. What We're Looking For Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field. Strong grasp of … testing using pytest Proficiency in SQL (we use MySQL, but experience with other SQL platforms is welcome). Experience with data manipulation and transformation using Pandas . Familiarity with ETL/ELT processes and data warehousing concepts. Understanding of cloud platforms (AWS or Azure). Basic knowledge of Git and GitHub for version control and collaboration. Awareness of best practices More ❯
environment - they'd love to meet you. 5 days on site | £30,000 per year What You'll Be Doing Assist our Data Engineer in developing Python scripts to extract, transform, and validate data against our MySQL database. Upload and structure data for our platform to support efficient reporting and analysis. Collaborate with stakeholders and our BI Analyst to understand … functionality, workflows, and changes clearly and consistently. Follow agile development principles and contribute to sprint planning and tracking. Participate in planning, designing and developing our future migration of automated ETL processing of our data on a chosen cloud platform. What We're Looking For Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field. Strong grasp of … testing using pytest Proficiency in SQL (we use MySQL, but experience with other SQL platforms is welcome). Experience with data manipulation and transformation using Pandas . Familiarity with ETL/ELT processes and data warehousing concepts. Understanding of cloud platforms (AWS or Azure). Basic knowledge of Git and GitHub for version control and collaboration. Awareness of best practices More ❯
infrastructure to ensure the reliability and efficiency of our data and systems used by our Machine Learning team. Your role will include creating and maintaining data pipelines that transformandload data from various products and managing the AWS infrastructure for our machine learning platform. Additionally, you will work with engineers, product managers, and data scientists to design and implement … privacy. In this role, you will Interact with product teams to understand how our safety systems interact with their data systems. Design and implement an automated end-to-end ETL process, including data anonymization, to prepare data for machine learning and ad hoc analysis. Manage and scale the tools and technologies we use to label data running on AWS. Devise … BSc or MSc in Computer Science/Software Engineering or related subject - candidates without a degree are welcome as long as they have extensive hands-on experience. Experience in ETL technical design, automated data quality testing, QA and documentation, data warehousing, and data modeling. Experience with Python for interaction with Web Services (e.g., Rest and Postman). Experience with using More ❯
Brackley, Northamptonshire, England, United Kingdom Hybrid / WFH Options
FRS Ltd
analysis and insights that directly influence strategic decisions and drive business growth, stepping away from routine month-end activities. Your Impact Will Include: Developing and deploying advanced queries to extract, process, and analyse data for actionable insights and dashboards. Interpreting complex data sets to uncover trends, identify anomalies, and reveal new business possibilities. Delivering evidence-based support for key strategic … or higher). Expertise in constructing complex SQL queries for data extraction. A flair for translating intricate data into compelling visual narratives. Understanding of data warehousing concepts andETL processes. Demonstrated ability to create effective dashboards and reports across various systems. Advanced proficiency in Microsoft Excel, with familiarity in data query tools (e.g., Access, SQL, Power BI). Familiarity with More ❯
Chesterfield, England, United Kingdom Hybrid / WFH Options
Brightwell
on experience of Power BI development including data modelling and report development using DAX and Power Query (M). The ability to build and improve complex SQL scripts to extract data from source systems (SQL Server). Working knowledge of Excel, PowerPoint and Word, with a high degree of competency in using them in the production of reports. Excellent numeric … or regulated industry. Desirable A basic knowledge and understanding of the range of services provided by capacity planning, business insight and quality assurance functions. Experience utilising R or Python. ETL experience with JSON API’s and building and maintaining SQL server stored procedures. Why Brightwell? As a Brightwell colleague, you will enjoy a competitive salary, hybrid work practices, professional development More ❯
Northampton, Northamptonshire, East Midlands, United Kingdom Hybrid / WFH Options
MND Association
database systems and processes. Strong SQL skills are essential. Confidence using automation tools like Power Query, Power Automate or similar. Familiarity with APIs or system integrations, and knowledge of ETL processes. Experience handling bulk data imports and reconciliation. A good understanding of GDPR and data management best practice. Excellent communication and interpersonal skills. The ability to manage competing priorities in … decision-making skills Strong ability to automate data processes using SQL, Power Query, Power Automate, or other tools and experience of working with APIs or system integrations. Knowledge of ETL processes and data flows with an appreciation for best practice. Important Information: We may close applications early if we receive a high volume, so early submissions are encouraged. If you More ❯
Employment Type: Contract, Part Time, Work From Home
London, South East, England, United Kingdom Hybrid / WFH Options
WüNDER TALENT
on cutting-edge data pipelines, cloud-native platforms and real-time data flows in a collaborative, forward-thinking environment. You’ll be involved in designing and building production-grade ETL pipelines, driving DevOps practices across data systems and contributing to high-availability architectures using tools like Databricks, Spark and Airflow- all within a modern AWS ecosystem. Responsibilities Architect and build … scalable, secure data pipelines using AWS, Databricks and PySpark. Design and implement robust ETL/ELT solutions for both structured and unstructured data. Automate workflows and orchestrate jobs using Airflow and GitHub Actions. Integrate data with third-party APIs to support real-time marketing insights. Collaborate closely with cross-functional teams including Data Science, Software Engineering and Product. Champion best More ❯
re looking for a Data Engineer to work as part of our Engineering team in London. We design, develop and operate all data systems across the company. This includes ETL, our data warehouses, real-time click streams, and EMR to support personalisation of content to our users. We are looking for someone to help us as we continue to evolve … years of relevant data engineering experience Strong Python and SQL skills Experience with dbt Experience with AWS Experience working with a columnar database such as Redshift Strong Experience with ETL/ELT and the management of data pipelines Familiarity with snowplow Experience with Data Integration from a variety of sources Good cross-team communication skills Familiarity with continuous integration, unit … testing tools and related practices Understanding of Agile Scrum software development lifecycle What you'll be doing: Implementing and maintaining ETL pipelines using Airflow & AWS technologies Contributing to data-driven tools owned by the data engineering team, including content personalisation Responsibility of ingestion framework and processes Helping monitor and look after our data infrastructure in AWS Supporting our Business Analytics More ❯
a week - this is usually on Tuesdays and Thursdays but can be subject to change. Strong benefits package This role focuses on the development, performance, management, and troubleshooting of ETL processes, data pipelines, and data infrastructure. The successful candidate will ensure the effective and reliable operation of these systems, adopting new tools and technologies to stay ahead of industry best … practices. Collaboration across teams to define solutions, requirements, and testing approaches is essential, as is ensuring compliance with regulatory standards.Key Responsibilities:- Design, develop, maintain, and optimise data pipelines, ETL processes, and databases.- Drive continuous improvement by refining processes and identifying new tools and standards.- Collaborate with cross-functional teams to define solutions and testing approaches.- Ensure compliance with regulatory requirements More ❯
ll be working on SAP datacentric data and analytics solutions, ensuring seamless integration with cloud platforms like Snowflake and Databricks. You'll also be designing efficient data models andETL processes. Working with SAP data extractors This will include BW extractors and CDS views and table extractors to integrate data into target platforms. Internal team development & progression You'll champion … challenges A strong desire to learn and share knowledge Ideally, you'll also have Certification for at least one non-SAP data platform, ideally Snowflake or Databricks Knowledge of ETL tools like SAP Data Services, Matillion, Fivetran or SNP Glue Hands-on experience with data visualisation tools such as Power BI (including data modelling and extraction) Hands-on experience with More ❯
could pragmatically deliver value . Manage and monitor the cost, efficiency, and speed of data processing. Our Data Tech Stack Azure Cloud (SQL Server, Databricks, Cosmos DB, Blob Storage) ETL/ELT (Python, Spark, SQL) Messaging (Service Bus, Event Hub) DevOps (Azure DevOps, Github Actions, Terraform) Who you are A driven, ambitious individual who’s looking to build their career … fast-growing company that’s trying to make a positive mark on the world. Essential skills Designing, building and maintaining robust and scalable data pipelines Proficiency in ELT andETL processes and tools Ability to write efficient code for data extraction, transformation, and loading (eg. Python, Spark and SQL) Proficiency with cloud platforms (particularly Azure Databricks and SQL Server) Ability More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Oscar Technology
Role - BI Developer Skills - Azure/ETL/SQL Location -Remote Salary - Up to £50,000 + 10% Bonus Summary This long-established company are looking for a BI Developer to join their team on a permanent basis. Your work would involve ETL processes for data integration, working with stakeholders to understand business needs, and optimizing database queries. The role … strategic business goals. Design and develop the architecture and infrastructure of the Business Intelligence system, including data warehouse structure, data integration processes and data modelling techniques. Implement and optimise Extract, Transform, Load (ETL) processes for integrating data from various sources into the data warehouse. Monitor system performance, identify bottlenecks, and optimise database queries for improved system efficiency. Collaborate with stakeholders … guidance to ensure the BI system meets the organisation's needs. Mentor and provide leadership to your junior team members. Technical Requirements Knowledge of Business Intelligence - Data Warehouse methodology, ETL, etc. Cloud Solutions in Azure SQL and Relational Databases DataBricks experience is highly advantageous Benefits Performance Bonus Generous Annual Leave allowance Buy and Sell Holiday scheme Medical coverage Life insurance More ❯
Greater Manchester, England, United Kingdom Hybrid / WFH Options
Oscar
Role – BI Developer Skills – Azure/ETL/SQL Location –Remote Salary – Up to £50,000 + 10% Bonus Summary This long-established company are looking for a BI Developer to join their team on a permanent basis. Your work would involve ETL processes for data integration, working with stakeholders to understand business needs, and optimizing database queries. The role … strategic business goals. Design and develop the architecture and infrastructure of the Business Intelligence system, including data warehouse structure, data integration processes and data modelling techniques. Implement and optimise Extract, Transform, Load (ETL) processes for integrating data from various sources into the data warehouse. Monitor system performance, identify bottlenecks, and optimise database queries for improved system efficiency. Collaborate with stakeholders … guidance to ensure the BI system meets the organisation's needs. Mentor and provide leadership to your junior team members. Technical Requirements Knowledge of Business Intelligence – Data Warehouse methodology, ETL, etc. Cloud Solutions in Azure SQL and Relational Databases DataBricks experience is highly advantageous Benefits Performance Bonus Generous Annual Leave allowance Buy and Sell Holiday scheme Medical coverage Life insurance More ❯
years of experience with NoSQL databases like Bigtable, Cassandra, HBase, etc. Experience with schema design and data modeling. Strong understanding of large-scale distributed data processing. Experience with developing extract-transform-load (ETL). Experience with distributed messaging systems like Kafka and RabbitMQ. Experience with distributed computing frameworks like Apache Spark and Flink. Bonus Points Experience working with AWS or More ❯
priorities. Manage & implement the building of resilient Data Models and robust design of data marts to support reporting and analytical requirements. Manage the creation & development of end-to-end ETL routines using Pentaho, SQL, EDQ and PLSQL. Provide technical expertise to the team for Data Warehouse design, development, and implementation. Manage the embedding of best practice and continual improvement for … jobs into production. Identify areas of innovation in future technology changes. Manage the loading of data files & implement strategies that ensure business requirements are met. Manage the fixing of ETLload failures as a matter of priority to make sure that the DWH is up and running as soon as possible. Manage & implement strategies for the monitoring of all ETL … Data Warehouse capability. Mange & review the EDQ data quality outputs and inform Data Quality team accordingly to resolve any issues. Manage the planning of regular maintenance of DWH structure & ETL routines to prevent redundancy & keep the DWH running efficiently. Ensure the daily monitoring of Landing Database to ensure regular feed of external data from suppliers. Engage with Data Architecture team More ❯
innovation in overcoming challenges. 5+ years of professional experience in software engineering roles such as Data Engineer, DevOps Engineer, or Integration Engineer, utilizing modern back-end technologies. Experience with ETL tools such as SnapLogic, Boomi, or MuleSoft or experience building your own ETL pipelines. Experience building enterprise API Gateway solutions based around Rest or GraphQL. Experience with SQL, NoSQL or More ❯
recent graduate to kick-start their career in data engineering within a supportive and collaborative environment. Key Responsibilities: Assist in the design, development, and maintenance of data pipelines andETL processes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs. Work with large datasets to extract, clean, andtransform data More ❯
client agreements. This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability. Key responsibilities Design and build robust ETL pipelines using Python and AWS services Own and maintain Airflow workflows More ❯
and problem-solving abilities Bring thought leadership to your area of responsibility and enjoy staying ahead in your field You possess the following skills and experiences: Solid understanding of ETL tooling to perform data transformation tasks Strong understanding of data design principles and dimensional data modeling Advanced SQL skills and understanding of query optimization strategies Preferred skills and experience across … the following; ETL Tools –Informatica IICS, Unix/Linux Shell Scripting, SQL Server & Stored Procedures (SSMS), SSMA (SQL Server Migration Assistant), GitHub, API Integration, Alteryx, Data Visualization, Automation & Scheduling, Documentation & Communication What’s Next? If you have the skills and passion to take on this DATA ENGINEER position then APPLY NOW for immediate consideration. More ❯
Employment Type: Permanent
Salary: £60000 - £67000/annum Hybrid, Great Benefits
and problem-solving abilities Bring thought leadership to your area of responsibility and enjoy staying ahead in your field You possess the following skills and experiences: Solid understanding of ETL tooling to perform data transformation tasks Strong understanding of data design principles and dimensional data modeling Advanced SQL skills and understanding of query optimization strategies Preferred skills and experience across … the following; ETL Tools –Informatica IICS, Unix/Linux Shell Scripting, SQL Server & Stored Procedures (SSMS), SSMA (SQL Server Migration Assistant), GitHub, API Integration, Alteryx, Data Visualization, Automation & Scheduling, Documentation & Communication What’s Next? If you have the skills and passion to take on this DATA ENGINEER position then APPLY NOW for immediate consideration. More ❯