76 to 100 of 518 Data Engineer Jobs in the UK

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that supports … their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. … Implement data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge fund industry. Technical Skills: Proficiency in Python and more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team is committed to … transforming data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you thrive on enhancing infrastructure scalability … and designing sophisticated data architectures, then this role is perfect for you! Responsibilities Design Data Architecture: Spearhead the development of an event-driven operational data architecture. Optimize Infrastructure: Ensure the scalability and reliability of our data pipelines and infrastructure. Advance Data Privacy: Strengthen our data more »

Security Check clearance. For further information, please see Selection Process details.We’re happy to speak about any reasonable adjustments you need.Are you an expert Data Engineer looking to use your technical knowledge and experience in a different way?Are you passionate about building and supporting data engineering … in their lives. We’re carrying out a once-in-a-generation digital transformation - a task of size and scale unmatched elsewhere. As the Data Engineer Head of Role, you will lead the Data Engineer profession across DWP Digital. You will be an expert Data Engineer practitioner with broad industry experience who can define and assure best practice while influencing, steering, building capability and mentoring others.If you have extensive data engineering experience and have built and led a community of practice, we’d love to hear from you.Job descriptionAs Head of Role more »

Security Check clearance. For further information, please see Selection Process details.We’re happy to speak about any reasonable adjustments you need.Are you an expert Data Engineer looking to use your technical knowledge and experience in a different way?Are you passionate about building and supporting data engineering … in their lives. We’re carrying out a once-in-a-generation digital transformation - a task of size and scale unmatched elsewhere. As the Data Engineer Head of Role, you will lead the Data Engineer profession across DWP Digital. You will be an expert Data Engineer practitioner with broad industry experience who can define and assure best practice while influencing, steering, building capability and mentoring others.If you have extensive data engineering experience and have built and led a community of practice, we’d love to hear from you.Job descriptionAs Head of Role more »

Security Check clearance. For further information, please see Selection Process details.We’re happy to speak about any reasonable adjustments you need.Are you an expert Data Engineer looking to use your technical knowledge and experience in a different way?Are you passionate about building and supporting data engineering … in their lives. We’re carrying out a once-in-a-generation digital transformation - a task of size and scale unmatched elsewhere. As the Data Engineer Head of Role, you will lead the Data Engineer profession across DWP Digital. You will be an expert Data Engineer practitioner with broad industry experience who can define and assure best practice while influencing, steering, building capability and mentoring others.If you have extensive data engineering experience and have built and led a community of practice, we’d love to hear from you.Job descriptionAs Head of Role more »

Security Check clearance. For further information, please see Selection Process details.We’re happy to speak about any reasonable adjustments you need.Are you an expert Data Engineer looking to use your technical knowledge and experience in a different way?Are you passionate about building and supporting data engineering … in their lives. We’re carrying out a once-in-a-generation digital transformation - a task of size and scale unmatched elsewhere. As the Data Engineer Head of Role, you will lead the Data Engineer profession across DWP Digital. You will be an expert Data Engineer practitioner with broad industry experience who can define and assure best practice while influencing, steering, building capability and mentoring others.If you have extensive data engineering experience and have built and led a community of practice, we’d love to hear from you.Job descriptionAs Head of Role more »

Data Engineer London (hybrid working) £up to £68,000 A leading financial organisation based in London is currently looking to recruit a Data Engineer to join a growing machine learning team ideally with a strong track record of data modelling, developing, and delivering large scale … data transformation project aligned with the overarching Data Strategy. The successful data engineer will define, develop, and deliver data transformations that not only drives our Machine learning models but create more strategic transformation that delivers consistent data across the organisation for the various business … needs. Key responsibilities Delivering data transformation based on the overarching data strategy Design, development and maintenance of Data transformation pipelines aligning with Data Strategy. Test driven development, clean code and documentation Delivering on agreed service levels, which you'll agree with your manager - and your contribution more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and SQL. You … will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has many hands-on aspects, along with more »

TL;DR 🧢 Role | Senior Data Engineer 💫 Company | InsurTech, Scale-up, Data 📏 Size | c.100 🎯 Areas | Data Pipelines, ETL, Cloud Infra, DataOps, Data Models, Machine Learning ✨ Tech | Python, ETL, SQL (all flavours), GCP 📍 Based | London (Zone 1) 💻 Hybrid | 2 days a week in-office 💰 Offer | Up to … over half a billion $ in funding. 2024 is the year they 10x their client base. That's where you come in... 💥 As a Senior Data Engineer you will: be designing and developing complex data processing modules ranging from ETL to ML, working closely with the firm's … core algo team, who are developing the machine learning models that underpin the value my client provides to its customers collaborate with data scientists and engineers to design, build, optimise and maintain production grade data pipelines to feed the company's core algos create frameworks, infrastructure and systems more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data more »

Job Title: Data Engineer Role Type: Permanent Location: Hybrid (Birmingham) Role Overview As the Data Engineer, you will be responsible for managing a team of data engineers, analysts and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role in guiding the team, developing curated business models, and utilizing Azure services to optimize our data infrastructure. Key Responsibilities Provide leadership, guidance, and support to team members, ensuring the successful execution of projects and tasks. Mentor and support the wider business … including Business Intelligence teams, to leverage data for decision-making using PowerBI and other Microsoft tools. Collaborate with cross-functional teams to achieve common business goals. Develop and maintain curated business models to support accurate and insightful decision-making. Utilize SSRS, SSAS, and SSIS to design, develop, and implement more »

Senior Data Engineer Location: London (2 days a week in office) Salary: £75k - £90k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation … cutting-edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: • Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration … across various systems. • Utilize Python for data manipulation, transformation, and automation tasks. • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. • Implement data pipelines and workflows to support real-time and batch data processing. • Optimize database performance more »

Lead Data Engineer Location: London Salary: £90k - £105k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Lead Data Engineer to join their dynamic team. The company prides itself on fostering innovation and utilizing cutting-edge technology to … drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various systems. Utilize … Python for data manipulation, transformation, and automation tasks. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. Implement data pipelines and workflows to support real-time and batch data processing. Optimize database performance, including tuning queries and more »

Your new company A high-Profile Emergency Organisation based in London Your new role Data Engineer - NPPV3 Cleared What you'll need to succeed Our client is looking for an experienced Data Engineer to join the Data Analytics Platform Project team. The successful candidate will … be detail-oriented, with excellentOrganisational skills and experience as a Data Engineer for Analytics Platforms. Successful candidates will need to hold a valid and active Warwickshire NPPV3 clearance. Requirements: Previous experience as a data engineer, ideally in the policing sector or similar Technical expertise with data models, data mining, and segmentation techniques Experience of Architecting and implementing Azure Services e.g. Azure cloud services, Azure storage, IIS, Azure Active Directory (AD), Azure Resource Manager (ARM), Azure Storage, Azure, Blob Storage, Azure VMs, SQL Database, Azure Functions, Azure Service Fabric, Azure Monitor, and Azure Service Bus more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the … design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable … and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing more »

Job Title: Junior Data Engineer Location : London (Anywhere in UK) Pay Rate : £150/Day We are looking to hire a Junior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS. You will work closely with … senior data engineers, data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data storage solutions. … Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue, AWS Lambda, and AWS Data Pipeline. Data Storage Management : Manage and optimize data storage solutions, including Amazon S3, Amazon Redshift, and AWS RDS. Data Quality and Validation : Ensure data more »

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft … Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to … use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and more »

Role – Lead Data Engineer Skills – Leadership/Python/Any Cloud Location – Manchester Work Pattern – Once every 2 weeks in the office Salary – up to £80,000 plus benefits package including a significant Bonus. The Company We are looking for Data Engineer to join a very … well-established company and data team. They have a huge amount of data, it’s one of the strategic pillars of the company and they are heavily investing in a new system, which will be a vast improvement. This role will focus on exploring solutions to maintain, improve … and scale their use of data. They do an awful lot with data, it’s a huge asset to the business and they have a large number of people who have access to their data systems for analytical and insight purposes. The Role This is an amazing opportunity more »

Data Engineer - Leading Pharmaceutical Company - Exeter (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Exeter, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »

Data Engineer - Leading Pharmaceutical Company - Bristol (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Bristol, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »

employees, they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across … the organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating from … Tableau to Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data volumes Extensive experience of more »

Data Engineer - Frimley/Preston - Permanent I am currently recruiting for a Data Engineer to join a leading Aerospace and Defence organisation, you will be working in a rapidly expanding team whose aim is to work with all areas of the business to embed MDM within … Activities working directly with Customers to understand their requirements & data. Development activities to support the embedding of MDM. Activities to support the development of data governance/data quality practices in support of MDM & other Data services. Activities supporting the operation of MDM tools, providing advice & training … with customers on MDM projects to understand their requirements. Experience of communicating complex technical processes to customers in an understandable way. Experience of building data services including aspects of creating design specifications, data modelling/conditioning/integration, improving data quality, data governance, testing and deployment more »

understanding of how people think, feel and act; globally and locally in over 90 markets. By combining the deep expertise of our people, our data resources and benchmarks and our innovative analytics and technology, we help our clients understand people and encourage growth. Backed by industry-leading anti-fraud … more than 100 markets worldwide. Our clients include many of leading brands, who trust us to collect reliable insights. Join Kantar Profiles as a Data Engineer, where your technical expertise and collaborative spirit will contribute to the success of our data-driven initiatives. Apply now and be … part of a team that is shaping the future of data analytics at Kantar Profiles. Job Summary As a Data Engineer at Kantar Profiles, you play a crucial role in the development and maintenance of robust data pipelines, facilitating seamless access to data for our more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real … Time data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data more »