51 to 75 of 237 Permanent Data Engineer Jobs in the UK excluding London

Job Description: Data Engineer - Mission Critical Overview We are seeking a highly skilled Data Engineer with a strong DBA background, solid .Net and C# development experience, and proficiency in Entity Framework to join our mission-critical team at my client's company. This role involves working … database and migrating it to Azure SQL. The successful candidate will play a crucial role in ensuring the performance, reliability, and scalability of our data infrastructure. Key Responsibilities Database Revitalisation Fix and optimize the legacy SQL Server database. Address performance issues, broken elements, and gaps, particularly those stemming from … Planning and Execution Plan and execute the migration of the SQL Server database to Azure SQL within the first three months. Aim for a data-tier application for better maintainability and scheduled job engineering solutions. Performance Tuning Enhance database performance and ensure efficient data querying and management. Optimize more »

Data Engineer £50,000 - £60,000 - Hybrid My client, industry leading EdTech organisation are currently looking to expand their Data team! become a Data Engineer with vast progression opportunities, where your work is all for a great cause! Requirements Thrive in a fast paced and … dynamic environment Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) Excellent analytical and problem-solving skills An appreciation for the big picture while … delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including having a working knowledge of GitHub Understanding of different data more »

Azure Data Engineer An Azure Data Engineer is required by Whitehall Resources for our client based in the south of England. This is a permanent role and can be done from the comfort of the successful candidate’s home with travel into the office one to … two times a month. The successful candidate will come from a Data Engineering background and have experience with the latest Microsoft technologies. Strong knowledge of MS SQL Server on Azure with proficiency in SQL will also be needed. Do you have? Azure Data Engineering experience? Strong knowledge of … MS SQL Server on Azure? A background in the design, build, and maintenance of ADF data pipelines to extract, transform, and load (ETL) data from various sources into Data Warehouses? Exposure to Azure Synapse Analytics? Excellent communication skills? Would you like? Work for an exciting end user more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical Skills: Proficiency in AWS Glue, AWS Redshift … and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI, Tableau, Qlik Sense) Additional Skills: Client more »

of our users. Through science, technology, and maintaining a clear focus on people, we make mobility possible. We have an exciting opportunity for a Data Engineer to join our growing IT team. The role As Data Engineer you will develop and construct data products and … services and integrate them into systems and business processes. Key duties: Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL …/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality. Building accessible data for analysis. Recognising opportunities to re-use existing data flows. more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure’s … diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work more »

Data Engineer Leeds, onsite 2x per week £45,000 - £55,000 This is an exciting opportunity to join a rapidly growing financial organisation, grown from a joint venture with a major bank. They are seeking an experienced Data Engineer to play a crucial role in the … progression of a new Data Lakehouse, and implementation of an iPaaS solution. As the Data Engineer, you will bring extensive commercial experience in working with sizeable ETL processes/pipelines, AWS serverless technology and Python. In addition to strong technical skills, effective communication and ability to engage … culture while having extensive financial backing to ensure their technology is the best the market has to offer! Requirements: 3+ years commercial experience within Data Engineering SQL Python AWS Excellent communication skills Package: 35 hour working week L&D budget 15% pension Hybrid working 30 days annual leave + more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its … next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … recognised for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely with … stakeholders to understand business requirements, design data solutions, and deliver value-added insights. You will be responsible for architecting data pipelines, optimizing data storage and retrieval, and ensuring the integrity and security of our data ecosystem. Additionally, you will have the opportunity to provide consultative guidance more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer), 75% Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile development setting to meet project objectives more »

Data Engineer - Azure SQL - £550 Per Day - Inside IR35 Overview My client, is a leading organisation committed to empowering people to make confident decisions. They are seeking a highly skilled Data Engineer to join their mission-critical team. This role involves a significant project focused on … database and migrating it to Azure SQL. The successful candidate will play a crucial role in ensuring the performance, reliability, and scalability of the data infrastructure. Key Responsibilities Database Revitalization: Address and optimise the legacy SQL Server database, fixing any performance issues, broken elements, and gaps. Migration Planning and … execute the migration of the SQL Server database to Azure SQL within the first three months. Performance Tuning: Enhance database performance and ensure efficient data querying and management. SQL Server Agent Jobs: Manage and optimize SQL Server Agent jobs, ensuring they run efficiently and without errors. Testing and Validation more »

Data Engineer Leeds - on site 2x per week up to £55,000 Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. Working closely with the Senior Data Engineer and Architects, you will play a crucial role in their journey of migrating from legacy to Azure. You will bring extensive commercial experience working with SAS codes, reports and stored procedures to improve both efficiency and automation whilst maintaining a core SAS user base. Requirements: Demonstratable proficiency … with SAS platforms Strong commercial experience with SQL Hands on experience with Azure Data Factory and the build of data pipelines Proficiency in Python for data manipulation, transformation and analysis Experience with Azure Synapse including ingestion and querying We are an equal opportunities employer and welcome applications more »

Senior Data Engineer (GCP) My client a financial services business are looking for a Senior Data Engineer (GCP), to spearhead global initiatives to migrate complex data systems to GCP. You will design, implement, and optimise data pipelines, ensuring data integrity during migration and … utilising GCP services for scalable and efficient data transformation. Salary: Up to £65K Hybrid: 2 days a week Key Responsibilities: Lead data engineering projects in Europe, working with partners for GCP transition. Design and deploy data pipelines with automated data lineage. Develop reusable data engineering … Ensure timely migration to GCP. Essential Qualifications: 5+ years of SQL. 3+ years of GCP and its different services. Experience with microservice architecture and data processing pipeline design. Desired Qualifications: Certification in GCP. Financial Services experience. Experience coaching and mentoring data engineers. If this role is of interest more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data … want to be part of our expert community, click apply now to start an application. Design with people in mind. As a Lead Software Engineer, you will be: Promoting the value of Communities of Practice, encouraging members to contribute, build and maintain an effective professional community. Defining, updating and more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data … want to be part of our expert community, click apply now to start an application. Design with people in mind. As a Lead Software Engineer, you will be: Promoting the value of Communities of Practice, encouraging members to contribute, build and maintain an effective professional community. Defining, updating and more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data … want to be part of our expert community, click apply now to start an application. Design with people in mind. As a Lead Software Engineer, you will be: Promoting the value of Communities of Practice, encouraging members to contribute, build and maintain an effective professional community. Defining, updating and more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data … want to be part of our expert community, click apply now to start an application. Design with people in mind. As a Lead Software Engineer, you will be: Promoting the value of Communities of Practice, encouraging members to contribute, build and maintain an effective professional community. Defining, updating and more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data … want to be part of our expert community, click apply now to start an application. Design with people in mind. As a Lead Software Engineer, you will be: Promoting the value of Communities of Practice, encouraging members to contribute, build and maintain an effective professional community. Defining, updating and more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data … want to be part of our expert community, click apply now to start an application. Design with people in mind. As a Lead Software Engineer, you will be: Promoting the value of Communities of Practice, encouraging members to contribute, build and maintain an effective professional community. Defining, updating and more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits • Up to 10% matched pension scheme with Standard Life • Death in Service: 4 x salary • Annual Car Parking permit • Purchase monthly during probationary … partner. Children under the age of 24 can be covered free of charge. Skills • Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences • Experienced in working Microsoft Cloud Data and Automation technologies • Experienced working with Tableau and or Power BI • Experienced in data warehousing more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits Up to 10% matched pension scheme with Standard Life Death in Service: 4 x salary Annual Car Parking permit Purchase monthly during probationary … partner. Children under the age of 24 can be covered free of charge. Skills Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences Experienced in working Microsoft Cloud Data and Automation technologies Experienced working with Tableau and or Power BI Experienced in data warehousing more »

Data Engineer - Belfast - £55 - 60k + Bonus Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning … and diversity at all levels. They have a new opportunity for a Data Engineer to join their Digital function. AWS is a huge growth area for this company, so it's a great opportunity to really develop your cloud skills. The person Experienced in designing and deploying production … data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Knowledge of data cleaning, wrangling, visualization and reporting Knowledge of data mining more »

Are you a Senior Data Engineer with extensive knowledge of Azure services, advanced skills in Databricks and in-depth knowledge of SAP HANA? We have a brand new opportunity to join us as the senior engineer and technical lead throughout the data delivery teams on our … make timely and accurate decisions is unparalleled. These new roles will play a huge part in ensuring we're taking full advantage of the data we currently capture and building out our new Azure platform to further our capabilities. There has never been a more exciting time to join … us! You will Develop and implement scalable and efficient data solutions using ADF and Databricks. Build and maintain robust ETL pipelines for data transformation and processing. Optimize data processing jobs for performance and cost. Work closely with other Central Data Office teams and in particular three more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained Working … with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services Experience more »

Are you a seasoned Data Engineer with a passion for SQL and Microsoft Azure? Do you excel in leading and inspiring teams? I'm representing a leading sports betting company based in the heart of Liverpool. Who are all about innovation, pushing the boundaries of sports analytics and … betting. They are searching for a talented Senior Data Engineer to champion their data management efforts and help upskill and lead their data team. What you'll be doing: Building and maintaining the clients data architecture, databases, and processing systems. Making sense of complex functional … and technical requirements, and turning them into detailed designs. Establishing data standards, procedures, and guidelines to ensure accuracy and compliance. Nurturing their teams with your leadership and mentoring skills. What you need: Proven experience as a Senior Data Engineer or a similar leadership role. Expertise in SQL more »