51 to 75 of 84 Data Engineering Jobs in the UK excluding London with Remote Work Options

converters. Converted code is causing failures/performance issues. Your responsibilities; As a Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible for: Designing, building, and maintaining data pipelines using Apache Spark and Scala Working on an Enterprise scale … and Cloud Services in one of the Clouds (GCP). Mandatory Skills; At least 8+ Years of IT Experience with designing, building, and maintaining data pipelines . At least 4+ Years of experience with designing, building, and maintaining data pipelines using Apache Spark and Scala. Programming languages: Proficiency … in Scala and Spark is essential. Familiarity with Python and SQL is often a plus. Big Data technologies: Understanding of HDFS, Kafka, Hive, and cloud platforms is valuable. Data engineering concepts: Knowledge of data warehousing, data pipelines, data modeling, and data cleansing techniques more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data infrastructure … remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. more »

Data Analyst - Hybrid Working Are you a talented Data Analyst seeking a challenging and business critical role within a highly successful global product company who have developed a world renowned brand? Are you looking for the next phase of your career through progressing your technical knowledge and joining … an established and accomplished data management team ? If so this could be the role for you... Why Would you Join? Competitive salary with annual reviews Generous Bonus Scheme Private medical care Finish early on a Friday 25 days holiday Hybrid working - 3 days in the office 2 days WFH … work from home) Beautiful brand new refurbished office The Opportunity As a data analyst you will conduct data analysis having first selected appropriate statistical methods and provide insights and recommendations based on investigations including deep dives into any relevant metrics. The successful data analyst will identify opportunities more »

Senior Data Engineer (Databricks) – Remote – Leeds - 6 Months Contract (Initial) – Outside IR35 We are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses … and consolidating/centralising a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows … in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data more »

Lead Data Engineer Hybrid - Manchester based (2x a month) £80,000 salary plus 20% annual bonus I am currently partnering with a leading digital retailer that service some of the worlds largest brands and they are seeking a Lead Data Engineer to join their Data Engineering team and play a pivotal role in designing, constructing, integrating and maintaining a robust data platform on multiple clouds. The successful Lead Data Engineer will have: Experience leading a Data Engineering team. Extensive working experience with GCP, SQL and DBT. Proficient in: Kafka, Dataform, Airflow … Tableau, PowerBI, Redshift, Snowflake, Terraform and BigQuery. What's in it for the successful Lead Data Engineer: Hybrid working for a better work/life balance. Joining the fastest-growing company in their sector. Working with the latest tech and Cloud services. Ability to manage and develop a team more »

with various business functions reviewing their information needs and processes. You will recommend, develop and support improvements or new systems to capture and store data and provide robust reporting capabilities. Our goal is to support evidence-based decision making throughout the organisation to deliver the best care and support … different needs and priorities Work independently using existing technical skills including: Advanced Excel knowledge to build tools to collect, store, model, analyse and present data Power Query to extract and transform data from different sources Writing SQL queries for data extraction and report building Data modelling … bring sources together for reporting Build on previous personal experiences, learn and apply new skills quickly around: Power BI for analysis and presentation of data DAX data modelling Low code development Built-in reporting tools to extract data from business systems Data engineering to automate more »

with various business functions reviewing their information needs and processes. You will recommend, develop and support improvements or new systems to capture and store data and provide robust reporting capabilities. Our goal is to support evidence-based decision making throughout the organisation to deliver the best care and support … different needs and priorities Work independently using existing technical skills including: Advanced Excel knowledge to build tools to collect, store, model, analyse and present data Power Query to extract and transform data from different sources Writing SQL queries for data extraction and report building Data modelling … bring sources together for reporting Build on previous personal experiences, learn and apply new skills quickly around: Power BI for analysis and presentation of data DAX data modelling Low code development Built-in reporting tools to extract data from business systems Data engineering to automate more »

DATA ENGINEER REMOTE WORKING (UK BASED) UP TO £60,000 PERMANENT Do you have experience as a consultant? Are you passionate about Data Engineering and have a strong background in the Azure stack? This role is an amazing chance to work with some experienced and talented individuals … in a small team. THE COMPANY The company is a Microsoft consultancy company. They are looking to build out their data engineering function with an expert in the azure stack and prior experience working in a consultancy. THE ROLE You will be: Designing, developing, and delivering solutions and … presenting ideas. Some light line management and mentoring of junior data engineers. Working on a variety of projects including building out infrastructure, ETL work, architecture design, advancing and maintaining warehouses, etc. YOUR SKILLS AND EXPERIENCE High levels of proficiency in Azure Cloud. Strong capabilities with Python, Snowflake, and Dynamics more »

as a Solution Architect within the Financial Services sector, with expertise in Corporate and Retail Lending and related areas Expertise in solution designing, ETL, data migration, information security, data modelling, data engineering, and data warehousing. Proficiency in CRM systems like Salesforce and MS Dynamics, particularly … like Power BI and code repository/issue tracking tools like Azure DevOps. Experience with cloud platforms, particularly Azure, and understanding of cloud computing data processing. Excellent communication and presentation skills, with the ability to explain complex technical concepts to non-technical stakeholders. Ability to lead architectural discussions, provide … address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2022 global revenues of €22 billion. Get The Future You Want | www.capgemini.com more »

cloud platforms will be considered experience in a technical consulting/technology professional services environment experience of working within enterprise projects with a strong data focus which could include data engineering, data platform design, data analytics, machine learning or AI. One more thing – research indicates more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400+), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions including warehousing … drive real business results, a stark contrast to the generic approaches often found at larger agencies. “Leading with Relationships and Results” As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. You'll … combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations for efficient data analysis. more »

LEAD DATA ENGINEER REMOTE FIRST (UK BASED) UP TO £100,000 PERMANENT Do you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working with public sector organisation? This role is an amazing chance to work with some experienced and … talented individuals. THE COMPANY The company is a leading consultancy company. They are looking to build out their data engineering function with an expert in cloud technologies and prior experience working with public sector organisations. THE ROLE You will be: Designing, developing, and delivering solutions and presenting ideas. … Some light line management and mentoring of junior data engineers. Working on a variety of projects including building out infrastructure, ETL work, architecture design, advancing and maintaining warehouses, etc. YOUR SKILLS AND EXPERIENCE High levels of proficiency in a cloud technology. Strong capabilities with Python, Spark, and Databricks. Experience more »

a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Databricks Engineers should have extensive experience working with Databricks on recent projects and be … exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills: Proven experience as a Databricks Engineer/Data more »

Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over … role will be about designing, planning and implementing systems based on LLM-inference, including advanced RAG. To this end you will collaborate tightly between Data Scientists, Machine Learning and Big Data Engineers, as well as Cloud Software Engineers and DevOps in a Scrum environment. You can support streamlining … a better future where a new job is just a click away. Your responsibilities: Implement and productionise ML-based services using Sagemaker Collaborate with Data Scientists to design and implement LLM-based inference workflows Utilize IaC and CI/CD best practices to increase efficiency in deployment, scalability and more »

We are seeking a Lead SQL Database Administrator with a strong background in database management systems, data modelling, and integration technologies. The successful candidate will lead a team of Database Developers, ensuring the reliability, security, and scalability of our database infrastructure. This role requires expertise in database management systems … design, implementation, maintenance, and performance optimisation), data modelling, and awareness of integration technologies to ensure the seamless flow of data across disparate systems. Day-to-day of the role: Lead and mentor a team of Database Developers, promoting a culture of innovation and continuous improvement. Design and implement … procedures to meet business requirements. Optimize SQL queries and ensure database performance, security, scalability, and reliability. Collaborate with stakeholders to design logical and physical data models and ensure data integrity. Develop integration solutions to facilitate data exchange between systems. Uphold data governance policies to ensure data more »

Data Platform Engineer (Azure) On behalf of our award-winning client based in Manchester, we are recruiting for an experienced Data Platform Engineer. As a Data Platform Engineer, you will deliverthe IT Support/corporate services business objectives and implement IT Services to meet business infrastructure, platform … needs, and growth targets. Data Platform Engineer (Azure)will be responsible for: Accountability & Responsibility for the continued development and delivery of the IT Data Operations support delivery. Lead the development, implementation, and establish a technology life cycle and continuous improvement/development (CI/CD) of applications and … they can operate 24x7 Lead the planning, development, documentation, implementation and testing of the corporate Disaster Recovery and Business Continuity processes and procedures The Data Platform Engineer (Azure) will have the following: Understanding and detailed knowledge of Microsoft Azure DevOps, ITIL, Azure Synapse, Databricks, PowerBI, Data Factory, HD more »

DevOps Engineer to join a growing tech team in Leeds. The organisation has significant financial backing and is looking to invest this in the engineering and IT teams. It's one of the best projects we've seen this year! Key details: Salary: £55,000-90,000 Benefits … skills desired/what you will learn: Terraform AWS: S3, Lambda/Serverless TypeScript, NodeJS, and ReactJS Python CI/CD: CircleCI, GitHub Actions Data Engineering technologies can be taught longer-term Role overview: Above all, this firm offers one of the best benefits packages outside of London … the most modern tech stack available. In the long term, there will be opportunities for vertical and horizontal moves, such as management, lead-level, data engineering and more. Interested? Please apply with your CV and/or message Billy Hall for further details. Xpertise acts as an employment more »

through another round of funding and offer a unique autonomous remote role to help shape the company's growth. This company are specialists within Data Engineering, Data Science and Training Services and have recently secured another $525,000 in funding to accelerate their growth. They have been … help shape the growth of the business. The role: *Part of a small development team *Creating interactive content, games, and gamification services within the Data industry *Working in Python, Vue/React *Remote, with 2 days a month required on site in Birmingham The person: *Proven software developer in more »

We are currently looking Systems Engineer to join the Data services team. This role will require you to attend the office 50% of the working week, therefore please only apply if you live a reasonable commutable distance to Cardiff. WHO ARE WE? At Creditsafe, we weave our core values … to be a part of a culture and a company where careers are made and where talent meet its true potential. THE TEAM The Data Services team sits within the Data Engineering department at Creditsafe Group. The team maintains over 42 APIs which are used to access … company and person data from a variety of sources and transform it into a cohesive formatted response which is used in downstream products and services. We engage with stakeholders at all levels of the organisation to achieve the business's objectives. We use modern tools and methodologies, using the more »

are a leading management consulting firm, and have a reputation for providing their clients with the highest quality of serviceYou’ll be passionate about data and its potential to transform businesses, you'll be at the forefront of designing and architecting data and analytics solutions that transform businesses. … You'll collaborate closely with clients, project managers, data engineers, and data scientists to craft scalable, efficient, and customized solutions that deliver real business impact.This role would suit someone with consultancy experience, someone who enjoys interreacting with both technical and non-technical people at all levels.What they’re … after –Solid experience working as a Data Engineering Consultant or Solution Architect, particularly with external clientsExperience with cloud technologies, particularly Azure and AWS but GCP considered.Experience with various data storage and processing technologies (MSSQL, Snowflake)Data Modelling, database design, ETL processes.And moreThis role would suit an more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing, and more »

Data Engineer Leeds, onsite 2x per week £45,000 - £55,000 This is an exciting opportunity to join a rapidly growing financial organisation, grown from a joint venture with a major bank. They are seeking an experienced Data Engineer to play a crucial role in the progression of … a new Data Lakehouse, and implementation of an iPaaS solution. As the Data Engineer, you will bring extensive commercial experience in working with sizeable ETL processes/pipelines, AWS serverless technology and Python. In addition to strong technical skills, effective communication and ability to engage with non technical … culture while having extensive financial backing to ensure their technology is the best the market has to offer! Requirements: 3+ years commercial experience within Data Engineering SQL Python AWS Excellent communication skills Package: 35 hour working week L&D budget 15% pension Hybrid working 30 days annual leave more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a week from … home and 2 day in office/on client site. Preferred skills: SAS Data Engineering Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we pay over … combination of microservices that make up a single customer journey. Our production environment is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work … where you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes An more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we pay over … combination of microservices that make up a single customer journey. Our production environment is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work … where you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes An more »