151 to 175 of 510 Data Engineer Jobs

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical Skills: Proficiency in AWS Glue, AWS Redshift … and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI, Tableau, Qlik Sense) Additional Skills: Client more »

Senior Azure Data Engineer £70,000-£75,000 salary Remote UK *Please note this is a permanent position (no contractors will be considered). You must also have full right to work in the UK to apply* I'm currently working with an exciting SaaS company, specialising in … the detection and management of risks that may affect the outcome of clinical trials. They're looking to strengthen their Data Engineering function now, by bringing on a Senior Data Engineer with excellent ability in Azure , Data Factory , data warehousing , SQL , Power BI , and an … understanding of RestAPIs . Essentials: 4+ years experience as a Data Engineer using Azure . Proven experience working with Azure Data Factory and Power BI . Strong ability with Data Warehousing. Excellent skills with Python and SQL . Confident understanding of RestAPIs . They are booking more »

an unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not just accessible but … optimised for safe, secure utilisation across multiple fronts — be it reporting, analytics, or powering applications — ultimately driving substantial productivity gains for all data consumers. As a collaborative force, you will seamlessly integrate across central, regional, and local teams, refining our client's data visualisation strategy and elevating our more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data … the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial working as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Experienced creating data pipelines more »

of our users. Through science, technology, and maintaining a clear focus on people, we make mobility possible. We have an exciting opportunity for a Data Engineer to join our growing IT team. The role As Data Engineer you will develop and construct data products and … services and integrate them into systems and business processes. Key duties: Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL …/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality. Building accessible data for analysis. Recognising opportunities to re-use existing data flows. more »

of new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … and other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise their … digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the data engineering more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure’s … diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for … a Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to … enhance understanding of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and more »

Azure Data Engineer Central London- 3 X Week Up to £60,000 I am working on a Data Engineer role for a fast-growing company within the property industry. They are looking for a confident Azure Engineer to help build out their data team … You will be sitting in a cross-functional data team, working closely with the Data Development Lead and the Head of BI. Requirements To qualify for this role, you will require: · Strong experience within Azure (Data Factory, Synapse, Fabric, etc.) · SQL Expertise As well as excellent stakeholder … successful candidate will receive: · A Salary of up to £60,000 · Excellent progression opportunities Process- three interview stages 1st Stage- Short Conversation with the Data Development Lead 2nd Stage- Technical Interview with Data Manager and a key business Stakeholder HOW TO APPLY: Please register your interest in this more »

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support further … growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain, support and … expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise and work closely with our team more »

Data Engineer Leeds, onsite 2x per week £45,000 - £55,000 This is an exciting opportunity to join a rapidly growing financial organisation, grown from a joint venture with a major bank. They are seeking an experienced Data Engineer to play a crucial role in the … progression of a new Data Lakehouse, and implementation of an iPaaS solution. As the Data Engineer, you will bring extensive commercial experience in working with sizeable ETL processes/pipelines, AWS serverless technology and Python. In addition to strong technical skills, effective communication and ability to engage … culture while having extensive financial backing to ensure their technology is the best the market has to offer! Requirements: 3+ years commercial experience within Data Engineering SQL Python AWS Excellent communication skills Package: 35 hour working week L&D budget 15% pension Hybrid working 30 days annual leave + more »

Permanent - Hybrid - Azure Data Engineer Azure Data Engineer required for an exciting perm opportunity. Our client, a leading property investment business are looking to hire an Azure Data Engineer to join their growing tech function. The key responsibilities are the following: Data processing … consolidation, clean-up and migration Data Transformation Azure roadmap discussions Maintain Azure Automation Runbooks. Configure virtual cloud instances and monitor backups. The key skills they are looking for are: 3+ years experience within an Azure Data Specialist position Microsoft T-SQL script skills Experience with Azure Data storage such as Azure blob storage/data lake Azure Key vault Active Directory - Azure AD SAML, Enterprise Apps A strong knowledge of databases (SQL/Oracle) Server Administration If you are looking to develop your skills within a dynamic environment and have a matching skillset to the more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its … next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data more »

an independent charity committed to bringing about better health and health care for people in the UK. This is an exciting role in the Data Analytics directorate, a team of around 25 staff. Data Analytics plays a core role in delivering the Foundations overall mission and strategy. We … the UK population, as well as health and care system performance. The Improvement Analytics Unit (IAU) is a sub-team of 14 staff within Data Analytics. It is a unique partnership between NHS England and the Health Foundation. We evaluate innovative and complex initiatives in health care in order … to support learning, improvement and policy development. Our Senior Data Engineer will work within the Improvement Analytics Unit (IAU).They will support our Assistant Director and Senior Analytical Managers to deliver an ambitious work programme, leading on data engineering, data management and information governance. The data more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … recognised for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely with … stakeholders to understand business requirements, design data solutions, and deliver value-added insights. You will be responsible for architecting data pipelines, optimizing data storage and retrieval, and ensuring the integrity and security of our data ecosystem. Additionally, you will have the opportunity to provide consultative guidance more »

Roles and Responsibilities: • Analyse and organize raw data • Build data systems, pipelines, and data products. • Evaluate business needs and objectives • Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modelling • Build algorithms and prototypes • Combine raw … information from different sources • Explore ways to enhance data quality and reliability • Identify opportunities for data acquisition • Develop analytical tools and programs • Collaborate with data scientists and architects on several projects • Automate Tasks • Create Models and Identify Patterns Key Skills: • Previous experience as a data engineer or in a similar role • Technical expertise with data models, data mining, data migration, Data warehousing and segmentation techniques (GCP ). • Big query, big tables and Compute engine in GCP. • Knowledge of programming languages Python, R, and java . • Machine learning will be added advantage. more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to global exchange … groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you will be … responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data lifecycle. Strong Python coding experience. more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data … remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative … data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other platforms for … large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in data more »

Data Engineer – London – Up to £120,000 I am working with a leading Blockchain start-up, whose core offering is based around the research, development and deployment of infrastructure. This VC-backed client has seen massive success in the last 12 months and are now capitalizing on their … who are ready to take on project ownership and create products that will truly disrupt their industry. Role The business is looking for a Data Engineer with a passion for new technologies/Strong analytical skills and whilst experience in a quant or trading role is not essential … beneficial. The team is highly entrepreneurial giving every new starter a great opportunity to take on project ownership straight from the off. As a Data Engineer you will be working on the company’s core analytics/Monitoring and Alerting platform alongside contributing to the research framework. Requirements more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and … analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams Share expertise by mentoring and showing best practices more »

Data Engineer - Azure SQL - £550 Per Day - Inside IR35 Overview My client, is a leading organisation committed to empowering people to make confident decisions. They are seeking a highly skilled Data Engineer to join their mission-critical team. This role involves a significant project focused on … database and migrating it to Azure SQL. The successful candidate will play a crucial role in ensuring the performance, reliability, and scalability of the data infrastructure. Key Responsibilities Database Revitalization: Address and optimise the legacy SQL Server database, fixing any performance issues, broken elements, and gaps. Migration Planning and … execute the migration of the SQL Server database to Azure SQL within the first three months. Performance Tuning: Enhance database performance and ensure efficient data querying and management. SQL Server Agent Jobs: Manage and optimize SQL Server Agent jobs, ensuring they run efficiently and without errors. Testing and Validation more »

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a … likely to grow and have line management responsibilities in the future. Due to this there is an emphasis on current, hands on experience within Data & AI. Key Responsibilities: Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with stakeholders … Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full-time role offering up to £150k salary plus bonus and benefits. 3 days minimum per week in the office in more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers … achieve their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse more »

ROLE SUMMARY DATA ENGINEER REMOTE/TRAVEL TO CLIENT SITE IN LONDON Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal … strategy, turn it into an actionable blueprint and help the client get it done. Who have deep expertise in operationalising strategy, process design, digitisation, data and analytics, automation, technology and change. RESPONSIBILITIES: Analyse and organise raw data Build data systems and pipelines Evaluate business needs and objectives … Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modelling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and more »