101 to 125 of 290 Permanent Data Pipeline Jobs in England

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse … project through its next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to … innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with … Hadoop, Spark, and other platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance more »

Data Analyst - Hybrid Working Are you a talented Data Analyst seeking a challenging and business critical role within a highly successful global product company who have developed a world renowned brand? Are you looking for the next phase of your career through progressing your technical knowledge … and joining an established and accomplished data management team ? If so this could be the role for you... Why Would you Join? Competitive salary with annual reviews Generous Bonus Scheme Private medical care Finish early on a Friday 25 days holiday Hybrid working - 3 days in the office … days WFH (work from home) Beautiful brand new refurbished office The Opportunity As a data analyst you will conduct data analysis having first selected appropriate statistical methods and provide insights and recommendations based on investigations including deep dives into any relevant metrics. The successful data more »

Job Specification: Mid-Level Data Scientist/Data Engineer About Us Based in Bristol, we are at the forefront of cyber risk assessment and management. Our innovative approach and proprietary models are revolutionizing the way cyber risk is understood and mitigated in the reinsurance domain. We … excellence and innovation, making us leaders in our field. Position Overview We are on the lookout for a talented and experienced Mid-Level Data Scientist/Data Engineer to play a crucial role in the development and operations of our automated ingestion system. This role is … ideal for someone passionate about crafting sophisticated data ingestion pipelines that incorporate advanced ML components, and who thrives in a dynamic, agile environment. Key Responsibilities Automated Ingestion System Development: Design, develop, and maintain efficient, scalable, and reliable data ingestion pipelines. ML Component Integration: Integrate advanced machine more »

We are seeking a passionate and driven Junior SQL Data Engineer to join our team. As a Junior SQL Data Engineer, you will work closely with our data engineering and analytics teams to develop, optimize, and maintain SQL databases and data pipelines. … paced, dynamic environment . REQUIRED - 5 years in the UK as a minimum Role and responsibilities: Design, develop and optimize SQL databases and data models to support business requirements. Build and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Collaborate … with cross-functional teams to understand data requirements and implement solutions that meet business needs. Perform data analysis and troubleshoot issues to ensure data accuracy and integrity. Support Legacy Data Warehouse: Bug fixes, batch ETL processing and data related queries. more »

Senior Data Engineer Python, SQL, Big Data Frameworks London, Geneva, Dubai - 4x a week (no flex) £110-120,000 + bonus Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and … maintaining the infrastructure that supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimize database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master's degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer in the more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into … their central Microsoft Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power … will not have to use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you more »

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be … working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity more »

About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision … strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve quality … years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project more »

Title: Head of Business Intelligence and Analytics Company Description: A leading company in the property sector with a strong focus on innovation and data driven decision making seeks a highly experienced professional to lead its Business Intelligence and Analytics team. Job Summary: We are searching for a talented … to spearhead our Business Intelligence and Analytics team. You will play a pivotal role in driving organizational growth and development by transforming raw data into actionable insights that inform strategic decision-making across various departments. Responsibilities: In this role, you'll find yourself equally split between hands-on … team with 50% devoted to hands-on tasks and 50% to management and leadership responsibilities' Oversee the construction and maintenance of a central data repository, ensuring alignment with organizational needs and data strategy. Collaborate with the data engineering team to gather and transform data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

Data Engineer Pearson Carter are currently working with a Education consultancy based in Sheffield who are looking for a Data Engineer who has strong AWS cloud, SQL and Python experience. They offer … a base salary of £50,000 and £60,000 Get in touch if you are looking for your next opportunity! Responsibilities: Data pipeline development in Python Development of the data warehouse stack Integrate additional data sources Experience: SQL Python AWS, Glue and Lambda more »

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that … supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge more »

our client's UK-based team. The successful candidate will: -have previous experience of mentoring a team of developers - be adept at managing data pipelines, working with data exports in Business Central - possess a solid understanding of financial reporting. Key Responsibilities : Design, develop, and maintain advanced … PowerBI dashboards and reports to drive business decisions. Expertly craft DAX formulas for complex calculations and data analysis within PowerBI. Utilise SQL queries to manipulate and retrieve data efficiently from various databases. Implement and manage data pipelines to ensure seamless data flow … and integration. Work with data exports from Business Central to optimise data usage in PowerBI. Leverage Synapse Analytics to handle large volumes of data and perform big data analytics. Provide insights into financial reports including General Ledger (GL), Profit & Loss (P&L more »

since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Senior Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a senior data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »

DATA ENGINEER – UP TO £60,000! Location : Sheffield Benefits: 25 Days + Bank Holidays! Life Assurance! Flexible Working! Company: A chance to have a positive societal impact if you launch yourself into a fast growing, but firmly established, company in the much sought after EdTech sector APPLY NOW … Responsibilities: To build and maintain scalable data pipelines To gather requirements and deliver data projects To document processes and data pipelines To maintain a backlog of future improvements/… features in Jira To build effective relationships with technical and non-technical colleagues Requirements: Should have exceptional SQL skills Should have data pipeline development experience in Python Should have experience with AWS tools including Glue & Lambda Should have an understanding of CI/CD concepts Should have more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and … implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams more »

Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for … a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data pipelines, ensure data quality, and automate reporting processes. Your work will support decision-making and contribute to strategic goals, making a significant impact across the company. What you'll be doing... You will gather data from various departments and tools, integrating it into a more »

Stride Recruitment are looking for skilled and motivated SAS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. Technical Background: SAS SAS Base … Azure or AWS or GCP Python/PySpark Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Additional Skills: Excellent communication and stakeholder management skills Ability to translate … complex data into actionable insights. Strong analytical and problem-solving abilities This is a great opportunity to work with an award-winning Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight more »

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support … further growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain … support and expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure … s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable … operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists within the Operational Analytics team to understand data needs and deliver solutions more »

About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access … to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test … and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding … existing data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from … must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's … offers agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be … from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the more »