1 to 25 of 323 Data Pipeline Jobs in England

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our clients Data Platform. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. Ensure more »

Job Title: Data Engineer Role Type: Permanent Location: Hybrid (Birmingham) Role Overview As the Data Engineer, you will be responsible for managing a team of data engineers, analysts and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role in guiding the team, developing curated business models, and utilizing Azure services to optimize our data infrastructure. Key Responsibilities Provide leadership, guidance, and support to team members, ensuring the successful execution of projects and tasks. Mentor and support the wider … business, including Business Intelligence teams, to leverage data for decision-making using PowerBI and other Microsoft tools. Collaborate with cross-functional teams to achieve common business goals. Develop and maintain curated business models to support accurate and insightful decision-making. Utilize SSRS, SSAS, and SSIS to design, develop more »

Data Engineer Data Transfer Programme Bristol - Hybrid (circa day per month in the office) £50,000 - £57,000 Fixed term for 12 months (possible extension) The role: Our client is committed to deliver a significant and comprehensive data transformation programme (DTP), designed to establish … a robust approach to modernising the use and management of all data, to inform decision making and support our regulatory activity. The Data Engineer will build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward … of database design and development, data management and systems integration Knowledge of automation testing as part of a data engineering pipeline Knowledge of software development approaches, disciplines and best practice Awareness of how data is used by Analysts, Data Scientists and more »

to Friday. As a DevOps/MLOps Engineer you will be operationalising machine learning effectively. You will support the architectural needs of their Data Science team to ensure the seamless deployment, monitoring, and maintenance of machine learning models and data pipelines. You will work in close … collaboration with the Data Science team to design and implement scalable and reliable infrastructure for machine learning model deployment and data processing. The successful candidate will deploy machine learning models and data pipelines to production environments and establish robust monitoring and alerting systems to … machine learning model deployment process and ensure reproducibility. The DevOps/MLOps Engineer will implement security best practices and ensure compliance with relevant data privacy regulations in all processes as well as work cross-functionally with Data Scientists, Software Engineers and DevOps team members to facilitate more »

We at Qualient Solutions are looking for a Data Cloud Architect with - Permanent - London, UK - Hybrid. Role Title: Data Cloud Architect Role Type: Permanent (Hybrid) Role Location: London, UK Job Summary: We are looking for a skilled and experienced Data Architect Technical to work … as part of our IT team. As a Data Architect Technical, you will be responsible for designing, developing, and maintaining the data architecture for our organization. You will have a strong understanding of data integration best practices and will play a key role in … data models and logical workflows. 7. Continuous Improvement: o Analyze performance metrics and propose improvements. o Provide resolution to data pipeline challenges. 8. Cloud Data Technologies: o Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving more »

Senior Data Engineer (Remote) - Stealth SaaS Startup Location: Manchester (Remote Friendly) Salary: £65,000 - £75,000 per annum About Us: We are an innovative stealth start-up set to launch a cutting-edge SaaS product next year. We're looking for a talented Senior Data Engineer to join our team and build robust data pipelines. Responsibilities: Build, and maintain scalable data pipelines. Maintain the pipeline through Databricks and Apache Beam Seamless data integration and quality. Data storage solutions using GCP (will still be considered with … to bring the AI/ML models into production Databricks for daily data processing Qualifications: Experience in data engineering and pipeline construction. GCP and familiarity with other cloud environments. Understanding of SDLC. Experience with Databricks. Programming skills (Python and SQL). What We Offer more »

Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for firms in their chosen target markets. Using … innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics and AI. You'll have experience in … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for firms in their chosen target markets. Using … innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics and AI. You'll have experience in … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

We are looking for a SC Cleared Data Architect for one of our client. Responsibilities: Overall Solution: Over 15 years of IT experience and over 7 years of experience in architecting, designing, developing and maintaining an End to End Data system for a Banking/Financial … project stakeholders and then, effectively interact with the team-members to come up a design to meet those current and future requirements. Design Data Infrastructure: Identify internal and external data sources relevant to the project for the project in a Cloud Environment. Collaborate with department heads … visualization skills for data models and logical workflows. Continuous Improvement: Analyze performance metrics and propose improvements. Provide resolution to data pipeline challenges. Cloud Data Technologies: Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving strategies. Advocate more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: Perform system administration on specific cyber defence applications and systems … network tools in response to new or observed threats within the network environment or enclave. Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. Implement data management standards, requirements, and specifications. Develop data standards, policies, and procedures. Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: Knowledge of big data more »

Brio Digital are happy to be supporting a data consultancy who are currently looking for an analytics engineer. The role will be hybrid with 2x days per week on-site in London. Salary; Up-to £80,000. Analytics Engineer Experience & Tech; SQL Python Experience with cloud platforms such … as GCP or Azure. Experience with Big Query & Synapse. Experience with Data visualisation tools such as D3. Experience in a client facing position A consultancy background would be highly beneficial. Analytics Engineer role overview; You have previously had experience working across multiple client projects at one time. You … be very client facing & also present to clients so if you have done this previously, that will be highly beneficial. You will build data pipelines to support analytics across very large data sets. You will mentor and support more junior members of the team. Apply now more »

from Office) SC Cleared: Required Job Type: Full-Time Experience: 15 - 20 years Job Summary: We are looking for a skilled and experienced Data Architect Technical to work as part of our IT team. As a Data Architect Technical, you will be responsible for designing, developing … and maintaining the data architecture for our organization. You will have a strong understanding of data integration best practices and will play a key role in driving successful data integration and transformation initiatives. Responsibilities: 1. Overall Solution: o Over 15 years of IT experience … data models and logical workflows. 7. Continuous Improvement: o Analyze performance metrics and propose improvements. o Provide resolution to data pipeline challenges. 8. Cloud Data Technologies: o Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

work in an environment that's fun, fast paced, customer focused and commercial with fantastic development opportunities? Look no further than the Asda Data team! If you have recently graduated or are due to graduate this year, come and join us on a 2-year Data graduate programme, working in the Geospatial & Market Team. Joining Asda as a Data Graduate, you will be working within the Geospatial & Market team, who provide geospatial and market intelligence and insight across Asda. We work most closely with our property team, supporting location planning and finding … at an exciting time as were looking at opening hundreds of new convenience stores over the next couple of years. Furthermore, we provide data to support our Marketing and Buying teams to deliver targeted marketing campaigns and support operational decision-making. For example, we provide insight and analytics more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

Data Engineer to join our growing team. You will be responsible for expanding and optimizing our data, data pipeline architecture and optimizing data flow across functional teams. The Data Engineer will work with our software developers, database architects, data analysts and data scientists on data initiatives. Responsibilities for Data Engineer: Configuring Azure Event Hubs Writing Azure Function Apps in C# Creating data pipelines in Azure Data Factory Creating PowerBI reports and visualisations Analysing analytics business requirements to … determine the data models and data flows required to deliver new dashboards and reports Creating Solution Design documents for analytics solutions Documenting Architectural Decisions that are relevant for analytics solutions Designing Extract-Transform-Load processes Required Technical and Professional Expertise Development of complex PowerBI reports from more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Location : London, Must have SC Clearance Certificate Mode: Hybrid Salary: Competitive Overview: We are seeking a talented Data Engineer with expertise in Azure to join our team. The ideal candidate will be responsible for developing data pipelines, building and maintaining data warehouses and data lakes, implementing data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Develop data pipelines for ETL/ELT (Extract, Transform, Load) processes using Azure technologies. Build and maintain scalable and efficient data warehouses and data lakes on Azure platforms. Implement data integration and transformation solutions to enable seamless data flow across systems and applications. Ensure data quality and integrity by implementing data validation and cleansing processes. Perform performance tuning and more »

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Senior Data Analyst/Data Modelling/SQL/Tableau/Python/Databicks Role: Senior Data Analyst Company: Renewable Energy Package: Up to £80,000 Location: London (Hybrid, 1 day a week in office) A world leader in renewable and sustainability energy are … currently in search of a seasoned Senior Data Analyst to join their growing Data team. As the Senior Data Analyst, you will be instrumental in providing comprehensive data analysis, utilizing your expertise in Tableau to unearth actionable insights that inform strategic business … Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualization skills, including proficiency with Tableau. Familiarity with cloud-based data pipeline architectures (e.g., Databricks) and platforms (e.g., AWS). Knowledge of Git-based source control methodologies, including branching and pull requests. Proven track record of more »