1 to 25 of 348 Data Pipeline Jobs

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »

the future of datadriven solutions, we eagerly await your application. Your main responsibilities will be to: Design, create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet the project and/or client requirements from a wide variety of structured and … cleaning, wrangling, and processing on a variety of data sets. Design, build and integrate analytics tools that utilise the data pipeline to provide actionable insights for the customers using metrics, statistics and ML techniques. Identify, design, implement and ensure adherence to internal process improvements: automating … analytics, and other data wrangling tools and methodologies. Experience of designing, building and optimising big data data pipeline, architectures and data sets. The ability to plan, design and work in a way that creates standardisation so that other team members more »

Data Quality Engineer (CDP Customer Data Platform) – Camden/Hybrid – 6 month contract £600-£650 per day outside IR35 Are you an experienced Data Quality Engineer with proficiency in SQL and data querying? Are you interested in joining a giant in the … retail and fashion sector? As the Data Quality Engineer you will be at the forefront of the team ensuring data quality is maintained in the overall data, data pipelines and data warehouse. KEY RESPONSIBILITIES Designing and executing comprehensive data validation strategies, including data profiling, data cleansing, and data transformation. Conducting data quality assessments and audits to evaluate adherence to data quality standards and identify areas for improvement. Collaborating with data engineering teams to design and more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … multiple greenfield projects supporting internal business units and external clients Ensure the accuracy and reliability of data across the data pipeline Bring positive innovative ideas that lead to innovative solutions rather than a lift-and-shift mentality Constantly stay up to date on new technologies … Ingestion tools such as FiveTran or Stitch Experience using Business Intelligence tools such as PowerBI, Looker or Tableau Experience with data pipeline tools such as DBT, Airflow or Luigi are a plus! Experience using cloud environments e.g. Azure or AWS Understanding of the Agile delivery method more »

Two driven and knowledgeable Azure Data Engineers to support a variety of data-related projects over the next two years are needed to join our team at Central Bedfordshire Council. You will have an opportunity to work with cutting-edge Azure ecosystem tools, including Databricks and … is a challenging and rewarding role within a supportive team environment. Join us and make a significant impact on Central Bedfordshire Council's data infrastructure and services. These positions are critical in facilitating our data migration projects as well as contributing to the development of the … Platform Engineer, Cloud Data Architect, Azure Data Solutions Engineer, Azure Data Integration Engineer, Cloud Data Pipeline Engineer, Azure Data Warehouse Engineer, Cloud Data Infrastructure Specialist, Azure Data Analytics Engineer will also be considered. more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data operations team and business stakeholders, work with the wider data team to provide a seamless service to business stakeholders. The day to day: You will be an experienced leader who specialises in delivering Data Projects using Agile delivery methods and the Data more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … and engage learners during their time studying with BPP and beyond, throughout their working lives. As a Data Engineer, you will report to the Data Engineering Manager. Collaborating closely with teams across BPP P&T department (Data, Product Management, Product Design & Engineering), you will … help deliver and evolve BPP Education’s vision to become more customer centred, design and data informed, to build products that meet and exceed our users’ needs across our education ecosystem. Key responsibilities Run data pipelines to extract data from various source systems (log more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning … visualisations that will drive strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness … your prowess in programming languages and data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our data engineering … capability within the Data Team. At E.ON Next we’re looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in … as part of your data pipelines, taking advantage of templating and parameterisation where needed. Able to make recommendations for data pipeline design based on business requirements. Previous data migration experience is ideal. Be open to new ways of working, and open to working more »

Role: Salesforce Data Architect Location: Remote - UK & Europe Day Rate: £400 Per Day Outside IR35 Length: 6 months Responsibilities: Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions using Salesforce Data Cloud. Configure and customize Salesforce Data Cloud … to meet specific business needs, including data modeling, data cleansing, and data integration. Develop and maintain data pipelines, ETL processes, and data quality rules within Salesforce Data Cloud. Perform data analysis and profiling to identify data inconsistencies, anomalies, and opportunities for improvement. Implement data governance best practices and ensure compliance with data security and privacy regulations. Provide technical expertise and support to troubleshoot issues related to Salesforce Data Cloud configuration and integration. Document technical specifications, data more »

Data Engineer Role purpose: The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and analytics delivery. The Data Engineer will contribute to enhancing our Azure-based data platform using technologies such as Azure Data Factory and Azure Databricks … functional teams including data scientists, analysts, and business stakeholders to understand data requirements, perform UAT and deliver solutions accordingly. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Document data pipelines, workflows, and processes to ensure knowledge sharing more »

business has attracted amazing talent so far, and we don't plan on stopping yet! The Role: Exciting opportunity for a hands-on Data Architect with solid data architecture skills and a good understand of data modelling, BI and reporting to take ownership of … the data platform for a scale up FinTech business. This will suit someone who is strong with data modelling (relational, dimensional, finance industry specific models like FSLDM) and likes learning and building new solutions to complex data challenges using cloud technologies. This will role … will own the enterprise data Lakehouse built on Databricks and data modelling for all layers in a medallion architecture. This role is business facing and requires good stakeholder management and communication skills, able to quickly acquire new skills and take ownership of a complex, multi-layered more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. · A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. · Designing and deploying production data more »

We are looking for a skilled Data Engineer with a strong background in Microsoft CRM to design, develop, and maintain our data pipelines and analytics solutions. The ideal candidate will have a passion for leveraging data to drive … business outcomes and will be adept at working with complex datasets and integrating data from various sources. Key Responsibilities: Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines to extract, transform, and load data from Microsoft CRM and … other relevant sources. Data Integration: Integrate data from Microsoft CRM with other internal and external data sources to create a unified view of customer interactions, sales performance, and other key metrics. Data Modeling: Develop and implement data models to support more »

An experienced Cloud Data Engineering Manager with at least 2-3 years of managing data engineering experience is needed to join the team at this rapidly growing Data Analytics Consultancy based in Oxford. You will be excited to play a pivotal role in leading … career with a well-established company! About the Company Founded in 2014 and based in Oxford, UK, this dynamic analytical consultancy specialises in data analysis, statistical modelling, and various analytical techniques like BI and Risk Management. They provide businesses with custom, secure solutions, primarily working in the cloud … data services (e.g., S3, Athena, Lambda, Glue) Advanced working knowledge in programming languages - specifically Python Hands-on experience in data pipeline development using tools such as AWS Glue Excellent communication and presentation skills, with the ability to articulate complex technical concepts to all stakeholders (non more »

Position: Data Engineer Reporting to: Lead Data Engineer Contract type: Full Time, Remote (with Occasional Travel) This is an exciting opportunity to join one of Europe's fastest growing healthtech startups Cera is a digital-first healthcare-at-home company delivering care, nursing, telehealth and repeat … staff across the UK and Germany, delivering 50,000+ healthcare visits a day, and has grown from zero to nearly $300M revenues. About Data at Cera Data has a critical role to play in two distinct areas. First, data about our operations, covering everything … helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about patient health, covering everything from their conditions to the health outcomes resulting from those conditions, helps us to observe and understand their experience more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Senior Data Engineer Role purpose: The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior … Data Engineer leads the design, development, and maintenance of data pipelines and workflows, driving the organisation's data processing capabilities and enabling the seamless delivery of BI reporting and analytics. In addition to core responsibilities, the Senior Data Engineer takes a proactive … stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives. Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime. Drive comprehensive documentation of data more »

BI Developer that has a strong background in Python and Power BI to join the Software Delivery team to strengthen the power of data within the business. The company is moving its data from legacy stores to a strategic data warehouse and data … coding standards, and tools, while also working collaboratively with the team by utilising communication and problem solving skills. Key responsibilities: Ability to build data pipelines that will allow optimal extraction, transformation, and incorporation of data from various data sources. Be able to utilise Power … enhancements. Improve solutions and be able to anticipate where the demand is for the business. Build analytics tools that utilise the data pipeline to provide key insights for various areas of the business. Automate processes for early feedback. Communicate progress and risk to appropriate teams. Contribute to more »

Data Delivery Lead Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of … superior data services. The Data Delivery Lead is responsible for ensuring the successful and timely delivery of data projects and initiatives. You will lead a team of Brown & Brown and third-party data specialists, manage resources, and act as a bridge between … technical and business stakeholders The day to day: You will be an experienced leader who specialises in delivering Data Projects using Agile delivery methods. Your primary responsibilities will include: Leadership : Overseeing data projects from conception to completion. This includes defining project scope, establishing timelines and budgets more »

last decade, IGS has built its reputation as a leading global provider of vertical farming technology, and is looking to recruit an experienced Data Engineer to join the team. The purpose of this role is to create and productionise data-centric applications and features, data pipelines and data analysis tools in an Azure cloud environment. You will also provide real time control and information for our market leading vertical farming solution. Responsibilities: Build new data-centric applications that are tested at multiple levels and ready for our Azure/… kubernetes production environment Update and add new features to existing applications Work closely with data scientists to automate and productionise machine learning and other complex solutions to business problems Collaborate and communicate with other team members including product managers, crop scientists, hardware, software and IoT engineers Use, update more »

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »

Data Engineer If you’re reading this, we are excited for you. You’ve landed on the job description for a company that will obsesses over your wellbeing with unrivalled work life balance, your career development providing transparent career paths and learning support for every single person, and … industries, read on… Egress Software Technologies are a leading Cyber Security company providing global solutions to protect against human activated risk. By aggregating data to derive intelligence, Egress is the only company able to predict future threats and prevent attacks or breaches – before they happen. Egress is proud … achieve their mission without unnecessary risk. At the forefront of the IT Cyber Security industry, Egress can provide an unrivalled career path in Data Engineering The Team Our Data Platform team is at the heart of Egress, shaping our data infrastructure, analytics, and machine more »