1 to 25 of 365 Data Pipeline Jobs

Key Responsibilities As a Data Architect, you will support the clients in their journey to become data-driven, by capturing and understanding their business needs, and defining and implementing Data and Analytics reference architectures, solutions and roadmaps. Furthermore, you will actively help our practice … in its objective to stay a Leader in Data & Analytics. • Define, guide and advise clients in developing data strategies • Engage with the clients to understand their business needs, pain points and realities • Gather, challenge and prioritize clients data requirements • Define and design innovative Data … architectures and solutions that leverage the right trade-off between clients realities, latest and disruptive technologies, current and future business needs, budget constraints, data availability and resource requirements. • Oversee the design of the data architecture and the technical architecture for the old-fashion and modern data more »

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources more »

Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »

Data Engineer – Hybrid Working £50,000 - £55.000 30 Days Holidays + 4 Days Christmas + Bank Holidays Great Pension Career Development Flexible Working - (Hybrid) A Great Working Environment Excellent Sport & Leisure Facilities Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42 … implement data security measures Design and implement data quality checks and validation processes within the pipelines using expectations with the pipeline, or dedicated testing tools (SODA) Collaborate with data governance, architects, system/product owners and end users to ensure quality issues are … addressed as needed. Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic Contribute to data modelling and schema design standards and related documentation. Qualifications & Requirements Degree in Computer Science, Data Engineering, or a related field or more »

Data Quality Engineer (CDP Customer Data Platform) – Camden/Hybrid – 6 month contract £600-£650 per day outside IR35 Are you an experienced Data Quality Engineer with proficiency in SQL and data querying? Are you interested in joining a giant in the … retail and fashion sector? As the Data Quality Engineer you will be at the forefront of the team ensuring data quality is maintained in the overall data, data pipelines and data warehouse. KEY RESPONSIBILITIES Designing and executing comprehensive data validation strategies, including data profiling, data cleansing, and data transformation. Conducting data quality assessments and audits to evaluate adherence to data quality standards and identify areas for improvement. Collaborating with data engineering teams to design and more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … multiple greenfield projects supporting internal business units and external clients Ensure the accuracy and reliability of data across the data pipeline Bring positive innovative ideas that lead to innovative solutions rather than a lift-and-shift mentality Constantly stay up to date on new technologies … Ingestion tools such as FiveTran or Stitch Experience using Business Intelligence tools such as PowerBI, Looker or Tableau Experience with data pipeline tools such as DBT, Airflow or Luigi are a plus! Experience using cloud environments e.g. Azure or AWS Understanding of the Agile delivery method more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data operations team and business stakeholders, work with the wider data team to provide a seamless service to business stakeholders. The day to day: You will be an experienced leader who specialises in delivering Data Projects using Agile delivery methods and the Data more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … and engage learners during their time studying with BPP and beyond, throughout their working lives. As a Data Engineer, you will report to the Data Engineering Manager. Collaborating closely with teams across BPP P&T department (Data, Product Management, Product Design & Engineering), you will … help deliver and evolve BPP Education’s vision to become more customer centred, design and data informed, to build products that meet and exceed our users’ needs across our education ecosystem. Key responsibilities Run data pipelines to extract data from various source systems (log more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning … visualisations that will drive strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness … your prowess in programming languages and data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our data engineering … capability within the Data Team. At E.ON Next we’re looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in … as part of your data pipelines, taking advantage of templating and parameterisation where needed. Able to make recommendations for data pipeline design based on business requirements. Previous data migration experience is ideal. Be open to new ways of working, and open to working more »

Role: Salesforce Data Architect Location: Remote - UK & Europe Day Rate: £400 Per Day Outside IR35 Length: 6 months Responsibilities: Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions using Salesforce Data Cloud. Configure and customize Salesforce Data Cloud … to meet specific business needs, including data modeling, data cleansing, and data integration. Develop and maintain data pipelines, ETL processes, and data quality rules within Salesforce Data Cloud. Perform data analysis and profiling to identify data inconsistencies, anomalies, and opportunities for improvement. Implement data governance best practices and ensure compliance with data security and privacy regulations. Provide technical expertise and support to troubleshoot issues related to Salesforce Data Cloud configuration and integration. Document technical specifications, data more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. · A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. · Designing and deploying production data more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Position: Data Engineer Reporting to: Lead Data Engineer Contract type: Full Time, Remote (with Occasional Travel) This is an exciting opportunity to join one of Europe's fastest growing healthtech startups Cera is a digital-first healthcare-at-home company delivering care, nursing, telehealth and repeat … staff across the UK and Germany, delivering 50,000+ healthcare visits a day, and has grown from zero to nearly $300M revenues. About Data at Cera Data has a critical role to play in two distinct areas. First, data about our operations, covering everything … helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about patient health, covering everything from their conditions to the health outcomes resulting from those conditions, helps us to observe and understand their experience more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Senior Data Engineer Role purpose: The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior … Data Engineer leads the design, development, and maintenance of data pipelines and workflows, driving the organisation's data processing capabilities and enabling the seamless delivery of BI reporting and analytics. In addition to core responsibilities, the Senior Data Engineer takes a proactive … stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives. Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime. Drive comprehensive documentation of data more »

BI Developer that has a strong background in Python and Power BI to join the Software Delivery team to strengthen the power of data within the business. The company is moving its data from legacy stores to a strategic data warehouse and data … coding standards, and tools, while also working collaboratively with the team by utilising communication and problem solving skills. Key responsibilities: Ability to build data pipelines that will allow optimal extraction, transformation, and incorporation of data from various data sources. Be able to utilise Power … enhancements. Improve solutions and be able to anticipate where the demand is for the business. Build analytics tools that utilise the data pipeline to provide key insights for various areas of the business. Automate processes for early feedback. Communicate progress and risk to appropriate teams. Contribute to more »

Data Delivery Lead Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of … superior data services. The Data Delivery Lead is responsible for ensuring the successful and timely delivery of data projects and initiatives. You will lead a team of Brown & Brown and third-party data specialists, manage resources, and act as a bridge between … technical and business stakeholders The day to day: You will be an experienced leader who specialises in delivering Data Projects using Agile delivery methods. Your primary responsibilities will include: Leadership : Overseeing data projects from conception to completion. This includes defining project scope, establishing timelines and budgets more »

last decade, IGS has built its reputation as a leading global provider of vertical farming technology, and is looking to recruit an experienced Data Engineer to join the team. The purpose of this role is to create and productionise data-centric applications and features, data pipelines and data analysis tools in an Azure cloud environment. You will also provide real time control and information for our market leading vertical farming solution. Responsibilities: Build new data-centric applications that are tested at multiple levels and ready for our Azure/… kubernetes production environment Update and add new features to existing applications Work closely with data scientists to automate and productionise machine learning and other complex solutions to business problems Collaborate and communicate with other team members including product managers, crop scientists, hardware, software and IoT engineers Use, update more »

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »

management firm that utilizes long-short equities, long-only, fixed income and commodities futures strategies across its funds seek to add a experienced Data Engineer Risk Developer. They have deep expertise in trading, technology and operations and attribute their success to rigorous scientific research. As a technology and … data - driven firm, they design and build their own cutting - edge systems, from high- performance trading platforms to large- scale data analysis and compute farms. The group manages the lifecycle of data used by investment for trading, backtesting and research. Working with quants and … strong understanding of data engineering principles and best practices) experience in database technologies (PostgreSQL, SQL), and query optimization with data pipeline development and automation. coding skills (mainly with Python) knowledge (understanding of risk concepts such as VaR calculations) and good understanding of statistics with version more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Data Engineer – Hybrid (3 days in Office) Stratford-Upon-Avon £56k + 5% bonus & benefits Do you want to grow your expertise and experience and use your skills in a vibrant environment where teamwork, creativity, diversity, inclusivity, and technical excellence are expected and enjoyed? This SaaS company are … associates to principals, applying your technical and problem-solving capabilities to scale their applications. You’ll contribute to the organisation’s high-quality data engineering practices, participating in technical design, implementation, testing, deployment, and ongoing support and maintenance of the data platform. By going above and … beyond implementing new features, the company focus on customer experience, building a high-quality, secure, and scalable data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your more experienced colleagues, including: Pair and mob-programming. Peer code reviews. more »