1 to 25 of 445 Data Pipeline Jobs

Key Responsibilities As a Data Architect, you will support the clients in their journey to become data-driven, by capturing and understanding their business needs, and defining and implementing Data and Analytics reference architectures, solutions and roadmaps. Furthermore, you will actively help our practice … in its objective to stay a Leader in Data & Analytics. • Define, guide and advise clients in developing data strategies • Engage with the clients to understand their business needs, pain points and realities • Gather, challenge and prioritize clients data requirements • Define and design innovative Data … architectures and solutions that leverage the right trade-off between clients realities, latest and disruptive technologies, current and future business needs, budget constraints, data availability and resource requirements. • Oversee the design of the data architecture and the technical architecture for the old-fashion and modern data more »

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources more »

Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »

Data Engineer – Hybrid Working £50,000 - £55.000 30 Days Holidays + 4 Days Christmas + Bank Holidays Great Pension Career Development Flexible Working - (Hybrid) A Great Working Environment Excellent Sport & Leisure Facilities Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42 … implement data security measures Design and implement data quality checks and validation processes within the pipelines using expectations with the pipeline, or dedicated testing tools (SODA) Collaborate with data governance, architects, system/product owners and end users to ensure quality issues are … addressed as needed. Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic Contribute to data modelling and schema design standards and related documentation. Qualifications & Requirements Degree in Computer Science, Data Engineering, or a related field or more »

Azure Head of Data Engineering Salary- £90,000 - £110,000 + Excellent benefits Location - Birmingham/Hybrid Key skills - Azure - Databricks - Data factory - Data Lakes - Synapse - Modelling - Agile Role purpose: We are actively seeking a dynamic professional to play a pivotal role in the … organisation and contributing to the exciting digital transformation journey. Reporting directly to the Chief Data Officer, you will lead team of skilled data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive our digital transformation initiatives and support … business reporting requirements. You will be responsible for overseeing all aspects of data engineering, from strategy to implementing cutting-edge technologies like Microsoft and Databricks and will enjoy being hands-on. Collaborating with leaders in the business, Analytics, Data Governance, Data Science and AI more »

Data Quality Engineer (CDP Customer Data Platform) – Camden/Hybrid – 6 month contract £600-£650 per day outside IR35 Are you an experienced Data Quality Engineer with proficiency in SQL and data querying? Are you interested in joining a giant in the … retail and fashion sector? As the Data Quality Engineer you will be at the forefront of the team ensuring data quality is maintained in the overall data, data pipelines and data warehouse. KEY RESPONSIBILITIES Designing and executing comprehensive data validation strategies, including data profiling, data cleansing, and data transformation. Conducting data quality assessments and audits to evaluate adherence to data quality standards and identify areas for improvement. Collaborating with data engineering teams to design and more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … multiple greenfield projects supporting internal business units and external clients Ensure the accuracy and reliability of data across the data pipeline Bring positive innovative ideas that lead to innovative solutions rather than a lift-and-shift mentality Constantly stay up to date on new technologies … Ingestion tools such as FiveTran or Stitch Experience using Business Intelligence tools such as PowerBI, Looker or Tableau Experience with data pipeline tools such as DBT, Airflow or Luigi are a plus! Experience using cloud environments e.g. Azure or AWS Understanding of the Agile delivery method more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data operations team and business stakeholders, work with the wider data team to provide a seamless service to business stakeholders. The day to day: You will be an experienced leader who specialises in delivering Data Projects using Agile delivery methods and the Data more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, BI & Analytics Technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. Reporting directly to the Head of Investments Data, BI & Analytics, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … and engage learners during their time studying with BPP and beyond, throughout their working lives. As a Data Engineer, you will report to the Data Engineering Manager. Collaborating closely with teams across BPP P&T department (Data, Product Management, Product Design & Engineering), you will … help deliver and evolve BPP Education’s vision to become more customer centred, design and data informed, to build products that meet and exceed our users’ needs across our education ecosystem. Key responsibilities Run data pipelines to extract data from various source systems (log more »

the uptake and success of electric vehicles with GRIDSERVE Car Leasing. Everything we do is underpinned and connected by a technology-agnostic, proprietary data platform that grows and improves every day. Get in touch ROLE OVERVIEW Join GRIDSERVE as the Head of Data. This will be a critical … member of our leadership team, responsible for establishing and driving the data vision and strategy across the company. This role involves harnessing the power of data to optimize our operations, enhance decision-making, and unlock innovative solutions in the renewable energy space. You will lead our … journey towards becoming a data-mature organisation, building a team to leverage data for operational excellence, strategic insights, and market innovations.You will be able to communicate complex data concepts in simple business language, cutting out the jargon and getting to the point of what more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning … visualisations that will drive strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness … your prowess in programming languages and data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs more »

The Department of Homeland Security (DHS) is recruiting professionals to support a range of technical roles in Data Science, including Data Scientist, Data Engineers, Artificial Intelligence (AI) Specialist, AI Operations Analyst, Data Modeler, Data Security Officer and Operations Research Analyst. … assessment process for their capability and career track/level) for consideration for these jobs. This announcement is being used to fill the Data Science Talent Pool. By applying to this job announcement, you are opting to be part of the DHS-CS Talent Pool for ongoing consideration … open jobs and will remain eligible for consideration for up to one year from the date of completion. There are a variety of Data Science opportunities across the Department, including supporting several specialized programs at the DHS Office of Strategy, Policy, and Plans (PLCY ) the Cybersecurity and Infrastructure more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our data engineering … capability within the Data Team. At E.ON Next we’re looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in … as part of your data pipelines, taking advantage of templating and parameterisation where needed. Able to make recommendations for data pipeline design based on business requirements. Previous data migration experience is ideal. Be open to new ways of working, and open to working more »

Job summary This is an exciting opportunity to join The Christie's Clinical Outcomes and Data Unit (CODU) as a Senior Data Scientist. The CODU's strategy is to improve patient outcomes through the robust selection, analysis, and visualisation of data. We work closely with colleagues … across the trust to support the use of data in clinical and operational decision making. We are experts in data visualisation, creating data analysis tools, and helping colleagues to use these tools in their daily work. You will be expected to work with the … Analysts, Data Scientists and Statisticians within the team, working on projects with stakeholders throughout the Christie, extracting insights from data collected throughout the hospital to be presented back to clinical and operational teams to inform improvements in the hospital. With your organised, enthusiastic and inquisitive approach more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … science, and engineering discipline. Experience performing data warehouse architecture development and management. Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. · A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. · Designing and deploying production data more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … best of open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data more »

Position: Data Engineer Reporting to: Lead Data Engineer Contract type: Full Time, Remote (with Occasional Travel) This is an exciting opportunity to join one of Europe's fastest growing healthtech startups Cera is a digital-first healthcare-at-home company delivering care, nursing, telehealth and repeat … staff across the UK and Germany, delivering 50,000+ healthcare visits a day, and has grown from zero to nearly $300M revenues. About Data at Cera Data has a critical role to play in two distinct areas. First, data about our operations, covering everything … helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about patient health, covering everything from their conditions to the health outcomes resulting from those conditions, helps us to observe and understand their experience more »