1 to 25 of 298 Remote Data Pipeline Jobs

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

governance, security and accessibility across data platforms Develop scalable data transformation logic using Python, SQL and Spark-based frameworks Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency Work closely with data scientists, analysts and engineering teams … initiatives Implement best practices for data modelling, metadata management and data lineage Produce technical documentation including data architecture, pipeline design and data flow diagrams Support continuous improvement of data platforms through optimisation, automation and performance tuning Qualifications and experience ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Title: Senior Data Engineer Location: Warwick (Hybrid Working) Rate: £550 - £650 per day (Umbrella) Contract: Initial 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead the design, development, and maintenance of data integration solutions and data … develop, and maintain ETL/ELT processes utilising tools such as Matillion. Create and maintain optimal data flows and data pipeline architectures. Develop and manage data warehouse objects, including tables, views, and security roles in Snowflake. Extract data from diverse sources ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Data Engineer Job Location: Preston - Hybrid- 1 day a week onsite. We offer a range of hybrid and flexible working arrangements - please speak to your recruiter about … modelling practices * Designing and implementing ETL pipelines using SSIS for data integration to ensure ETL processes performs optimally * Troubleshooting; identifying and fixing pipeline bottlenecks and data issues * Understanding of data governance, data quality, and best practices The Data Management ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Data Engineer Job Location: Preston – Hybrid- 1 day a week onsite. We offer a range of hybrid and flexible working arrangements – please speak to your recruiter about … modelling practices Designing and implementing ETL pipelines using SSIS for data integration to ensure ETL processes performs optimally Troubleshooting; identifying and fixing pipeline bottlenecks and data issues Understanding of data governance, data quality, and best practices The Data Management ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With The Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety … projects and sectors. Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference ...

matrices, and reporting structures. Lead validation of large-scale datasets across landing, raw, validated, curated, and reporting zones. Oversee ETL and data pipeline testing, including source-to-target validation, data reconciliation, transformation rule verification, schema validation, and data lineage checks. Drive automation opportunities … data quality, regression testing, and pipeline validations. Manage functional, integration, regression, UAT, and production validation cycles. Demonstrate strong ETL/Data Testing expertise across SQL, Oracle, Big Data (Hive, HBase, HDFS), and Azure ADF/ADB. Validate large-scale data migrations ...

arriving from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team.Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. * Ensure Silver and Gold layer data products are fit for purpose … modelling - conceptual, logical and physical. Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … Summary: The Senior data engineer role will have a specific focus on data and integration, ensuring that they drive single version of the truth by developing and maintaining reliable solutions to store and manage key data. The role will source, model, and provide data ...

modern AWS-native technology stack including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, and DynamoDB. You will own testing across automated pipelines, data workflows, and cloud infrastructure - identifying risks, championing test frameworks, and coaching colleagues in quality engineering practices. This is a hands-on, technically deep role. … modern AWS-native technology stack including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, and DynamoDB. You will own testing across automated pipelines, data workflows, and cloud infrastructure - identifying risks, championing test frameworks, and coaching colleagues in quality engineering practices. This is a hands-on, technically deep role. ...

efficient data processing, storage and retrieval. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability. The tasks for this post include the following: Analyse existing data pipelines … optimisation, and scalability. Work closely with Bioinformaticians and annotators to integrate data pipelines with existing systems and applications. Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency. Stay current with industry trends and best practices in data engineering ...

work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time. Data Architect - why this role matters to you: Work for Delta Defense, the private company that provides Marketing, Operations and Customer Service for the U.S. … Carry Association. The USCCA safeguards life, freedom, and finances for responsible American protectors. Learn more about the USCCA at Join us as a Data Architec t on the Enterprise Data Warehouse Team, where you will play a hands-on role in shaping and building ...

Senior Data Planner This role owns relationships with external data vendors and is accountable for ensuring externally sourced data is technically fit, well-integrated, governed, and delivers long-term value across the organisation. Client Details Senior Data Planner The employer … services and supporting the community. As a large organisation, it offers a professional and structured environment with opportunities for impactful work. Description Senior Data Planner Define and deliver the external data sourcing strategy, ensuring alignment with enterprise data architecture, analytics ambitions, and business priorities ...

Head of Data Bristol (Hybrid) From £90k Certified B Corp The Opportunity At Ecosurety, we’re at a pivotal point in our growth. We’re a strong, established business, now placing increased focus on building out a product range that helps organisations make critical decisions about their packaging … improving sustainability while reducing costs. At the centre of this is a platform that brings together fragmented packaging data, applies complex regulatory logic, and enables customers to model packaging decisions across multiple markets. As this platform evolves, there’s a clear opportunity to go further - moving beyond reporting ...

deploying top-tier engineers into mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid … working with flexibility Collaborate with high-performing engineering teams Exposure to modern data stacks and cloud technologies Clear progression in a growing consultancy The Role You’ll design, build, and optimise data pipelines and systems that support critical business decisions. Key Responsibilities Build and maintain data ...

Data Engineer Location: Belfast (Hybrid) Eligibility: UK work authorisation required (no sponsorship available) Are you a Data Engineer looking to work on modern cloud data platforms and play a key role in shaping how data drives business performance? This is an opportunity … governance and best practices across the wider team What you'll bring: * Strong experience in data engineering and data pipeline development * Excellent SQL skills * Hands-on experience with Azure data tools (ADF, Databricks, Synapse, SQL MI) * Experience working with relational databases ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

Microsoft Fabric Data Engineer - Senior/Principal Location: Hybrid - 2-3 days onsite in Warrington (travel/expenses will be covered) Permanent Salary: Depending on experience Our client is seeking a highly skilled Microsoft Fabric Data Engineer at Senior or Principal level to lead the design … Collaboration Act as a technical authority for Microsoft Fabric, championing best practice and platform adoption. Mentor engineers, providing guidance on data modelling, pipeline optimisation and Fabric capabilities. Collaborate with BI developers, product managers and business teams to create data products that are accessible, scalable ...

high-performance data products. This role will require strong technical skills across data modeling, distributed data processing, ELT pipeline development, and dashboarding, with an emphasis on automation, observability, and engineering best practices supporting our EU and UK commercial data warehouse. … including query optimization). Proven experience with distributed systems and large-scale datasets (TB scale). Experience implementing CI/CD pipelines, data testing, and infrastructure as code. Solid understanding of data governance, security, and compliance in enterprise environments. Why This Role? Working as a Data ...

Head of Enterprise Data Delivery Salary £80,000 (plus car allowance of £5,900) Location Hybrid - Milton Keynes or Boston Permanent, Full Time Data,transformationand governance - this role has it all! As Head of Enterprise Data Delivery atAmplius,youllshape how data is built,managedand delivered across the clear direction and standards, making sure data is consistent,reliableand easy to use. By bringing structure to complex, fragmented data,youllhelp improve reporting and support better, more confident decision-making. Salary: £80,000 (plus car allowance ...

Head of Enterprise Data Delivery Salary £80,000 (plus car allowance of £5,900) Location Hybrid - Milton Keynes or Boston Permanent, Full Time Data,transformationand governance - this role has it all! As Head of Enterprise Data Delivery atAmplius,youllshape how data is built,managedand delivered across the organisation.Youllset clear direction and standards, making sure data is consistent,reliableand easy to use. By bringing structure to complex, fragmented data,youllhelp improve reporting and support better, more confident decision-making. Salary: £80,000 (plus car allowance ...

Consultant/Data Engineer Location: Telford or Worthing (hybrid working 2 days onsite) Type: Full Time, Permanent Salary: £50,000 - £70,000 DOE + comprehensive benefits package Deerfoot Recruitment is working with a major consultancy partner on a long-term public sector engagement and is seeking experienced … Senior Data Engineer/Analytics Engineer/Data Platform Engineer/Data Integration Engineer/Data Pipeline Engineer/Data Solutions Engineer/Enterprise Data Engineer Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy ...

Head of Enterprise Data Delivery Salary £80,000 (plus car allowance of £5,900) Location Hybrid - Milton Keynes or Boston Permanent, Full Time Data, transformation and governance - this role has it all! As Head of Enterprise Data Delivery at Amplius, you’ll shape … data is built, managed and delivered across the organisation. You’ll set clear direction and standards, making sure data is consistent, reliable and easy to use. By bringing structure to complex, fragmented data, you’ll help improve reporting and support better, more confident decision ...