16 Contract Data Pipeline Jobs in the UK

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Data Engineer - 5 Month Remote Contract Interviewing now for a Data Engineer for a remote project (Outside IR35.) We are seeking an experienced Data Engineer responsible to develop and deliver data solutions, optimising data to ensure data availability … and accuracy. You will extract data from the Datalake using Big Query. You will Build data pipelines from gathered requirements to support delivery of data solutions. You will also track down discrepancies with data across the integration points and report data … Market Rates (Outside IR35) Location: Remote/UK Start: ASAP Skills -Previous experience in database services, design, implementation and experience at enterprise level data platforms, data lake concepts and data handling. - Proficient with SQL, joins, PKs, FKs, referential integrity. -Previous data warehouse more »

New 1 year contract opportunity for a mid-senior (outside IR35) Data Engineer to join an independent Civil Society with immediate effect. Data Engineer Responsibilities Design and implement scalable data architectures for large-scale web-scraping tools. Develop and optimize data pipelines … for ETL from online platforms, including textual and unstructured data, and REST APIs. Test, validate, and secure acquired data to ensure accuracy and quality. Work closely with the AI/ML Engineer to ensure seamless integration and alignment of data and AI … models. Data Engineer Required Experience Data engineering experience (2+ years) Cloud platform proficiency (e.g., AWS, Azure, GCP) Data pipeline development (e.g., Airflow, Apache Spark) SQL proficiency, database design Visualization tools knowledge (e.g., Tableau, PowerBI, Looker) Data Engineer Application Process This is more »

consultancy client. The successful candidate will be responsible for designing, developing, and maintaining KDB databases, as well as creating and optimizing Real Time data analytics solutions. You will work closely with the technology team to enhance our data management systems, ensure data accuracy and … integrity, and help us make data-driven decisions. Key Responsibilities: Design and develop KDB databases and data processing systems to support Real Time data analysis and reporting. Optimize database performance, troubleshoot issues, and implement improvements as needed. Collaborate with data analysts and … other teams to understand data requirements and develop efficient data retrieval processes. Write and maintain KDB Q scripts, ensuring code is well-documented and follows best practices. Monitor data quality and accuracy, implementing data validation and cleansing processes. Develop and maintain data more »

Azure Data Engineer I am currently working with a client in Bristol who is looking for an experienced Azure Data Engineer to provide assistance on an ongoing project for the next 6 months! Role: Azure Data Engineer Rate: £500 - £650 per day Duration … Months Location: Bristol - 5 days a week onsite work Status: Inside IR35 Role Overview: As a Azure Data Engineer, you'll be at the forefront of crafting, innovating, and sustaining data solutions within the Azure ecosystem. Your mastery will be instrumental in steering data initiatives towards success, ensuring they're finely tuned for performance, scalability, and dependability. Key Responsibilities: Craft, refine, and deploy data pipelines and ETL workflows within Azure's expansive framework. Leverage Azure's suite of services, including Azure Data Factory, Azure Databricks, and Azure Synapse more »

Position: Azure Data Engineer Contract Length: 6 months Location: Bristol, UK (5 days onsite) IR35 Status: Inside IR35 Rate: £500 - £650 per day Role Overview: As an Azure Data Engineer, you will play a pivotal role in designing, developing, and maintaining data solutions on … the Azure platform. Your expertise will drive the success of data projects, ensuring optimal performance, scalability, and reliability. Key Responsibilities: Design, develop, and implement data pipelines and ETL processes on Azure. Optimize and troubleshoot data solutions to ensure performance and reliability. Collaborate with cross … functional teams to understand business requirements and translate them into technical solutions. Utilize Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics to build robust data architectures. Implement best practices for data governance, security, and compliance. Skills and Qualifications: Proven more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: * Perform system administration on specific cyber defence applications and systems … network tools in response to new or observed threats within the network environment or enclave. * Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. * Implement data management standards, requirements, and specifications. * Develop data standards, policies, and procedures. * Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. * To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: * Knowledge of big data more »

Test Architect - Automation of Data & Analytics London (Hybrid) 6 Month Contract £5 50 - 625/day (Outside IR35) A highly skilled Test Architect needed with active SC Security Clearance for a 6 Month Outside IR35 contract. Hybrid working with the expectation of 2 days/week on-site … large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Architect and design the automation framework for testing data and analytics projects, including data pipelines, data warehouses, and analytics applications. Expertise in Total Landscape, Banking experience, Cloud Testing, Data … with scripting and programming languages such as Python, Java, SQL. Must offer a solid background in banking and financial experience, COTS products, and Data Modernization/transformation programs. Designing and implementing testing strategies and solutions. A deep understanding of the testing landscape, banking industry, cloud technologies, data more »

Job summary We have an exciting opportunity for a data scientist to join a unique team aiming to reduce to reduce health inequalities in North East London within the next 3 years. We are looking for a talented and collaborative colleague, who wants to make a difference. The … postholder will work with clinical, data and academic teams to use Natural Language Processing techniques on free-text combined with Electronic Health Record datasets to build a predictive geographical map of heart disease in North East London, allowing better targeting and delivery of diagnostic testing. Main duties of … the job The Barts Health PREDICT project aims to leverage real-world patient data to extract clinical and social determinants of cardiovascular health, and then identify at-risk social and geographic groups who will have enhanced access to echocardiography, a clinical test that can detect heart disease years more »

Data Engineer- Leicester I'm currently looking for a Data Engineer to join a company that is based in Leicester. They need someone to start in the next few weeks. Location: Leicester (on site 2-3 times a week) Length: 12 months Day Rate: £400 per … day. IR35 Status: Inside of IR35 Required experience will include: Expertise in designing and implementing data pipelines using Azure services such as Azure Data Factory , Azure Databricks and DBT . Hands-on experience with SQL database design Experience of product lifecycle management principles and tools (e.g. … DevOps , terraform ) and relational database manipulation and interrogation. If you are interested in this Data Engineer role please apply with your most recent CV. Alternatively email me on George . batson @ Randstad . co . uk Data Engineer- Leicester Randstad Technologies is acting as an Employment more »

Job Title: Data Engineer Duration: 6 months initially Rate: £600 - 650/day umbrella Location: Bristol (Hybrid 2 times a week) Overview: Seeking a skilled data engineer with a strong background in database management, warehousing and ETL's, with experience in designing and implementing efficient data … Responsibilities Utilize expertise to ensure program solutions meet Technology Operations requirements. Optimize database performance via index strategies, resource allocations, and efficient queries. Automate data workflows, including exception processes, to enhance operational efficiencies. Collaborate with cross-functional teams to understand data requirements and provide technical guidance. Key … technologies Snowflake (Must) Matillion (Must) Financial services experience (Must) Database Management Data Modelling SQL SSIS ETL Developing Database To be considered for this role, please submit your CV in application. We will contact you within 72 hours if your skills are relevant to our client's requirement. ea more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Skills/Experience: Previous experience of Enterprise ICS/network architectures … and technologies. * Working with frameworks and technologies that support data-intensive distributed applications. * Experience maintaining and administrating data analytical and SIEM platforms. * Experience using host and network-based IDS/IPS * Experience using packet capture solutions. * Skill in developing and deploying signatures. * Skill to apply cybersecurity … network tools in response to new or observed threats within the network environment or enclave. * Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. * Implement data management standards, requirements, and specifications. * Develop data more »

building products that are performant, scalable, and robust to support critical transportation processes. You build web applications that delight our customers, and complex data pipelines to process the data that serves them. We will give you the space to explore new technologies and approaches, and apply … job responsibilities working with AWS technologies such as Lambda, ECS Fargate, API Gateway, RDS, DynamoDB, EMR building customer-facing applications and APIs building data pipelines using Spark + Scala that process Tb of data per day working with customers to understand the business context of new more »

CI/CD tools, capable of building and managing pipelines Proficient coding skills, ideally in Python Experience in building and deploying tools for data pipelines Familiarity with cloud-native technologies like Kubernetes or Docker Experience deploying open-source technologies Benefits: Competitive salary Excellent pension Remote working opportunity Dedicated … budget Apply now for this exciting opportunity to lead innovative projects and advance your career. Important Information: We endeavour to process your personal data in a fair and transparent manner. In applying for this role, Additional Resources will be acting in your best interest and may contact you more »