26 to 50 of 336 Data Pipeline Jobs in England

an experienced Software Engineer to join their R&D Team. The R&D Team is responsible for transforming complex legal information challenges into data-driven tools that can be integrated into their product portfolio. Tech Stack Storage: S3 (object storage), DynamoDB (rapid retrieval) Search & Analytics: Elastic Search Core … Python and TypeScript Proficiency with modern front-end frameworks, particularly React Strong understanding of HTML5, JavaScript, and CSS3 Experience with building complex systems, data pipelines, and cloud-based APIs Comfortable in an agile and iterative team environment Fast learner with the ability to master new technologies Excellent communication more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team is committed … integrations and click-stream ingestion. Proven ability in stakeholder management and project leadership. Proficiency in SQL, Python, PySpark. Solid background in data pipeline orchestration, data access, and retention tooling. Demonstrable impact on infrastructure scalability and data privacy initiatives. A collaborative spirit, innovative problem … integrations and click-stream ingestion | Proven ability in stakeholder management and project leadership | Proficiency in SQL, Python, PySpark | Solid background in data pipeline orchestration, data access, and retention tooling | Demonstrable impact on infrastructure scalability and data privacy initiatives | Collaborative spirit | Innovative problem-solving more »

traders and risk managers on the design and implementation of the pricing platform. Conduct real time analysis of dataset quality, investigate errors in data pipelines and liaise with various teams to resolve any issues. Drive automation of legacy pricing systems. Streamline the research process, enabling efficient deployment of more »

Role Overview The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for running a small data engineering team, planning … team members’ workloads and utilising your experience to guide the team to solutions to complex problems. You will be responsible for ensuring that data shared across borders, whether to our parent company, subsidiaries, or approved third parties, observes expected safeguards, technical controls, and minimization techniques to comply with … Manage, scale, and mentor team of data engineers Work with stakeholders on priorities and roadmap for data analytics, customer pipelines, data models, and data infrastructure Design and develop new data flows and integrations to support the international migration to a more »

Data Engineer – London - £100,000 Description My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as … being able to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP. Responsibilities Designing and implementing scalable and efficient data storage solutions on Azure. Building and maintaining … with data scientists and analysts to understand their requirements and develop optimized data models. Monitoring and troubleshooting data pipeline performance issues. Implementing security measures to protect our data assets. Conducting regular data quality checks and applying necessary fixes. Keeping more »

Data Engineer Do you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! 📍 Location : London, UK As a Data Engineer , you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts. … Responsibilities: 📈 Data Pipelines 🔗 Data Integration 🗄️ Databases 🤝 Collaboration 🔄 Automation 🔐 Security What we would love to see from you! 🎓 Education : Master’s in CS, Engineering, Mathematics, or related field 📊 Experience : Proven Data Engineer experience, preferably in finance 💻 Skills : Python, SQL, NoSQL, big data tools more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400+), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions … real business results, a stark contrast to the generic approaches often found at larger agencies. “Leading with Relationships and Results” As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. … You'll combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw … data is prepared into clear and coherent presentations for the stakeholders. The successful candidate will be someone with at least 3-5 years’ experience in a similar environment, strong SQL and Python knowledge and with the ability to communicate effectively with senior stakeholders. Role & Responsibilities: Collaborating with stakeholders … to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained more »

a critical role in developing and implementing machine learning models to drive the company’s products and services. You will work closely with data engineers and other stakeholders to ensure the scalability and performance of the solutions. This is a hybrid role with some travel to Manchester and … London to meet business requirements. Key Responsibilities: Design, develop, and deploy machine learning models Collaborate with data engineers to manage and optimise data pipelines Implement data governance and data management best practices Work with AWS tools, including Glue and SageMaker, to build … Participate in code reviews and contribute to the improvement of the development processes Key Skills and Qualifications: Proven experience in machine learning and data engineering Proficiency in Python Experience with AWS services, particularly Glue and SageMaker Strong understanding of data governance and data management more »

We are looking for a Data Engineer to join our Y Combinator backed start-up. They are using AI and ML technology to build a SaaS product. You will be working closely with the Data Scientists and wider engineering teams. Responsibilities Maintaining Python/SQL ETL … capabilities Collaborate with several teams to provide technical solutions Requirements Early-stage start-up passion Strong Python knowledge Experience building and optimizing "big data" pipelines more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … science, and engineering discipline. Experience performing data warehouse architecture development and management. Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality more »

Portfolio Manager and other investment professionals. Testing and deploying programs and applications. Troubleshooting, debugging, maintaining and improving existing software. Build and maintain robust data pipelines and databases that ingest large amounts of data every day, while developing processes that validate the integrity of the data. Qualifications more »

Data Analysis Specialist Methods are looking for a Data Analysis Specialist to work on an initial 7 month contract with a fantastic client of ours. The engagement will run for 7 months, with a view to extend further. The position has been confirmed to fall Inside … IR35. PURPOSE OF THE JOB: The Data Analysis Specialist role is primarily focused on running, extending and enhancing data analytics with Data Analyst. As a Data Analysis Specialist, you will be responsible for generating data report and get providing insight … to senior management with digitalized documents. Also, Using various systems to gather information such as SCM and ERP. Reporting to the Data Analyst who will work closely with you and supporting team to deliver to achieve key targets. And you will be involved in various different work streams. more »

Senior Python Data API Developer The Role: Ocean Red Partners are currently looking for a Senior Python Data API Developer. The responsibilities include participating in all phases of the software development lifecycle and knowledge transfer where required. This role is a consultative position so will require … automation Manage testing and bug fixes Integrate front-end components into applications Implement software enhancements and suggest improvements Requirements Solid experience as Python Data API Developer Experience developing Python APIs and documentation Experience with automated diagram generation Experience with data pipelines tooling e.g. Databricks Attention to more »

since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »

A specialist Fintech SME that provides advanced data to Capital Markets is in search of a Technical Support Engineer to join their order team. • Technical Support Engineer • £60k • Fintech • Hybrid Remote (London), Shares, flexible working You’d be joining a small but efficient Op’s team to monitor … these production applications and to make sure our daily batch jobs. You’ll use your knowledge of these data pipelines to troubleshoot potential production issues and escalate to relevant teams internally/externally. The company is a Market leader in Data Analytics, providing Financial services for … the Capital Markets. They recently secured a Series B investment, and have won awards for being Lead Data Provider. The role is hybrid remote, with 2/3 days per month in the London office. An ideal candidate will need to have experience in Python/Bash scripting more »

Job Title: Cloud Data Engineer Location: Knutsford, UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Knutsford, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data … Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow . Knowledge of SQL and ability to write complex queries for data transformation and analysis. Understanding of more »

Are you an experienced Senior Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days … site. Preferred skills: Experience with Azure and Databricks Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking sector or financial services would more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a … brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data and work within an organisation who are providing significant investment into all of their data teams. The teams itself are growing in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks more »

Data Engineer Manchester Hybrid (2-3 days per week in the office) Salary: Flexible dependent on experience Discretional Bonus Structure Private Medical/Dental insurance/Nursery Scheme A global law firm is seeking a talented Data Engineer to join its team and help shape its … data landscape. The role involves driving data projects from start to finish. The be successful in the role you will need strong experience with SQL and Azure Data Lake. Key Responsibilities of the Data Engineer: Reviewing and improving existing systems and data pipelines. Developing and deploying data pipelines in Azure. Integrating data from various sources. Ensuring data services are automated, reliable, and secure. Enhancing data efficiency and quality. SQL normalization. Additional Responsibilities as a Data Engineer: Cleaning and structuring data more »

Data Engineer (6-Month Contract) - £450 per day inside IR35 Birmingham/Hybrid We are recruiting on behalf of a leading company dedicated to innovative solutions in waste management. As part of our ongoing commitment to excellence, we are currently seeking a skilled Data Engineer to … join our Commercial Waste programme on a 6-month contract basis. Role Overview We are looking for a talented Data Engineer to support enterprise data platforms and warehouses in Azure. You will play a crucial role in gathering detailed requirements from business sponsors/owners and … executing data ingestion and modelling tasks. Experience in producing Power BI reports is desirable but not essential. Key Responsibilities Collaborate with business sponsors and owners to understand and document detailed requirements. Design, develop, and maintain data pipelines using Azure Data Factory and Azure Databricks. more »

At AX, we are looking for a Data Engineering Lead to join our dynamic team. As the Data Engineering Lead you will have a strong background in data analysis, team management, and expertise in utilizing various Microsoft BI tools and cloud-based technologies including … SSRS, SSIS, SSAS, Azure Synapse, Azure Data Factory and lakes and curated business models. A little bit about us AX is an accident assistance and after care service provider who deliver replacement vehicles to customers who have been involved in non-fault accidents. We pride ourselves on keeping … and engaging with our colleagues is fundamental to ensure we provide an industry leading service to our partners and our customers. As our Data Engineering Lead, your responsibilities will include: Team Leadership Provide leadership, guidance and support to team members, ensuring the successful execution of projects and tasks. more »

Senior Software Engineer - £110k - Hybrid Working Opportunity for a tech-savvy innovator with a passion for data-driven solutions to join a global data-centric company as a Senior Software Engineer, helping to shape the future of clients' data strategies and engineering practices. They … specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. Requirements: Experience … with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »

Senior Data Engineer opportunity to join a well-known financial services company working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job … Advise on and ensure the maximum return of value from the company's data assets; through use of best practice data engineering techniques that aid the delivery of the company's data management strategy and roadmap and align to regulatory requirements. Contribute towards the … support, maintenance, and improvement of the company's platform inc data pipelines, and ensure data quality and governance. Responsibilities Advise on the Design, implementation, and maintenance of complex data engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to more »

Job Role: Principal Data Engineer Job Type: Contract IR35 : Inside IR35 Day Rate: £600/Day Contract Duration: 6 months Working Hours: 5 days per week Remote Working : 4 days remote working. 1 day on-site in London Location: Hybrid Remote/London (UK only) Reference : BH-299c … Role Overview: We are seeking an experienced Principal Data Engineer to join our client's team. You will lead the Data Engineering Acceleration initiative, designing, building, and transitioning a robust data management system that optimises data lifecycle management. Key Responsibilities: A cross … discipline professional who can collaborate with multiple teams, such as DataOps, Data Analytics, Software Development teams, to design solutions with them Provide expert advice and support in designing efficient processes for data discovery, profiling, quality, encryption, and pipelines. Document compliance, security, and data sovereignty more »