18 Data Pipeline Jobs in the East of England

Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with … business activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the … integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Key Requirements Good understanding and competency in technologies currently used (and available in the marketplace more »

Data Engineer £35,00o To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team as … well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data … build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance Programming languages such as SQL and more »

Role: Graduate Data Engineer Type: 12 months fixed-term Location: Peterborough Ready to utilise your skills to process and extract value from large datasets? Are you passionate about performing root cause analysis on various data? We have an exciting role for you – Graduate Data … and thought leadership. Be part of an exciting team where you will be challenged every day. Work closely with different teams to develop data pipelines. Grow your career, while being exposed to new technologies. The Role As a Graduate Data Engineer , you will help design and … platform services: EC2, EMR, RDS, Redshift, Glue. Ability to work with object-oriented scripting languages: Python, Pyspark. Knowledge of data pipeline and workflow management and their tools such as Airflow. Strong understanding of relational SQL and NoSQL databases, including MongoDB and stream-processing systems: Spark more »

Senior Data Engineer Luton/Hybrid Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Data Engineer providing technical leadership to the Data Engineering team. You will play a major role in adhering to big data best practices whilst building and maintaining reliable data pipelines and products across a range of exciting projects. Bringing a wealth of technical experience in big data platforms combined with excellent skills in development. This role will support the business on the journey from a greenfield big data estate to a mature data more »

for a Business Intelligence Engineer to join our transforming team. This is a great job for someone with experience in building and maintaining data pipelines in a large complex organisation. A bit about the job: Working alongside other Engineers you will be building and maintaining data pipelines into the Claims BI team, creating long lasting data modelling necessary to facilitate reporting and analytics, identifying new data sources, and building out comprehensive data views for your BI colleagues to ingest. You will: Collaborate with and build on the work … of Quantum Data Engineering to build out a governed, strategic, Claims data asset for use across UKGI Collaborate with colleagues across Aviva IT/Quantum to improve the ingestion of 3rd party data, including removing existing manual effort, improving the quality and timeliness of more »

a Lead Business Intelligence Engineer to join our transforming team. This is a great job for someone with experience in building and maintaining data pipelines in a large complex organisation. Acting as a team lead, you will influence and adhere to our Data Asset Strategy, whilst … mentorship, and fostering a culture of continuous learning and growth. A bit about the job: You will be responsible for building and maintaining data pipelines into the Claims BI team, creating long lasting data modelling necessary to facilitate reporting and analytics, identifying new data sources, and building out comprehensive data views for your BI colleagues to ingest. You will: Provide technical leadership to other BI team members to deliver high quality business intelligence solutions to defined timescales Collaborate with and build on the work of Quantum Data Engineering more »

Data Engineer Manager Salary: National £32,000 to £55,000 London £40,300 to £89,600 An exciting opportunity exists within our Data Engineering service for a highly skilled individual to work within our Oracle Cloud environment, which is helping to shape the future of insurance … through cutting-edge data delivery to predictive analytics, data science and underwriting. The team is part of Aviva’s global Data Science Practise (Quantum) and is recognised as a centre of excellence - providing an Oracle Cloud platform that delivers the data needed … will be responsible for developing in languages including SQL, PLSQL and Python, having the necessary skills to work iteratively and liaise directly with data stakeholders. Able to deliver well-structured code to a deadline and take responsibility for the quality of the solution. Maintain and continuously improve our more »

We're embarking on an exciting journey here at AutoProtect, and we're on the lookout for a skilled and motivated Data Analyst to join our team and play a pivotal role in our data-driven journey. Your objective will be to provide the business and … its clients with a trusted, single source of data, with outputs that are easy to use and understand; integrated across all our products and services. The role will be based in our Harlow office and the working pattern will be Monday-Friday, 9am-5pm. The role The key … could be looking after include: Analyse different performance metrics across a range of products to support customer acquisition and engagement; Present and explain data in non-technical terms and engaging with stakeholders at any level; Work with stakeholders, both technical and non-technical to design, spec and build more »

Join our dynamic team as a Software Engineer where you'll drive innovation in data-driven applications for biologics research. From design to deployment, you'll be at the forefront, collaborating with various teams including IT infrastructure, lab automation, and scientists across various therapeutic areas. Your expertise will … craft our end-to-end data capture and processing while ensuring flawless integration with legacy and vendor systems. If you're passionate about cutting-edge technology and making a significant impact, this role is your gateway to contribute to revolutionizing biologics drug discovery process. With one of the … test-driven development ( TDD ) Experience working independently to build MVP software applications, and some familiarity contributing to large codebase. Understanding of data pipeline and ETL process. Familiarity with different tools and cloud service for data enabling application development. Desirable for the role Postgraduate degree or more »

Role: Senior Data Analyst Salary: £35,000 - £40,000 Location: Peterborough – onsite. Our client, a leading retail fashion brand, are looking to recruit a Senior Data Analyst into the team. With Data at the core, they are looking for someone to really help drive … forward the data strategy for the business. Having recently implemented Snowflake, this role will be well suited to those comfortable with creating data pipelines, using various ETL tools, testing data and writing queries. Please take look at some of the core requirements below and … with this role** Key Responsibilities: · Generate and maintain reports on sales performance and marketing activity across various channels. · Extract, manipulate, and analyse commercial data to provide actionable insights. · Create informative dashboards using Tableau. · Identify and resolve data discrepancies. · Maintain reporting for the marketplaces team. · Mentor junior more »

Role: Data Insights Manager ( SQL ) Salary: £45,000 - £55,000 Location: Peterborough – onsite. Our client, a leading retail fashion brand, are looking to recruit a Data Insights Manager into the team. With Data at the core, they are looking for someone to really help … drive forward the data strategy for the business. Having recently implemented Snowflake, this role will be well suited to those comfortable with creating data pipelines, using various ETL tools, testing data and writing queries, whilst managing and growing small teams. Please take look at … some of the core requirements below and apply for a more detailed conversation. **No sponsorship is offered with this role** Key Responsibilities: Data Warehousing Lead the team in building out reports. Use extensive SQL skills to extract and analyse data at a deeper level Move buying more »

Data Engineer Salary: National £28,000 – £43,000. London £30,000 - £50,000. An exciting opportunity exists to join our Data Engineering service team for a highly skilled individual to work within our Oracle Cloud environment, which is helping to shape the future of insurance through … cutting-edge data delivery to predictive analytics, data science and underwriting. The team is part of Aviva’s global Data Science Practise (Quantum) and is recognised as a centre of excellence - providing an Oracle Cloud platform that delivers the data needed to … knowledge including SQL, along with an understanding of insurance, an interest in analytics, good communication and stakeholder management skills, and an interest in data pipelines. A bit about the job: This is a key role within the development and maintenance of various data delivery applications, from more »

Job Title: Data Scientist** **Location: Cambridge, UK** Are you a talented Data Scientist with a passion for applying advanced analytical techniques to solve complex problems? We are seeking a skilled individual with a science or mathematics-based degree to join our dynamic team in Cambridge. **Company … Overview:** We are a leading technology company dedicated to innovation in data analytics and machine learning. Our mission is to transform data into actionable insights that drive strategic decisions and innovation across various industries. **Role and Responsibilities:** - Develop and implement advanced statistical models and machine learning … algorithms. - Analyse large datasets to identify trends, patterns, and correlations. - Collaborate with cross-functional teams to understand business objectives and provide data-driven solutions. - Design and maintain scalable data pipelines and architectures. - Present findings and insights to stakeholders in a clear and concise manner. **Required Skills more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

role demands both high technical aptitude and problem-solving abilities, motivation, and exceptional attention to detail. At Roku, we are a company of data-focused builders, particularly on the Search and Recommendations team. Every day, you'll have the opportunity to assess existing systems and find ways to … applying Machine Learning to concrete problems at large-scale. Strong CS fundamentals, with the ability to write algorithms with ease. Good understanding of data science and machine learning fundamentals like regression, classification, tree-based approach, neural networks, and sequence-based models. Experience with advanced machine learning techniques, including … and artwork. Proven familiarity with NLP approaches like Word2Vec or BERT, including identifying the right KPIs and objective functions. Experience working with big data systems (Spark, EMR, Kafka, S3, Airflow) and programming languages (Java, Scala, or Python). Experience building in-production Machine Learning systems Good understanding of more »

components of the AI infrastructure. Design and deploy scalable and resilient infrastructure solutions to support AI and machine learning initiatives. Manage and optimise data pipelines, storage systems, messaging frameworks and computing resources for efficient data processing and analysis. Integrate machine learning models into production systems, ensuring … and strong proficiency in Python development Deep knowledge of distributed and scalable systems, including proficiency with PostgreSQL, RabbitMQ, and Cassandra. Familiarity with big data technologies such as Hadoop, Spark, or Kafka . Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems. Excellent communication more »

components of the AI infrastructure. Design and deploy scalable and resilient infrastructure solutions to support AI and machine learning initiatives. Manage and optimise data pipelines, storage systems, messaging frameworks and computing resources for efficient data processing and analysis. Integrate machine learning models into production systems, ensuring … and strong proficiency in Python development Deep knowledge of distributed and scalable systems, including proficiency with PostgreSQL, RabbitMQ, and Cassandra. Familiarity with big data technologies such as Hadoop, Spark, or Kafka . Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems. Excellent communication more »