1 to 25 of 31 Big Data Jobs in the North of England

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. About the role and responsibilities: We are looking to fill the position of Data ...

xperience and Education Required Approximately 10 years of industry experience implementing data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, and similar technologies. 3–5 years of team management experience. 3–5 years of consulting experience … preferred). Minimum of 5 years’ experience in data architecture, data modelling, or related disciplines. Bachelor’s degree or equivalent experience required; Master’s degree preferred. Strong knowledge of data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise … data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team … their UK presence; their platform enables an insurance quote to be made to the consumer within 60 seconds, using just 4 clicks. As a Data Software Engineer within the Claims team you will help shape the architecture of data products, building reusable technology that enables teams to ingest ...

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team … their UK presence; their platform enables an insurance quote to be made to the consumer within 60 seconds, using just 4 clicks. As a Data Software Engineer within the Claims team you will help shape the architecture of data products, building reusable technology that enables teams to ingest ...

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team … their UK presence; their platform enables an insurance quote to be made to the consumer within 60 seconds, using just 4 clicks. As a Data Software Engineer within the Claims team you will help shape the architecture of data products, building reusable technology that enables teams to ingest ...

goals through better borrowing. Our customers look to borrow money to enable them to achieve something in their lives - whether that’s making a big life event affordable, buying something they need now without affecting their monthly budget, or getting by until payday. And we’re looking to shape … borrowing team to help build world class service for the bank of the future. You will play a critical role in overseeing our foundational data platforms, identifying and driving opportunities to enhance our current capabilities. Your expertise will be pivotal in allowing us to scale into new global markets ...

goals through better borrowing. Our customers look to borrow money to enable them to achieve something in their lives - whether that’s making a big life event affordable, buying something they need now without affecting their monthly budget, or getting by until payday. And we’re looking to shape … borrowing team to help build world class service for the bank of the future. You will play a critical role in overseeing our foundational data platforms, identifying and driving opportunities to enhance our current capabilities. Your expertise will be pivotal in allowing us to scale into new global markets ...

goals through better borrowing. Our customers look to borrow money to enable them to achieve something in their lives - whether that’s making a big life event affordable, buying something they need now without affecting their monthly budget, or getting by until payday. And we’re looking to shape … borrowing team to help build world class service for the bank of the future. You will play a critical role in overseeing our foundational data platforms, identifying and driving opportunities to enhance our current capabilities. Your expertise will be pivotal in allowing us to scale into new global markets ...

Title: AWS Data Engineer Contract: 6 Months Location: Remote, UK Skills: Advanced knowledge of data management tools including SQL/DBMS, MongoDB, Hadoop and/or other big data technologies. Advanced programming skills in Java, Python, R, C++, C#, etc. Knowledge of statistical and data mining techniques (regression, decision trees, clustering, neural networks, etc.). Experience with data visualization tool is plusExposure to online, mobile, and social data is a plus. Intellectual curiosity, along with excellent problem-solving and quantitative skills, including the ability to disaggregate issues, identify root causes and recommend ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions at pace. Active … clearance is essential, we are seeking DV cleared candidates only. The role You'll design and deploy production-grade data pipelines, from ingestion through to consumption, within a modern big data architecture. Work is delivery focused and delivered using agile engineering practices. Typical responsibilities Build and operate ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that support analytics and operational decision … making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop ...

Company Description At Data Intellect it has never been just about data or technology, they are our tools. It’s about human intellect, collaboration and providing solutions for the most complex of challenges. We do this by living the [DI] code: We are Problem Solvers who are Humble … possess a Can-do Attitude with a focus on Togetherness . “ We are not big on egos, but we’re not for the faint-hearted either ” – Steve Turner, CEO Job Description We are hiring for developers for our growing Market Abuse Surveillance practice. What you’ll be doing: Working ...

technologies in our stack: Clickhouse, Kafka, Pulsar, Python Experience with networking and security concepts Interest or experience with marketing technologies Interest or experience with big data, data analytics, AI and machine learning Ireland (Dublin) or UK (London or Milton Keynes ...

technologies in our stack: Clickhouse, Kafka, Pulsar, Python Experience with networking and security concepts Interest or experience with marketing technologies Interest or experience with big data, data analytics, AI and machine learning Ireland (Dublin) or UK (London or Milton Keynes ...

until Summer 2027. About Jaywing Founded in 1999, and now part of Stubben Edge Group, Jaywing’s heritage is in data science, predictive modelling and analytics that support both our risk and marketing clients. We collate, manage and analyse huge volumes of data to help businesses better understand … debt (IFRS9) and capital (IRB) modelling and management. Our Consulting team have many clients ranging from retail finance houses such as Frasers, to big banks like TSB, start-up lenders like Starling, and public sector organisations. We are seeing increased demand from our clients for our services, and this ...

goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as a Data Science AI Trainer, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Design original computational data … problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks). Develop problems requiring non-trivial reasoning chains in data processing, statistical analysis, feature engineering, predictive modeling, and insight extraction. Create deterministic problems with reproducible answers: avoid stochastic elements or require fixed random seeds ...

goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as a Data Science AI Trainer, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Design original computational data … problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks). Develop problems requiring non-trivial reasoning chains in data processing, statistical analysis, feature engineering, predictive modeling, and insight extraction. Create deterministic problems with reproducible answers: avoid stochastic elements or require fixed random seeds ...

goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as a Data Science AI Trainer, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Design original computational data … problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks). Develop problems requiring non-trivial reasoning chains in data processing, statistical analysis, feature engineering, predictive modeling, and insight extraction. Create deterministic problems with reproducible answers: avoid stochastic elements or require fixed random seeds ...

goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as a Data Science AI Trainer, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Design original computational data … problems are computationally intensive and cannot be solved manually within reasonable timeframes (days/weeks). Develop problems requiring non-trivial reasoning chains in data processing, statistical analysis, feature engineering, predictive modeling, and insight extraction. Create deterministic problems with reproducible answers: avoid stochastic elements or require fixed random seeds ...

pipeline development using GitLab CI Experience with monitoring, logging and alerting tools Understanding of secure DevOps practices in regulated environments Experience working with large data stores or big data platforms Desirable skills: Experience supporting AI or data driven platforms Knowledge of cyber security or fraud prevention … within government or critical national infrastructure environments About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels ...

hiring for Lead Observability & Data Architect/Engineer (SC/DV Cleared) Location: Hybrid - London/Reading/Birmingham/Manchester/Glasgow We are seeking an Enterprise Platform Architect or Senior Data Engineer to design and scale national-critical monitoring fabrics and data hubs. Whether your … background is rooted in core Observability platforms (Opensearch/Elastic/Splunk/OpenTelemetry) or high-scale Data Engineering (Kafka, Python, Airflow, OpenSearch/Lucene), your core mission is the same: transforming billions of raw event logs into actionable, secure streaming telemetry. Should be able to build high-performance ...

dedicated Data Science team is at the forefront of revolutionizing pharma intelligence and how patients gain access to life-saving therapies. Armed with cutting-edge technology and a passion for innovation, we leverage the vast landscape of data to extract actionable insights that drive informed decision making. … unique collaborative approach fosters a dynamic synergy between data science and product development. Our deep expertise in machine learning, artificial intelligence, advanced statistical modelling, and big data, combined with our domain knowledge, enables us to deliver comprehensive solutions that empower our clients to stay ahead ...