9 of 9 Big Data Jobs in the North of England

frameworks. About the Role We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. … hands-on technical leadership with test strategy ownership . You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions at pace. Active … clearance is essential, we are seeking DV cleared candidates only. The role You'll design and deploy production-grade data pipelines, from ingestion through to consumption, within a modern big data architecture. Work is delivery focused and delivered using agile engineering practices. Typical responsibilities Build and operate ...

Copello are looking for an experienced Data Engineer to join a growing team delivering data solutions within secure government environments. You'll design and develop scalable data pipelines, integrate data from multiple sources, and build high-performance data platforms that support analytics and operational decision … making. Key Responsibilities: Design and build data pipelines and ingestion processes Develop scalable data integration and processing solutions Optimise data platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop ...

pipeline development using GitLab CI Experience with monitoring, logging and alerting tools Understanding of secure DevOps practices in regulated environments Experience working with large data stores or big data platforms Desirable skills: Experience supporting AI or data driven platforms Knowledge of cyber security or fraud prevention … within government or critical national infrastructure environments About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels ...

reimagined our Data Technician apprenticeship to drive change, incorporating new features and tools. Apprentices will learn data management, analysis techniques to gain real world insights, with access to new learn members and optional qualifications. Role The ERP team's main objectives are: Ensure the businesses ERP system operates … efficiently and effectively and is accessible during all of SKAO’s business hours across time zones Ensure a high level of ERP systems data integrity Maintain an excellent ERP support service with positive reviews from internal and external service users Continual Service Improvement (CSI) of the support service Allocate ...

Join a leading independent technology and services provider as an OpenSource Data Platform Solution Engineer. Job Overview: Looking for a hands-on Solution Engineer/Architect to design and support large-scale cybersecurity data platforms using open-source technologies. Location: Sheffield Rate: A daily rate, in-scope IR35 … Strategy and Governance, Cyber Sciences and Analytics, Cybersecurity Key Responsibilities: Design end-to-end technical solutions for cybersecurity applications Work on large-scale (petabyte) data platforms Create architecture documents (HLDs/LLDs) Evaluate and standardise open-source technologies Collaborate with engineering and governance teams Ensure solutions meet security, compliance ...

Have 10+ years of experience building large‐scale and low‐latency distributed systems Command of Java or C++ Solid understanding of algorithms, data structures, performance optimization techniques, object‐oriented programming, multi‐threading, and real‐time programming Experience with distributed caching, SQL/NoSQL, and other databases is a plus … Experience with Big Data and cloud services such as AWS or GCP is a plus Experience in the advertising domain is a big plus B.S. or M.S. degree in Computer Science, Engineering, or equivalent Self‐motivated individual with a high level of accountability and ownership Critical thinking ...

Expect You Have 10+ years of experience building large-scale and low-latency distributed systems. Proficiency in Java or C++. Strong understanding of algorithms, data structures, performance optimization, object-oriented programming, multi-threading, and real-time programming. Experience with distributed caching, SQL/NoSQL, and other databases … plus. Experience with Big Data and cloud services such as AWS or GCP is a plus. Experience in the advertising domain is a plus. B.S. or M.S. degree in Computer Science, Engineering, or equivalent. Self-motivated with a high level of accountability and ownership. Critical thinking and practical ...

mentor engineers, shape the technology roadmap, and drive scalable cloud and on‐premise solutions for global customers. With deep expertise in distributed systems, big data processing and production deployments, you’ll collaborate across teams to elevate design, foster engineering standards, and deliver high quality software at scale. #J ...