Permanent Big Data Jobs in the South East

1 to 25 of 41 Permanent Big Data Jobs in the South East

Enterprise Data & Analytics Platforms Director

Slough, Berkshire, United Kingdom
Mars, Incorporated and its Affiliates
Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer

Portsmouth, Hampshire, United Kingdom
Iglu.com
experiences and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You'll play … a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and reliable data pipelines, focusing … on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Platform Engineer

Farnborough, Hampshire, South East, United Kingdom
Peregrine
Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent to … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯
Employment Type: Permanent
Salary: £70,000
Posted:

Data Platform Engineer

Reading, Berkshire, South East, United Kingdom
Peregrine
The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access … for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust error … handling strategies. Youll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. Were looking for candidates with over More ❯
Employment Type: Permanent
Salary: £50,000
Posted:

Database Administrator (Oracle)

London, South East, England, United Kingdom
Hybrid / WFH Options
Claranet Limited
Position Summary The Database Administrator is part of the Data and AI practice. This team is made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and … at any Claranet UK office - most people choose a combination of the two. We’ve worked hard to create a remote-friendly culture and believe you can have a big impact no matter where you live. Working in the Data Practice we can offer an environment where you will be surrounded by like-minded, highly technical people. Due … Security Reporting On-Call for fourth-line support 24/7 rota. Automation of all support activities including backups, patching, and script deployments. Accompany customers towards Cloud technologies, PaaS data platforms and other cloud-native Data Services. Ensure the storage, processing, and quality of customer data You will build new customer environments, working as part of a More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:

Data Solutions Architect

South East, United Kingdom
Hybrid / WFH Options
Anson Mccade
Data Solutions Architect £110,000 - £120,000 GBP 10% Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solutions Architect - Consulting Location: London (Remote-first) Working Pattern: Full-time, Permanent Salary: £110,000 - £120,000 per annum About the Role We're seeking a Data Solutions Architect to join a dynamic consulting team … delivering cutting-edge, cloud-based data solutions for high-profile clients across diverse industries. This is a remote-first role with occasional travel, offering the opportunity to lead end-to-end delivery of complex data architecture projects in a collaborative, agile environment. What You'll Be Doing Leading cross-functional teams of Data Engineers, Architects, BAs, and … QA Analysts. Designing and delivering scalable data solutions using modern cloud platforms and data technologies. Engaging with stakeholders to shape and own the technical delivery of data architecture projects. Applying best practices in data governance, security, and compliance. What We're Looking For Experience & Leadership Proven track record as a Lead Data Solutions Architect or More ❯
Employment Type: Permanent, Work From Home
Posted:

Python Data Engineer

Farnborough, Hampshire, England, United Kingdom
Hybrid / WFH Options
Eutopia Solutions ltd
Python Data Engineer Location: Farnborough (Hybrid) Employment Type: Full-Time, Permanent Salary: c£50,000We are recruiting on behalf of a leading organisation based in Farnborough, currently seeking a highly skilled Python Data Engineer to join their growing data team. This is a fantastic opportunity to work with cutting-edge technologies and play a key role in … the design, development, and optimisation of scalable data solutions. The Role As a Python Data Engineer, you will be instrumental in building robust data pipelines and maintaining cloud-based databases to support a range of business functions. Working closely with analysts and data scientists, you'll help solve complex data challenges and contribute to the … company's data-driven strategy. Key Responsibilities Design and implement efficient, scalable data pipelines using Python and SQL Server Develop, test, and deploy ETL workflows and data processing solutions using Docker containers on Azure Collaborate with data stakeholders to resolve data-related challenges Optimise existing pipelines and databases for performance and reliability Troubleshoot and maintain More ❯
Employment Type: Full-Time
Salary: £45,000 - £50,000 per annum
Posted:

Senior Consultant

Reading, England, United Kingdom
Hybrid / WFH Options
HD TECH Recruitment
Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯
Posted:

Data Solution Architect

South East, United Kingdom
Hybrid / WFH Options
Anson Mccade
Data Solution Architect ££125,000 GBP + benefits package Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect Location: London (Hybrid) Salary: Up to £125,000 + benefits package Contract Type: Permanent We are supporting a leading consulting client in their search for a Data Solution Architect to join a remote-first … data architecture team. This is a senior, delivery-focused role requiring deep technical expertise and end-to-end consulting experience across cloud-based data solutions. Key Responsibilities: Lead cross-functional teams to deliver scalable data solutions across cloud platforms Architect data lakes, lakehouses, and event-driven systems using tools like Databricks, Kafka, and Confluent Apply Data Mesh and Data Fabric principles to modern data architectures Define and implement data product strategies with a product-led mindset Ensure compliance with data governance and security standards (e.g. GDPR, HIPAA) Engage stakeholders and oversee technical delivery across Agile projects Skills & Experience: Proven experience as a Lead Data Solution Architect in consulting environments Expertise More ❯
Employment Type: Permanent, Work From Home
Posted:

Data Science Lead

Brighton, Sussex, United Kingdom
Hybrid / WFH Options
The William Reed Group
We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Science Lead

Crawley, Sussex, United Kingdom
Hybrid / WFH Options
The William Reed Group
We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Head of Data Platform Engineering

Bexhill-on-sea, Sussex, United Kingdom
Hybrid / WFH Options
Hastings Direct
At Hastings Direct, storing your data securely is very important to us. Please see our Data Protection Statement and Job Application Terms & Conditions here for details on how your information will be stored. Head of Data Platform Engineering page is loaded Head of Data Platform Engineering Apply locations Bexhill time type Full time posted on Posted … days left to apply) job requisition id This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

South East, United Kingdom
Hybrid / WFH Options
Anson Mccade
Data Engineer £45,000 - 55,000 GBP + Package Hybrid WORKING Location: Stevenage, Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Focus Location: Stevenage or Bolton (Stevenage preferred) Salary: £45,000 to £55,000 depending on experience Working Pattern: Hybrid, 2 to 3 days on-site per week Overview: A new opportunity has opened … for a Data Engineer to join a newly formed Generative AI delivery office. This role involves evaluating, designing, deploying, and supporting internal data sets, ensuring they are secure, resilient, and optimised for internal customer needs. Key Responsibilities: Build and maintain robust data pipelines and data sets Collaborate with internal stakeholders to optimise data usage and … security Ensure compliance with data governance and quality standards Contribute to the technology roadmap and deliver innovative solutions Stay current with emerging technologies in AI and data engineering Technical Skills Required: SQL technologies (e.g. MS SQL, Oracle) NoSQL technologies (e.g. MongoDB, InfluxDB, Neo4J) Data exchange and processing tools (ETL, ESB, API) Programming experience (Python or similar) Big More ❯
Employment Type: Permanent, Work From Home
Posted:

Head of Data Platform Engineering

Bexhill-On-Sea, East Sussex, South East, United Kingdom
Hybrid / WFH Options
Hastings Direct
This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯
Employment Type: Permanent
Posted:

Computer Vision Engineer

Southborough, Kent, United Kingdom
Hybrid / WFH Options
Vermelo RPO
Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … WebApi SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN s) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … working/best practices. Automation first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Computer Vision Engineer

Tunbridge Wells, Kent, South East, United Kingdom
Hybrid / WFH Options
Gerrard White
Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … WebApi SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN's) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … working/best practices. Automation first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯
Employment Type: Permanent
Posted:

Computer Vision Engineer

Turnbridge Wells, Southborough, Kent, United Kingdom
Hybrid / WFH Options
Vermelo RPO
Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … WebApi SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN’s) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … working/best practices. Automation first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯
Employment Type: Permanent
Posted:

Software Developer / IT Consultant (m/f/d)

Oxford, Oxfordshire, United Kingdom
TNG Technology Consulting GmbH
in a customer-oriented manner on a variety of projects in the areas of Agile Software Development, Artificial Intelligence, and DevOps & Cloud. In addition, we work on topics in Big Data and IoT. We mostly use Java and TypeScript, but also other programming languages, such as Python or C#. Our clients include large corporations as well as medium … in a customer-oriented manner on a variety of projects in the areas of Agile Software Development, Artificial Intelligence, and DevOps & Cloud. In addition, we work on topics in Big Data and IoT. We mostly use Java and TypeScript, but also other programming languages, such as Python or C#. Our clients include large corporations as well as medium More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

South East, United Kingdom
Anson Mccade
Data Engineer £55000 GBP Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Hybrid (2-3 days on-site) - UK-based £45,000-£55,000 + Benefits Join a growing international team at the forefront of Generative AI and data innovation. You'll be working within a developing, cross-functional environment … building and maintaining high-quality, secure datasets that underpin critical internal projects. This is a unique opportunity to apply your data engineering skills to a high-impact, defence-focused setting where your work directly supports national capability. What you'll be doing: Designing, deploying, and optimising secure and resilient data pipelines Collaborating with internal stakeholders to ensure datasets … are tailored, reliable, and compliant with governance standards Applying your expertise in data management, processing, and quality assurance Staying ahead of emerging technologies, contributing to the technology roadmap Delivering innovative solutions in NLP, OCR, and Generative AI applications Experience required: Strong SQL skills (e.g. MS SQL, Oracle) and noSQL skills (e.g. MongoDB, Neo4J) Proficiency in data exchange and More ❯
Employment Type: Permanent
Posted:

Senior Data Analyst

Reading, Berkshire, England, United Kingdom
Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
Senior Data Analyst - £60,000 + Benefits Reading (2-3 days in-office) Hybrid working | No sponsorship available Join a global leader in marketing data and analytics, helping the world's biggest brands understand people and drive growth through powerful insights. We're looking for a Senior Data Analyst to support survey optimisation and revenue performance-delivering … meaningful insights at scale within a high-impact team reporting directly to the Chief Data Officer. Why Join? Operate in 90+ markets with world-class data and benchmarks Work on exciting client projects including product launches and market intelligence Millions of survey matches processed daily-big data environment Key role in ongoing automation and Azure migration … initiatives What You'll Do Analyse and optimise the commercial performance of surveys Identify patterns in client use and respondent behaviour Model pricing strategies and incentive effectiveness Use data science tools to boost segmentation and survey ROI Collaborate across commercial, analytics, and tech teams Drive smarter decisions through revenue modelling and optimisation Tech Stack Python, SQL Cloud migration to More ❯
Employment Type: Full-Time
Salary: £50,000 - £60,000 per annum
Posted:

Software Development Engineer, Prime Tech Hub

Reading, Berkshire, United Kingdom
Amazon
with cross-cultural awareness, as you'll be implementing solutions for diverse markets while maintaining Amazon's global standards of customer obsession. Key responsibilities: Work alongside product managers, ML data scientists, designers, and fellow engineers to create seamless Prime experiences Drive technical decisions that consider EU regulations and regional customer preferences Design and develop scalable systems that support Prime … Own the delivery of end-to-end, full stack solutions. - Make sound engineering decisions and improve our software development practices. - Build analytics platforms to process large volumes of traffic data, trends in marketing signals, and other key metrics. - Build experimentation frameworks to drive continuous testing new marketing experiences. - Contribute to the team's technical vision and roadmap. A day … A SDE2 in this role is in charge of end-to-end project ownership and developing full-stack solutions ranging from building scalable softwares to process large volumes of data, building big-data platforms to process customer level data and to capture marketing signals for analytics and measurement. They work with cross-functional teams containing Data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist

London, South East, England, United Kingdom
Oscar Technology
New Role: Data Scientist Salary: Up to £70,000 Hybrid: 1-2 days in office per week Location: London Area We're looking for a Data Scientist to join our growing team in a hybrid role based in the London area. This is a fantastic opportunity for someone who thrives on solving complex problems and deploying robust, scalable … solutions in a real-world setting. What We're Looking For: 3+ years of data science/ML or similar experience Extensive knowledge of machine learning and statistical methods for predictive modelling and forecasting. Advanced SQL skills and deep experience in data wrangling and manipulation. Proficient in Python, with strong understanding of relevant libraries. Proven track record of … leading delivery across a range of data-driven projects. Comfortable working cross-functionally in a collaborative, fast-paced environment. Company Overview: You'll become part of a wider data and analytics team that's working on some genuinely exciting challenges using the latest in cloud technologies, big data platforms, and advanced machine learning techniques. Reporting into More ❯
Employment Type: Full-Time
Salary: £55,000 - £70,000 per annum
Posted:

Data Engineer, Commodities, £135k Extensive Benefits

London, South East, England, United Kingdom
Harvey Nash
Data Engineer, Commodities £135,000 Basic + Extensive Benefits, London My Commodities Trading Client are looking for a Data Engineer to join the trade surveillance team, develop ingestion pipelines and frameworks to support strategic decision making. The team has recently built a new data lake house and ingestion infrastructure. It is entering a phase of hardening and … re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio. Key Requirements: Strong proficiency in Python and PySpark Successful track history in a Data Engineering role including Database Management (ideally SQL), Data Orchestration (ideally Apache Airflow or Dagster), Containerisation (ideally Kubernetes and Docker) .Data Pipelines (big data technologies and architectures) Experience in More ❯
Employment Type: Full-Time
Salary: £135,000 per annum
Posted:

Senior Quantitative Analyst

London, South East, England, United Kingdom
Spectrum IT Recruitment
s team based in central London. The successful Quantitative Analyst will join a small but very talented team and will be expected to interpret, filter, and analyse very large data sets whilst working closely with other analysts and developers. The successful Quantitative Analyst will be a forward-thinking individual who is more than comfortable working to both their own … following: Python, C#, C++, Java Mathematical Modelling Mathematical skills, particularly a keen understanding of probabilities and statistics Analytic mindset Strong communication skills Accuracy and attention to detail Experience in data science (big data, deep learning, machine learning) is beneficial Specific sports trading knowledge is beneficial but not essential If you feel you have the skills and experience More ❯
Employment Type: Full-Time
Salary: £100,000 - £120,000 per annum
Posted:

Data Engineer (SC cleared)

Guildford, Surrey, United Kingdom
Hybrid / WFH Options
Stott and May
Data Engineer (SC cleared) Start: ASAP Duration: 12 months Location: Mostly Remote - must have access to London or Bristol Pay: negotiable, INSIDE IR35 Responsibilities: - Design, implement robust ETL/ELT data pipelines using Apache Airflow - Build ingestion processes from internal systems and APIs, using Kafka, Spark, AWS - Develop and maintain data lakes and warehouses (AWS S3, Redshift … Ensuring governance using automated testing tools - Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs - Apply best practice in security and compliance Required Tech Skills: - Python and SQL for processing - Apache Airflow, writing Airflow DAGs and configuring airflow jobs - AWS cloud platform and services like S3, Redshift - Familiarity with big data processing using Apache Spark - Knowledge of modelling, schema design and partitioning strategies - Understanding batch Vs streaming data paradigms - Docker or Kubernetes (containerization More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Big Data
the South East
10th Percentile
£44,250
25th Percentile
£52,500
Median
£65,000
75th Percentile
£68,750
90th Percentile
£83,750