Big Data Jobs in the South East

26 to 50 of 75 Big Data Jobs in the South East

Chief Data Scientist

london, south east england, united kingdom
Harnham
Chief Data Scientist Up to £120,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer insights, predict behaviour, and enable hyper … targeted marketing. Responsibilities: Lead the organization’s data science initiatives, developing advanced analytics strategies, and driving innovation through AI and machine learning Develop and implement the company’s data science strategy to drive business growth. Stay ahead of emerging trends in data science, AI, and big data technologies. Challenge the status quo and always look … for ways to improve data science Oversee the development, deployment, and optimisation of AI/ML models. Partner with business leaders to identify key challenges and opportunities. Requirements: PhD or Master’s degree in Data Science, Computer Science, Statistics, Mathematics, or a related field Proven leadership experience in a data science or AI-driven organization. Proficient in More ❯
Posted:

Chief Data Scientist

london (city of london), south east england, united kingdom
Harnham
Chief Data Scientist Up to £120,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer insights, predict behaviour, and enable hyper … targeted marketing. Responsibilities: Lead the organization’s data science initiatives, developing advanced analytics strategies, and driving innovation through AI and machine learning Develop and implement the company’s data science strategy to drive business growth. Stay ahead of emerging trends in data science, AI, and big data technologies. Challenge the status quo and always look … for ways to improve data science Oversee the development, deployment, and optimisation of AI/ML models. Partner with business leaders to identify key challenges and opportunities. Requirements: PhD or Master’s degree in Data Science, Computer Science, Statistics, Mathematics, or a related field Proven leadership experience in a data science or AI-driven organization. Proficient in More ❯
Posted:

Data Engineer

South East, United Kingdom
Hybrid / WFH Options
Anson Mccade
Data Engineer £45,000 - 55,000 GBP + Package Hybrid WORKING Location: Stevenage, Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Focus Location: Stevenage or Bolton (Stevenage preferred) Salary: £45,000 to £55,000 depending on experience Working Pattern: Hybrid, 2 to 3 days on-site per week Overview: A new opportunity has opened … for a Data Engineer to join a newly formed Generative AI delivery office. This role involves evaluating, designing, deploying, and supporting internal data sets, ensuring they are secure, resilient, and optimised for internal customer needs. Key Responsibilities: Build and maintain robust data pipelines and data sets Collaborate with internal stakeholders to optimise data usage and … security Ensure compliance with data governance and quality standards Contribute to the technology roadmap and deliver innovative solutions Stay current with emerging technologies in AI and data engineering Technical Skills Required: SQL technologies (e.g. MS SQL, Oracle) NoSQL technologies (e.g. MongoDB, InfluxDB, Neo4J) Data exchange and processing tools (ETL, ESB, API) Programming experience (Python or similar) Big More ❯
Employment Type: Permanent, Work From Home
Posted:

Head of Data Platform Engineering

Bexhill-On-Sea, East Sussex, South East, United Kingdom
Hybrid / WFH Options
Hastings Direct
This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯
Employment Type: Permanent
Posted:

Computer Vision Engineer

Southborough, Kent, United Kingdom
Hybrid / WFH Options
Vermelo RPO
Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … WebApi SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN s) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … working/best practices. Automation first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Computer Vision Engineer

Tunbridge Wells, Kent, South East, United Kingdom
Hybrid / WFH Options
Gerrard White
Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … WebApi SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN's) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … working/best practices. Automation first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯
Employment Type: Permanent
Posted:

Computer Vision Engineer

Turnbridge Wells, Southborough, Kent, United Kingdom
Hybrid / WFH Options
Vermelo RPO
Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … WebApi SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN’s) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … working/best practices. Automation first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯
Employment Type: Permanent
Posted:

Software Developer / IT Consultant (m/f/d)

Oxford, Oxfordshire, United Kingdom
TNG Technology Consulting GmbH
in a customer-oriented manner on a variety of projects in the areas of Agile Software Development, Artificial Intelligence, and DevOps & Cloud. In addition, we work on topics in Big Data and IoT. We mostly use Java and TypeScript, but also other programming languages, such as Python or C#. Our clients include large corporations as well as medium … in a customer-oriented manner on a variety of projects in the areas of Agile Software Development, Artificial Intelligence, and DevOps & Cloud. In addition, we work on topics in Big Data and IoT. We mostly use Java and TypeScript, but also other programming languages, such as Python or C#. Our clients include large corporations as well as medium More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist

Isleworth, Middlesex, United Kingdom
83zero Ltd
Data Scientist - GCP 500- 550 per day (Inside IR35) 2 Days Onsite - Isleworth, West London 6-Month Contract (Extendable) 83zero are partnered with a global leader in media and broadcasting, looking for an experienced Data Scientist to support a business-critical project. You'll be joining a collaborative team of data scientists and engineers to build and … refine machine learning models that deliver genuine commercial impact. What You'll Be Doing: Work closely with fellow data scientists to explore how AI/ML can unlock insights and improve decision-making. Perform advanced analysis on large, complex datasets using statistical and modelling techniques. Build, test, and tune ML models (especially NLP or computer vision) using Python and … modern ML libraries, all within Google Cloud Platform (GCP) . Optimise models for accuracy and performance, ready for product integration. Stay up-to-date with the latest developments in data science and AI to drive innovation. Present insights, results, and model performance clearly to both technical and non-technical stakeholders. Ensure your workflows are reproducible and well-documented, including More ❯
Employment Type: Contract
Rate: GBP 500 - 550 Daily
Posted:

Data Engineer

London, South East, England, United Kingdom
Oscar Technology
New Role: Data Engineer Salary: Up to £65,000 Hybrid: 2 days in office per week Location: London Area We're looking for a Data Engineer to join our expanding team in a hybrid role based in London. This is an excellent opportunity for someone who thrives on building reliable, scalable data infrastructure to solve meaningful challenges. … What We're Looking For: 3+ years of data engineering experience. Strong cloud engineering background. Deep understanding of modern data architecture, including robust SQL skills and database performance tuning. Experienced in orchestrating complex data workflows to manage scheduling, dependencies, and data quality in ELT/ETL pipelines. Familiarity with modern data warehouses and experience with … orchestration tools. Company Overview: You'll become part of a wider data and analytics team that's working on some genuinely exciting challenges using the latest in cloud technologies and big data platforms. A supportive, fast-paced environment with real opportunities to grow. Candidates must be UK-based If you're a hands-on data engineer More ❯
Employment Type: Full-Time
Salary: £50,000 - £65,000 per annum
Posted:

Senior Data Science Director

london, south east england, united kingdom
Hybrid / WFH Options
Chi Square Analytics
Senior Data Science Director - £170,000 -£185,000 plus 30% bonus - London, United Kingdom (Hybrid) We’re partnering with a forward-thinking, global social gaming company seeking a seasoned Senior Director in Data and Analytics to shape and scale their data science capabilities. This individual will lead a high-performing analytics team, overseeing the development and deployment … of advanced modelling, predictive insights, and data-driven strategies to guide executive decision-making across diverse business domains. Key Responsibilities Set the vision and roadmap for the data science function, fostering scalable practices in areas such as A/B testing, user segmentation, predictive modelling, and reinforcement learning Lead cross-functional collaborations, embedding data-led insights into … product development, marketing, and operational platforms Translate analytical discoveries into compelling, business-focused narratives for senior leadership and stakeholders Attract, mentor, and lead a distributed team of data scientists and engineers, nurturing their professional growth and impact Champion adoption of best practices in ML operations, experimentation frameworks, and data governance Key Skills Advanced degree (MSc/PhD) in More ❯
Posted:

Senior Data Science Director

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Chi Square Analytics
Senior Data Science Director - £170,000 -£185,000 plus 30% bonus - London, United Kingdom (Hybrid) We’re partnering with a forward-thinking, global social gaming company seeking a seasoned Senior Director in Data and Analytics to shape and scale their data science capabilities. This individual will lead a high-performing analytics team, overseeing the development and deployment … of advanced modelling, predictive insights, and data-driven strategies to guide executive decision-making across diverse business domains. Key Responsibilities Set the vision and roadmap for the data science function, fostering scalable practices in areas such as A/B testing, user segmentation, predictive modelling, and reinforcement learning Lead cross-functional collaborations, embedding data-led insights into … product development, marketing, and operational platforms Translate analytical discoveries into compelling, business-focused narratives for senior leadership and stakeholders Attract, mentor, and lead a distributed team of data scientists and engineers, nurturing their professional growth and impact Champion adoption of best practices in ML operations, experimentation frameworks, and data governance Key Skills Advanced degree (MSc/PhD) in More ❯
Posted:

Senior Data Science Director

slough, south east england, united kingdom
Hybrid / WFH Options
Chi Square Analytics
Senior Data Science Director - £170,000 -£185,000 plus 30% bonus - London, United Kingdom (Hybrid) We’re partnering with a forward-thinking, global social gaming company seeking a seasoned Senior Director in Data and Analytics to shape and scale their data science capabilities. This individual will lead a high-performing analytics team, overseeing the development and deployment … of advanced modelling, predictive insights, and data-driven strategies to guide executive decision-making across diverse business domains. Key Responsibilities Set the vision and roadmap for the data science function, fostering scalable practices in areas such as A/B testing, user segmentation, predictive modelling, and reinforcement learning Lead cross-functional collaborations, embedding data-led insights into … product development, marketing, and operational platforms Translate analytical discoveries into compelling, business-focused narratives for senior leadership and stakeholders Attract, mentor, and lead a distributed team of data scientists and engineers, nurturing their professional growth and impact Champion adoption of best practices in ML operations, experimentation frameworks, and data governance Key Skills Advanced degree (MSc/PhD) in More ❯
Posted:

Data Engineer

South East, United Kingdom
Anson Mccade
Data Engineer £55000 GBP Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Hybrid (2-3 days on-site) - UK-based £45,000-£55,000 + Benefits Join a growing international team at the forefront of Generative AI and data innovation. You'll be working within a developing, cross-functional environment … building and maintaining high-quality, secure datasets that underpin critical internal projects. This is a unique opportunity to apply your data engineering skills to a high-impact, defence-focused setting where your work directly supports national capability. What you'll be doing: Designing, deploying, and optimising secure and resilient data pipelines Collaborating with internal stakeholders to ensure datasets … are tailored, reliable, and compliant with governance standards Applying your expertise in data management, processing, and quality assurance Staying ahead of emerging technologies, contributing to the technology roadmap Delivering innovative solutions in NLP, OCR, and Generative AI applications Experience required: Strong SQL skills (e.g. MS SQL, Oracle) and noSQL skills (e.g. MongoDB, Neo4J) Proficiency in data exchange and More ❯
Employment Type: Permanent
Posted:

Full Stack Developer

London, South East, England, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
analytical solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include: Manage both scheduled and ad hoc data harvesting processes. Write efficient regular expressions to extract data from raw HTML, JSON, and XML. Clean and validate harvested data using automated processes. Troubleshoot and resolve complex … data processing issues. Maintain and enhance existing data pipelines and services. Improve automation for data processing and delivery. Core Requirements: Solid understanding of HTTP protocols and request/response architecture. Proficiency in writing Regular Expressions for data extraction. Working knowledge of Python, SQL, and either C# or Java. Strong problem-solving and debugging skills. Effective communication … skills for understanding project needs and working with the team. Advantageous: Experience with automated data harvesting using Python, C#, or Java. Familiarity with front-end technologies (JavaScript, React). Experience with cloud platforms like AWS or GCP (especially BigQuery). Exposure to Big Data tools such as Elasticsearch. Background in the travel industry. Knowledge of GitHub and More ❯
Employment Type: Contractor
Rate: £200 - £300 per day
Posted:

Databricks Engineer

London, South East, England, United Kingdom
Harnham - Data & Analytics Recruitment
a great opportunity for an Azure Databricks Engineer to join a renewable energy firm based in London. You'll play a hands-on role in developing and optimising modern data lakehouse solutions on Azure, while supporting critical analytics and data delivery systems. The environment encourages technical ownership, collaboration, and the chance to tackle complex cloud-native engineering challenges. … THE COMPANY This is a leading organisation within the renewable energy sector, dedicated to sustainable innovation and data-driven operations. The business is undergoing rapid digital transformation, investing in cloud-based technologies to optimise performance, forecasting, and environmental impact. With operations across multiple regions, their data initiatives play a key role in supporting clean energy production, distribution, and … strategy. THE ROLE You'll join a collaborative engineering team focused on building scalable, secure, and efficient data platforms on Microsoft Azure. Your work will directly support migration initiatives, analytics enablement, and platform reliability. You'll be responsible for data pipeline development, resource deployment, and ongoing optimisation of cloud-native systems. Your responsibilities will include: Designing and implementing More ❯
Employment Type: Contractor
Rate: £550 - £600 per day
Posted:

Senior Data Analyst

Reading, Berkshire, England, United Kingdom
Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
Senior Data Analyst - £60,000 + Benefits Reading (2-3 days in-office) Hybrid working | No sponsorship available Join a global leader in marketing data and analytics, helping the world's biggest brands understand people and drive growth through powerful insights. We're looking for a Senior Data Analyst to support survey optimisation and revenue performance-delivering … meaningful insights at scale within a high-impact team reporting directly to the Chief Data Officer. Why Join? Operate in 90+ markets with world-class data and benchmarks Work on exciting client projects including product launches and market intelligence Millions of survey matches processed daily-big data environment Key role in ongoing automation and Azure migration … initiatives What You'll Do Analyse and optimise the commercial performance of surveys Identify patterns in client use and respondent behaviour Model pricing strategies and incentive effectiveness Use data science tools to boost segmentation and survey ROI Collaborate across commercial, analytics, and tech teams Drive smarter decisions through revenue modelling and optimisation Tech Stack Python, SQL Cloud migration to More ❯
Employment Type: Full-Time
Salary: £50,000 - £60,000 per annum
Posted:

Software Development Engineer, Prime Tech Hub

Reading, Berkshire, United Kingdom
Amazon
with cross-cultural awareness, as you'll be implementing solutions for diverse markets while maintaining Amazon's global standards of customer obsession. Key responsibilities: Work alongside product managers, ML data scientists, designers, and fellow engineers to create seamless Prime experiences Drive technical decisions that consider EU regulations and regional customer preferences Design and develop scalable systems that support Prime … Own the delivery of end-to-end, full stack solutions. - Make sound engineering decisions and improve our software development practices. - Build analytics platforms to process large volumes of traffic data, trends in marketing signals, and other key metrics. - Build experimentation frameworks to drive continuous testing new marketing experiences. - Contribute to the team's technical vision and roadmap. A day … A SDE2 in this role is in charge of end-to-end project ownership and developing full-stack solutions ranging from building scalable softwares to process large volumes of data, building big-data platforms to process customer level data and to capture marketing signals for analytics and measurement. They work with cross-functional teams containing Data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Scientist

london, south east england, united kingdom
Cint
million respondents in over 150 countries who consent to sharing their opinions, motivations, and behaviours. We are feeding the world’s curiosity! Job Description The Opportunity As a Senior Data Scientist at Cint, you will play a pivotal role in optimizing the Cint Exchange. Collaborating closely with product and engineering teams, you will deliver data-driven solutions to … enhance the performance of existing products, inform the development of new offerings, and deepen our understanding of marketplace dynamics. This role involves advanced data mining and analytics, robust product and data validation, and the development of sophisticated statistical and machine learning-based methodologies. The ideal candidate will have a strong ability to independently research, develop, and maintain high … recommendations through compelling visualizations and presentations tailored to diverse technical and non-technical audiences. Qualifications What we are looking for Minimum 5 years of solid working experience in a Data Science capacity, with demonstrated experience in leading projects or initiatives. A Master's degree (or equivalent) in Statistics, Quantitative Sciences, Data Science, Operations Research, or a related quantitative More ❯
Posted:

Senior Data Scientist

slough, south east england, united kingdom
Cint
million respondents in over 150 countries who consent to sharing their opinions, motivations, and behaviours. We are feeding the world’s curiosity! Job Description The Opportunity As a Senior Data Scientist at Cint, you will play a pivotal role in optimizing the Cint Exchange. Collaborating closely with product and engineering teams, you will deliver data-driven solutions to … enhance the performance of existing products, inform the development of new offerings, and deepen our understanding of marketplace dynamics. This role involves advanced data mining and analytics, robust product and data validation, and the development of sophisticated statistical and machine learning-based methodologies. The ideal candidate will have a strong ability to independently research, develop, and maintain high … recommendations through compelling visualizations and presentations tailored to diverse technical and non-technical audiences. Qualifications What we are looking for Minimum 5 years of solid working experience in a Data Science capacity, with demonstrated experience in leading projects or initiatives. A Master's degree (or equivalent) in Statistics, Quantitative Sciences, Data Science, Operations Research, or a related quantitative More ❯
Posted:

Data Scientist

London, South East, England, United Kingdom
Oscar Technology
New Role: Data Scientist Salary: Up to £70,000 Hybrid: 1-2 days in office per week Location: London Area We're looking for a Data Scientist to join our growing team in a hybrid role based in the London area. This is a fantastic opportunity for someone who thrives on solving complex problems and deploying robust, scalable … solutions in a real-world setting. What We're Looking For: 3+ years of data science/ML or similar experience Extensive knowledge of machine learning and statistical methods for predictive modelling and forecasting. Advanced SQL skills and deep experience in data wrangling and manipulation. Proficient in Python, with strong understanding of relevant libraries. Proven track record of … leading delivery across a range of data-driven projects. Comfortable working cross-functionally in a collaborative, fast-paced environment. Company Overview: You'll become part of a wider data and analytics team that's working on some genuinely exciting challenges using the latest in cloud technologies, big data platforms, and advanced machine learning techniques. Reporting into More ❯
Employment Type: Full-Time
Salary: £55,000 - £70,000 per annum
Posted:

Data Scientist

london, south east england, united kingdom
Cint
million respondents in over 150 countries who consent to sharing their opinions, motivations, and behaviours. We are feeding the world’s curiosity! Job Description The Opportunity As a Data Scientist at Cint you will have the opportunity to work alongside our Data Science and Analytics teams and collaborate with product and engineering teams to work on Identity and … Data Solutions products. This includes vendor analysis and onboarding, establishing statistical methodology and modeling standards and development. The ideal candidate is a self-starter comfortable working with large datasets and knowledgeable in statistical and machine learning techniques, with an eagerness to learn and contribute to the development and validation of products that align Cint capabilities with the market. What … ou will do Support research and discovery phase for new and existing products/models. The primary areas include Identity and Data Solutions. Actively participate in the development and enhancement of our Identity Graph, utilizing statistical and machine learning techniques to improve accuracy. Drive the onboarding and validation of new data vendors, by establishing statistical methodologies and conducting More ❯
Posted:

Data Scientist

slough, south east england, united kingdom
Cint
million respondents in over 150 countries who consent to sharing their opinions, motivations, and behaviours. We are feeding the world’s curiosity! Job Description The Opportunity As a Data Scientist at Cint you will have the opportunity to work alongside our Data Science and Analytics teams and collaborate with product and engineering teams to work on Identity and … Data Solutions products. This includes vendor analysis and onboarding, establishing statistical methodology and modeling standards and development. The ideal candidate is a self-starter comfortable working with large datasets and knowledgeable in statistical and machine learning techniques, with an eagerness to learn and contribute to the development and validation of products that align Cint capabilities with the market. What … ou will do Support research and discovery phase for new and existing products/models. The primary areas include Identity and Data Solutions. Actively participate in the development and enhancement of our Identity Graph, utilizing statistical and machine learning techniques to improve accuracy. Drive the onboarding and validation of new data vendors, by establishing statistical methodologies and conducting More ❯
Posted:

Data Engineer, Commodities, £135k Extensive Benefits

London, South East, England, United Kingdom
Harvey Nash
Data Engineer, Commodities £135,000 Basic + Extensive Benefits, London My Commodities Trading Client are looking for a Data Engineer to join the trade surveillance team, develop ingestion pipelines and frameworks to support strategic decision making. The team has recently built a new data lake house and ingestion infrastructure. It is entering a phase of hardening and … re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio. Key Requirements: Strong proficiency in Python and PySpark Successful track history in a Data Engineering role including Database Management (ideally SQL), Data Orchestration (ideally Apache Airflow or Dagster), Containerisation (ideally Kubernetes and Docker) .Data Pipelines (big data technologies and architectures) Experience in More ❯
Employment Type: Full-Time
Salary: £135,000 per annum
Posted:

Data Engineer (SC cleared)

Guildford, Surrey, United Kingdom
Hybrid / WFH Options
Stott and May
Data Engineer (SC cleared) Start: ASAP Duration: 12 months Location: Mostly Remote - must have access to London or Bristol Pay: negotiable, INSIDE IR35 Responsibilities: - Design, implement robust ETL/ELT data pipelines using Apache Airflow - Build ingestion processes from internal systems and APIs, using Kafka, Spark, AWS - Develop and maintain data lakes and warehouses (AWS S3, Redshift … Ensuring governance using automated testing tools - Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs - Apply best practice in security and compliance Required Tech Skills: - Python and SQL for processing - Apache Airflow, writing Airflow DAGs and configuring airflow jobs - AWS cloud platform and services like S3, Redshift - Familiarity with big data processing using Apache Spark - Knowledge of modelling, schema design and partitioning strategies - Understanding batch Vs streaming data paradigms - Docker or Kubernetes (containerization More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Big Data
the South East
10th Percentile
£44,250
25th Percentile
£52,500
Median
£65,000
75th Percentile
£68,750
90th Percentile
£83,750