51 to 75 of 122 Big Data Jobs

Lead PySpark Engineer

Hiring Organisation
SKILLFINDER INTERNATIONAL
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP Annual
Advanced (P3) AWS - Advanced (P3) SAS - Foundational (P1) Key Responsibilities Technical Delivery Design, develop, and maintain complex PySpark solutions for ETL/ELT and data mart workloads. Convert and refactor Legacy SAS code into optimized PySpark solutions using automated tooling and manual refactoring techniques. Build scalable, maintainable, and production … ready data pipelines. Modernize Legacy data workflows into cloud-native architectures. Ensure data accuracy, quality, integrity, and reliability across transformation processes. Cloud & Data Engineering (AWS-Focused) Develop and deploy data pipelines using AWS services such as EMR, Glue, S3, and Athena. Optimize Spark workloads ...

Technical Lead / Delivery Manager

Hiring Organisation
Cambridge University Press & Assessment
Location
Cambridge, Cambridgeshire, United Kingdom
Employment Type
Permanent
Salary
GBP 50,900 - 68,000 Annual
Location: Cambridge/Hybrid ( 3 days per week in office) Contract: Permanent Hours: Full Time Play a pivotal role in shaping the Data landscape of our organisation. The Delivery Manager must have a strong technical background as this role is a hands-on position that involves collaborating with cross … University of Cambridge. About the role The job holder is required to define and drive quality, consistency, and excellence in all aspects of Data Engineering within the Enterprise Data Teams with change control process and collaborative work. Mentor a team of developers/engineers, fostering a collaborative ...

Machine Learning Engineer II

Hiring Organisation
Yahoo Inc
Location
Ireland
Employment Type
Permanent
Salary
EUR 125,000 - 150,000 Annual
mail messages with advanced backend systems and algorithms, including NLP, GenAI, and ML techniques. Our infrastructure extracts information, creates enhanced content, and integrates diverse data sources to amplify key insights. This work presents rewarding technical challenges for high-caliber engineers eager to tackle impactful problems. Responsibilities: Contribute to Mail … Yahoo ecosystem. Innovate and Personalize: Assist in building scalable AI/ML solutions that identify user interests and habits, contributing to personalized user experiences. Data-Driven Insights: Apply machine learning techniques and big data processing to derive insights from mail data, enhancing content and user knowledge. ...

Senior Data Engineer

Hiring Organisation
WorkGenius Group
Location
City of London, London, United Kingdom
Senior Data Engineer (Contract) Location: Edinburgh, UK and/or London, UK Onsite: 3 days per week (mandatory) Start: ASAP Duration: 12–24 months (high likelihood of extension) About the Role We’re hiring a Senior Data Engineer for a long-term engagement with a large, global technology … organization operating at scale in AI-driven and data-intensive environments. You’ll work on building high-performance data pipelines, supporting advanced analytics and ML-driven initiatives, and ensuring robust, scalable data infrastructure across multiple domains. What You’ll Do Design, build and maintain scalable data ...

Data Engineer

Hiring Organisation
Boothbay Fund Management LLC
Location
London Area, United Kingdom
Westchester. The firm is operated with an entrepreneurial spirit and is continually seeking to improve and expand. Role We are seeking a talented Data Engineer to join the growing data team within our Quantitative Management Division This position is ideal for individuals who are passionate about building scalable … data solutions, eager to learn in a collaborative environment, and excited to work in small teams while taking advantage of opportunities to lead and enhance both themselves and their teammates. In this role, you will collaborate with experienced engineers to build and maintain our data infrastructure, develop efficient ...

Data Engineer DV Cleared

Hiring Organisation
Datatech Analytics
Location
Cheshire, North West, United Kingdom
Employment Type
Permanent, Work From Home
Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions at pace. Active … clearance is essential, we are seeking DV cleared candidates only. The role You'll design and deploy production-grade data pipelines, from ingestion through to consumption, within a modern big data architecture. Work is delivery focused and delivered using agile engineering practices. Typical responsibilities Build and operate ...

Data Platform Engineer

Hiring Organisation
Matchtech
Location
Penwortham, Lancashire, United Kingdom
Employment Type
Contract
Contract Rate
GBP 74 Hourly
Data Platform Engineer- 12 month contract - Warton Aerodrome (Remote) - 74.26 ph UMB or 55 ph PAYE (Inside IR35) The Umbrella rate quoted above is the Gross Umbrella rate (i.e. the rate we pay to the Umbrella Company inclusive of ALL employment costs). Please note, the rate paid … Limited Deemed rate or Agency PAYE rate. Please get in touch to discuss the rates via these different payment vehicles. The Role As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports ...

Senior Data Scientist

Hiring Organisation
Disney Experiences
Location
Kissimmee, Florida, United States
Employment Type
Permanent
Salary
USD Annual
organization, which creates and sells Disney products worldwide. The MBIA team supports the full retail lifecycle by providing analytics, reporting, and insights that empower data-informed decision-making for a broad community of stakeholders across Category and Location Planning, Product Development, Merchandising, and Retail Operations. We are seeking … Sr. Data Scientist to support and drive advanced analytics and data science initiatives for brick-and-mortar and ecommerce retail across Disney Experiences. This role will focus on developing and enhancing machine learning models and data-driven solutions to optimize key areas such as customer segmentation, assortment ...

Information Technology Data Analyst Lead - Health Outcomes

Hiring Organisation
CHRISTUS Health
Location
Irving, Texas, United States
Employment Type
Permanent
Salary
USD Annual
Description Summary: The Information Technology Data Analyst Lead is responsible conducting full lifecycle analysis to include requirements, design, documentation, testing and validation to support the implementation of data and analytics solutions. Data Analyst must have expertise in methodology, design, specifications, programming, delivery, monitoring, and support standards leading … development of data and analytics solutions. SQL querying experience in a range of databases such as transactional, analytical, columnar and massively parallel processing is required. Experience in data mining using advanced SQL or Business Intelligence tools is required. Responsibilities: Meets expectations of the applicable OneCHRISTUS Competencies: Leader ...

Data Engineer

Hiring Organisation
MBDA UK
Location
Bolton, Middle Hulton, Greater Manchester, United Kingdom
Employment Type
Permanent
Salary
£45000 - £55000/annum
Bolton As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa … facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed ...

Data Engineer - Focus Apache Flink (m/f/x)

Hiring Organisation
ADMIRAL Technologies
Location
Wien, Austria
Employment Type
Permanent
Salary
EUR Annual
Develop yourself and with us the software solutions of tomorrow! Learn more here: ADMIRAL Technologies - A clear victory for your future! Analyze and prepare data from the pre-systems Model and map scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists … Enrich data and load into big data environment (Apache Hadoop on Cloudera) Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop ...

Software Engineer

Hiring Organisation
KMJJ Enterprise, LLC
Location
Annapolis Junction, Maryland, United States
Employment Type
Any
Salary
USD Annual
Required Experience with: Linux CLI Bash/Python scripting Java applications in a Linux environment Developing with the Spring framework including Spring Boot Processing Big Data System design and architecture Web development, HTTP, and REST services NoSQL technologies such as Elasticsearch, Accumulo CI/CD principles, concepts, tools … Containerization technologies such as Docker Description The Software Engineer shall be responsible for the design, development, test, and sustainment of an end-to-end Big Data processing platform that provides downstream systems with aggregated analytic results and allows end-users the ability to query, visualize, and analyze event ...

Data Engineer

Hiring Organisation
Randstad Digital
Location
Manchester, North West, United Kingdom
Employment Type
Contract
Contract Rate
£60 - £80 per hour
Senior Data Engineer (Data Modernization) We are looking for a proactive, goal-oriented Senior Data Engineer to build and scale high-performance big data pipelines. This role is ideal for a collaborative problem-solver who excels in distributed environments and values technical excellence through …/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/CD and writing secure code. Data Governance: Proven ...

Data Engineer

Hiring Organisation
Randstad Digital
Location
United Kingdom
Employment Type
Contract
Contract Rate
£60 - £80 per hour
Senior Data Engineer (Data Modernization) We are looking for a proactive, goal-oriented Senior Data Engineer to build and scale high-performance big data pipelines. This role is ideal for a collaborative problem-solver who excels in distributed environments and values technical excellence through …/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/CD and writing secure code. Data Governance ...

Senior Data Scientist

Hiring Organisation
Method-Resourcing
Location
City of London, London, United Kingdom
Employment Type
Permanent
Salary
£85,000
Senior Data Scientist - £75,000 to £85,000 + 3 days a week onsite Method Resourcing is supporting a high-growth data function in central London who are building out their Data Science capability and looking for an experienced Senior Data Scientist ready to progress into … mentor others, and capable of stepping into a Lead role within 1-2 years. The Role You'll act as the blend of: Data & AI evangelist - educating stakeholders on possibilities and translating technical outcomes to business value. Data specialist - shaping data science strategy, building production-ready ...

Senior Data Scientist

Hiring Organisation
Method Resourcing
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£75,000 - £85,000 per annum
Senior Data Scientist - £75,000 to £85,000 + 3 days a week onsite Method Resourcing is supporting a high-growth data function in central London who are building out their Data Science capability and looking for an experienced Senior Data Scientist ready to progress into … mentor others, and capable of stepping into a Lead role within 1-2 years. The Role You'll act as the blend of: Data & AI evangelist - educating stakeholders on possibilities and translating technical outcomes to business value. Data specialist - shaping data science strategy, building production-ready ...

Account Representative

Hiring Organisation
Haver Analytics
Location
London Area, United Kingdom
Description Haver Analytics is the premier provider of time series data for the global strategy, research and quant communities. We deliver primary-sourced databases, a wealth of key survey and forecast data from our industry partners, and a robust offering of archive databases that drive machine learning … big data applications. We continuously display up-to-the-minute data from over 2500 government and private sources via integration with Microsoft Office and all leading statistical packages through our DLX® software and platform-independent HaverView(TM). We pride ourselves on the quality of the data ...

Professional Services DevOps Engineer

Hiring Organisation
JFrog, Inc
Location
Atlanta, Georgia, United States
Employment Type
Any
Salary
USD Annual
cutting-edge technologies/practices (Docker, Kubernetes, IaC, Cloud Native, NPM, Java, Pypi (Binary Repositories, Distribution to Devices, Continuous Build Tooling); work with BI, Data Warehousing/Integration, MDM, Application Integration, Cloud Infrastructure (AWS, Google, Azure)/Big Data; use Java, SQL, XML, Tomcat; troubleshoot technical issues … Requirements: Masters degree or foreign equivalent in Computer Science, Computer Engineering, or Software Engineering plus 2 years experience. Experience to include working with BI, Data Warehousing/Integration, MDM, Application Integration, Cloud Infrastructure (AWS, Google, Azure)/Big Data; using Java, SQL, XML, Tomcat; and troubleshooting technical ...

Lead Big Data Ops Engineer

Hiring Organisation
Hunter Bond
Location
London, United Kingdom
Employment Type
Permanent
Salary
GBP 90,000 Annual
leading Tech client are looking for a talented and motivated individual to ensure the resilience, performance, and cost-effectiveness of their Azure-based data platform. This role is essential to their data ecosystem, combining platform reliability, incident response, SLA management, cost optimization (FinOps), and deployment oversight. You will … newly created role in a growing business. A brilliant opportunity! The following skills/experience is required: Proven operational leadership for large-scale data platforms. Expertise in incident management, SLA enforcement, and stakeholder communication. Hands-on experience with Azure Synapse, Databricks, ADF, Power BI. Familiarity with CI/ ...

Lead DataOps Engineer - Big Data

Hiring Organisation
Hunter Bond
Location
London, United Kingdom
Employment Type
Permanent
Salary
GBP 90,000 Annual
leading Tech client are looking for a talented and motivated individual to ensure the resilience, performance, and cost-effectiveness of their Azure-based data platform. This role is essential to their data ecosystem, combining platform reliability, incident response, SLA management, cost optimization (FinOps), and deployment oversight. You will … newly created role in a growing business. A brilliant opportunity! The following skills/experience is required: Proven operational leadership for large-scale data platforms. Expertise in incident management, SLA enforcement, and stakeholder communication. Hands-on experience with Azure Synapse, Databricks, ADF, Power BI. Familiarity with CI/ ...

Data Engineer

Hiring Organisation
Anson Mccade
Location
Stevenage, Hertfordshire, South East, United Kingdom
Employment Type
Permanent
Salary
£55,000
seeking a highly skilled Senior Data Engineer to join our systems engineering team. In this role, you will be at the forefront of innovation, designing and maintaining the robust data architectures that power mission-critical AI and NLP initiatives. Since we operate in a highly regulated and secure … heavily on on-premise infrastructure , ensuring our Generative AI capabilities are powerful, private, and resilient. Key Responsibilities Architect & Build: Design, develop, and optimize scalable data pipelines (ETL/ELT) within air-gapped or on-premise data centers. AI Integration: Engineer data structures specifically for Natural Language Processing ...

Data Scientist - Hybrid - Outside IR35

Hiring Organisation
Tenth Revolution Group
Location
Oxfordshire, England, United Kingdom
Employment Type
Contractor
Contract Rate
£500 - £600 per day
Data Scientist - Hybrid - Outside IR35 About the Role We are seeking a highly analytical and business-minded Data Scientist to join our team. In this role, you will transform complex data into actionable insights, build predictive models, and partner with cross-functional stakeholders to drive strategic decision … making. You will work with large datasets, apply advanced statistical and machine learning techniques, and help shape data-driven initiatives across the organization. Key Responsibilities Collect, clean, and analyze structured and unstructured datasets from multiple sources Develop and deploy predictive models and machine learning algorithms Design and conduct experiments ...

Data Engineer

Hiring Organisation
Coforge
Location
Waterside, England, United Kingdom
Data Engineer Key skills: AI to design, develop, and deploy, machine learning and artificial intelligence Experience : 12+ years Location : Waterside, UK Job Type: Permanent (Full time) We at Coforge are seeking “ Data Engineer ” with the following skill-set: We are seeking a highly skilled Data Scientist … machine learning and artificial intelligence solutions. The ideal candidate will work on large datasets, build predictive models, and collaborate cross-functionally to deliver scalable, data-driven products. Key Responsibilities Design, develop, and optimize machine learning and deep learning models. Work on AI/ML projects including NLP, computer vision ...

python dev

Hiring Organisation
Pontoon
Location
London, United Kingdom
Employment Type
Contract
unlikely). FaaST description from AppHQ - user base is more than 2000 across the bank, including quantitative analysts and traders/trading support, Quartz, Data Scientists, etc. The Role The role is dev/ops and is split between supporting KYC/AML Client Outreach applications and supporting quantitative … analysts (quants) in Global Corporate and Investment Banking and Global Markets lines of business who utilise Bank of America's Big Data and Analytics platforms, on which KYC/AML Client Outreach applications also run. The Client Outreach KYC/AML Operations and Development Teams The Client Outreach ...

Sr. Software Engineer

Hiring Organisation
Dematic Corp. (ILD-US)
Location
Atlanta, Georgia, United States
Employment Type
Any
Salary
GBP Annual
Will Do in This Role : Design and develop scalable, high-performance software solutions for multi-tenant, cloud-based warehouse optimization systems powered by big data and AI. Write clean, maintainable, and high-quality code, ensuring alignment to industry best practices. Lead full-stack development, contributing to both front … React, Angular and services including REST, GraphQL and WebSockets. Optimize database performance, working with both SQL and NoSQL databases, and implement big data technologies for real-time analytics. Drive automation and DevOps best practices, leveraging Terraform, GitLab, and cloud-based infrastructure to enhance deployment efficiency. Collaborate cross-functionally ...