1 to 25 of 66 Hadoop Jobs in the UK excluding London

Data Engineer II (Data Platform)

Location
Oxford, England, United Kingdom
complex ETL/ELT processes from concept to production. Proficiency in SQL and data exploration across large, complex datasets. Experience with big data technologies (Hadoop, Hive, BigQuery, Snowflake) and working with terabyte-scale or larger datasets. Solid foundation in data structures, algorithms, and object‐oriented design. Professional experience building ...

Data Engineer

Location
Gloucester, England, United Kingdom
Scala, and SQL. Hands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise ...

Data Engineer - Security & Intelligence

Hiring Organisation
Hackajob Ltd
Location
Gloucester, Gloucestershire, South West, United Kingdom
Employment Type
Permanent
Scala, and SQL. Hands-on experience building and operating large-scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud-native data platforms, with strong expertise ...

Principal Platform Engineer

Hiring Organisation
London Stock Exchange Group
Location
Edinburgh, UK
Employment Type
Full-time
modelling, and visualization to identify patterns and insights. Ensure data quality, reliability, and security across systems. Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyse large datasets. Stay up to date with the latest trends and technologies in big data, analytics, and cloud platforms. Required ...

Senior Data Engineer

Hiring Organisation
Hackajob Ltd
Location
South West London, London, United Kingdom
Employment Type
Permanent
Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Data Engineer

Hiring Organisation
Hackajob Ltd
Location
South West London, London, United Kingdom
Employment Type
Permanent
Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI ...

Principal Data Engineer

Hiring Organisation
Hackajob Ltd
Location
Bristol, Avon, South West, United Kingdom
Employment Type
Permanent, Part Time, Work From Home
NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

Core Data Engineer

Location
City of Edinburgh, Scotland, United Kingdom
Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres, sql server ...

Senior Data Engineer

Hiring Organisation
Morson Edge
Location
Corsham, Wiltshire, South West, United Kingdom
Employment Type
Contract
Contract Rate
£0.00 - 62.40 per hour
Degree in STEM, Data, AI, or Programming-related field Experience influencing technical decisions and supporting capability growth. Experience with big data tools e.g. Spark, Hadoop, NiFi Exposure to Ansible and Terraform Understanding of ML algorithms and deployment ...

DV Cleared Senior Data Engineer (Defence & Aerospace)

Hiring Organisation
Synergize Consulting Ltd
Location
Wiltshire, United Kingdom
Employment Type
Contract
Contract Rate
GBP 35 Annual
STEM, Data, AI, Programming or a related discipline. Experience influencing technical decisions and supporting capability development. Exposure to big data technologies such as Spark, Hadoop or NiFi. Experience with Ansible and Terraform. Understanding of machine learning algorithms and deployment. ...

Quantexa Senior Manager

Hiring Organisation
KPMG
Location
Huntly, Aberdeenshire, UK
Employment Type
Full-time
Quantexa components such as: Entity Resolution (ER) Scoring Framework Contextual Network Generation UI Configuration Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

Data Engineer - DV Cleared

Hiring Organisation
CBS Butler
Location
Bristol, Somerset, United Kingdom
Employment Type
Contract
Contract Rate
GBP 55 - 60 Hourly
STEM, Data, AI, Programming or related degree. Experience influencing technical decisions or helping develop technical capability. Experience with big-data technologies such as Spark, Hadoop or NiFi . Exposure to Ansible and Terraform . Understanding of machine-learning algorithms and deployment. Clearance & Location DV clearance is essential for this ...

Principle Data Warehouse Engineer (Executive Director)

Hiring Organisation
Hackajob Ltd
Location
South West London, London, United Kingdom
Employment Type
Permanent
deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders) to deliver ...

Data Lead - AI and Automation Information Technology - Smiths Group - Birmingham

Location
Birmingham, England, United Kingdom
Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately represent the underlying datasets. Review and align the reporting attributes against the enterprise and conceptual ...

Senior Java / SQL Developer

Location
Glasgow, Scotland, United Kingdom
Gradle). Desirable skills: Scala: Hands-on experience or a strong functional programming background using Scala. Big Data: Exposure to Apache Spark, Kafka, or Hadoop ecosystems. Cloud: Experience with AWS, Azure, or Google Cloud Platform. Experience in banking or financial services industry. Soft Skills Strong problem-solving abilities. Clear ...

Lead Funds Data Architect

Location
Belfast City District, Northern Ireland, United Kingdom
Oracle, Snowflake, Databricks).* Experience with data integration (ETL/ELT, APIs).* Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus.Domain Knowledge:* Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations.* In-depth knowledge of regulatory ...

Lead Funds Data Architect

Hiring Organisation
Citigroup
Location
Belfast, UK
Employment Type
Full-time
Server, Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus. Domain Knowledge: Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory ...

Senior Data Engineer

Hiring Organisation
Hackajob Ltd
Location
South West London, London, United Kingdom
Employment Type
Permanent, Part Time
Salary
£75,000
infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

Google Cloud Platform Data Engineer

Location
Bristol, England, United Kingdom
addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka ...

Senior Software Engineer, Java

Hiring Organisation
Roku
Location
Manchester, UK
Employment Type
Full-time
business needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache ...

Senior Software Engineer, Java

Hiring Organisation
Roku
Location
Cambridge, Cambridgeshire, UK
Employment Type
Full-time
business needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache ...

Data Engineer

Location
Glasgow, Scotland, United Kingdom
data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with big data technologies (Spark, Hadoop, Kafka). Knowledge of API integrations and microservices-based data ingestion. Experience working in Agile/Scrum environments. Banking Domain Experience (Mandatory) Experience working ...

Data Engineer - eSC or eDV Clearance Required

Location
Leicester, England, United Kingdom
Developed Vetting (DV). Preferred technical and professional experience Experience with machine learning frameworks (TensorFlow, PyTorch, scikit-learn). Familiarity with big data technologies (Hadoop, Spark). Background in data science, IT consulting, or a related field. AWS Certified Big Data or equivalent. Demonstrated leadership and mentoring skills. Publication ...

Data Engineer

Location
Romsey, England, United Kingdom
approach. Creating code that is open by default and easy for others to reuse. Required Skills Experience with Big Data technologies, such as Apache Hadoop, Spark or Pig AWS Apache NiFi Python or Java Built on over a 70 year heritage, Roke offers specialist knowledge in sensors, communications, cyber ...

Google Cloud Platform Data Engineer

Hiring Organisation
PA Consulting
Location
Bristol, UK
Employment Type
Full-time
addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehousesAn understanding of machine learning model development lifecycle, feature engineering, training and testingGood understanding or hands-on experience of KafkaExperience ...