for highly scalable systems) and query languages (specifically Hive/SparkSQL and ANSI SQL).Experience building large scale Spark 3.x applications & data pipelines, ideally with Batch processing running on Hadoop clusters. If you had experience with messaging queues such as Kafka, RabbitMQ or JMS and reactive architecture paradigm. Experience designing and developing highly available fault tolerant software. Experience in More ❯
Agile working practices CI/CD tooling Scripting experience (Python, Perl, Bash, etc.) ELK (Elastic stack) JavaScript Cypress Linux experience Search engine technology (e.g., Elasticsearch) Big Data Technology experience (Hadoop, Spar k , Kafka, etc.) Microservice and cloud native architecture Desirable: Able to demonstrate experience of troubleshooting and diagnosis of technical issues. Able to demonstrate excellent team-working skills. Strong More ❯
able to work with Business/Systems Analysts and Quality Engineers in a behavioural driven development environment. You will have knowledge of all types of data storage techniques, SQL, Hadoop, Snowflake, Mongo, The Ideal candidate should have experience of developing Microservices in Cloud based environment/Successful candidates will have experience working on large-scale production systems with high More ❯
able to work with Business/Systems Analysts and Quality Engineers in a behavioural driven development environment. You will have knowledge of all types of data storage techniques, SQL, Hadoop, Snowflake, Mongo, The Ideal candidate should have experience of developing Microservices in Cloud based environment/Successful candidates will have experience working on large-scale production systems with high More ❯
month contract - Inside IR35 - Financial Services This role will require travel to Milton Keyenes and the London offices. Experience: Advanced knowledge and 3yrs+ experience of programming languages Hadoop SQL, Spark, SAS etc. Exceptional problem-solving skills. Track record of developing high quality analysis that has resulted in customer centric decisions that achieve business objectives. Understanding of the customer and More ❯
Leicester, Leicestershire, England, United Kingdom
Lorien
banking-focused data model. Liaise with IT teams to transition data models into production environments. Conduct data mining and exploratory data analysis to support model development. Apply strong SQL, Hadoop, and cloud-based data processing skills to manage and analyse large datasets. Support the design and structure of data models, with a working understanding of data modelling principles. Present … scalable data solutions within a cloud architecture. Key Skills & Experience: Proven experience as a technical data analyst or data engineer in a project-focused environment. Strong proficiency in SQL, Hadoop, and cloud platforms (preferably AWS). Experience with data mining, data modelling, and large-scale data processing. Familiarity with tools such as Python, R, and Power BI. Understanding of More ❯
nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir Foundry Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of …/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY CLEARED/SECURITY CLEARANCE/NIFI/CLOUDERA/HADOOP/KAFKA/ELASTIC SEARCH/LEAD BIG DATA ENGINEER/LEAD BIG DATA DEVELOPER More ❯
/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE. Current DV Security Clearance (Standard or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira …/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY CLEARED/SECURITY CLEARANCE/NIFI/CLOUDERA/HADOOP/KAFKA/ELASTIC SEARCH/LEAD BIG DATA ENGINEER/LEAD BIG DATA DEVELOPER More ❯
/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE.... Current DV Security Clearance (Standard or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira …/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY CLEARED/SECURITY CLEARANCE/NIFI/CLOUDERA/HADOOP/KAFKA/ELASTIC SEARCH/LEAD BIG DATA ENGINEER/LEAD BIG DATA DEVELOPER More ❯
Java Software Engineer - Data Storage Technologies - (MySQL, Hadoop, Cassandra,AWS (RDS, Step functions, EC2, Kinesis) Location: Manchester Duration: 5 months *Urgent 5-Month Contract - Role hiring now!* This is a *Manchester* based role with an excellent immediate start within a Global T echnology Client that is working on *delivering innovative regulatory technology solutions that ensure compliance, manage risk, and … compliance and risk management through advanced tools and analytics. Skills & Experience 3+ years' software development experience (Java essential). Strong background with microservices and distributed systems. Experience with MySQL, Hadoop, Cassandra . Knowledge of AWS services (RDS, Step Functions, EC2, Kinesis). Experience with testing frameworks and performance monitoring. FinTech, compliance, or payments experience (a plus). Please send More ❯