London, Liverpool, Merseyside, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data infrastructure … remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. more »
Milton Keynes, Buckinghamshire, South East, United Kingdom
Maclean Moore Ltd
Kafka Developer Duration: 6 Months Location: Milton Keynes Key responsibilities: Demonstrable experience as an Kafka Developer (Ideally Kafka Streams). Hand on experience in Bigdata technologies (Hadoop, Hue, Hive, Impala,Spark,.) and stronger within Kafka. Knowledge and experience using Key value data bases . Experience … developing microservices using Spring. Design and develop cloud-based data engineering solutions Java/Scala, Openshift/Kubernetes , deployments in Jekins The Candidate will be part of the team responsible for progress and support of one of the main streaming in house products . As well will be responsible … for creating a scalable configurable streaming applications to provide fresh data as part of data services for different applications ,usually 24/7 applications with a big performance requirement . Key skills/knowledge/experience: BigData Hadoop - Hive and Spark/Scala solid more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Experis
digital and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of … large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance … of the solution design. Key Skills/requirements Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »
Computer Futures - London & S.E(Permanent and Contract)
and troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: * Perform system administration on specific cyber defence applications and systems … defence network tools in response to new or observed threats within the network environment or enclave. * Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. * Implement data management standards, requirements, and specifications. * Develop data standards, policies, and … procedures. * Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. * To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: * Knowledge of bigdata technologies and ecosystems (eg, NiFi). * Knowledge of more »
and troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: * Perform system administration on specific cyber defence applications and systems … defence network tools in response to new or observed threats within the network environment or enclave. * Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. * Implement data management standards, requirements, and specifications. * Develop data standards, policies, and … procedures. * Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. * To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: * Knowledge of bigdata technologies and ecosystems (e.g., NiFi). * Knowledge of more »
out and implemented by a Sales focused Cloud Architect with an ability to secure UK eDV security clearance. With Machine Learning techniques, Encryption and BigData tools, this firm have solved a critical privacy issue that will benefit National Security and Intelligence clients across the world and is … equally impactful for other sectors, allowing private access to Neural Networks and Data sets for knowledge growth. If you are interested in delivering impactful product presentations and able to highlight mission-critical benefits of a software product, you will be highly valued in this role. Youll need to lead … and consultative selling of B2B software Demonstrable experience working with Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine Learning more »
Employment Type: Contract
Rate: From £1,100 to £1,300 per day Outside of IR35
Chertsey, Surrey, South East, United Kingdom Hybrid / WFH Options
Polar Recruitment Services Ltd
best known and admired brands in the world, working within a continuing growing Marketing team. You will be responsible for creating quality software and data structures that meet the functional and non-functional project requirements in the implementation, enhancement, and support of marketing projects. This will include producing application … general industry & platform-specific best practices. Skills & experience: Experience designing, implementing, and supporting enterprise-grade technical solutions in the cloud for meeting complex business data requirements. Working knowledge and experience with BigData platforms, Adobe Experience Platform or similar CDP. Third normal form, star schema, Snowflake, etc. … Experience with data modelling, table design, and mapping business needs to data structures. In depth knowledge in one or more programming languages (e.g. C++, Java, Python, R, PHP) Up to date understanding of best practices regarding system security measures. Hours of work: Flexible working pattern within a 37.5 more »
with large datasets and use of API's. o Logstash, management, configuration, and improvements, extending with Plugins. * Experience of Linux including: System Administration of BigData Platforms, System Monitoring, System Patching. * Knowledge of Data streaming and Message Brokers technologies. Please send in your latest CV LA International more »
Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in BigData Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »
Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in BigData Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »
My client is adigital, cloud, bigdata and security consultancy and will be a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise more »