Modelling. Experience with at least one or more of these programming languages: Python, Scala/Java Experience with distributed data and computing tools, mainly Apache Spark & Kafka Understanding of critical path approaches, how to iterate to build value, engaging with stakeholders actively at all stages. Able to deal with more »
Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on more »
London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
Work with Hadoop, Spark, and other platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate more »
Linux environments. Knowledge of data modeling, database design, and query optimization techniques. Experience with real-time data processing, streaming, and analytics technologies (e.g., Kafka, Apache Flink). Familiarity with financial markets, trading systems, and quantitative analysis is a plus. Excellent problem-solving, analytical, and communication skills, with the ability more »
Data Engineer to join our team and build robust data pipelines. Responsibilities: Build, and maintain scalable data pipelines. Maintain the pipeline through Databricks and Apache Beam Seamless data integration and quality. Data storage solutions using GCP (will still be considered with other cloud experience) Best practices in data management more »
. • Troubleshooting networks issues (tcpdump/Wireshark). • Scripting capabilities (SH/Bash/Python/Perl). • Configuration of common services (DNS/Apache/NGINX/Postfix/Squid/SSH/iptables). • Understanding of clustering services, enabling High Availability failover. • Experience with enterprise hardware and more »
within the EU Fusion programme and connections to international HPC communities, showcasing contributions made to the field. Experience in workflow management systems such as Apache Airflow. Familiarity with Research Data Management methodologies,modern database technologies including SQL, NoSQL and Graph Databases, and parallel file access technologies such as MPI more »
which Data Scientists will be able to enjoy using Essential criteria and experience Proficiency in one or more analytical tools eg R, Python, Tableau, Apache Spark, etc. Proficiency in Azure Machine Learning and Azure Data Bricks. Pro-activity and self-starting attitude Excellent analytical and problem-solving ability Responsibilities more »
and Saltstack CI/CD: Jenkins, GitLab CI/CD Data/Messaging: Amazon Aurora (Postgres), ElastiCache (Redis), AmazonMQ (RabbitMQ) API: Tyk API Gateway, Apache Monitoring/Logging: Datadog and SumoLogic Security: IAM (Identity Access Management), Security Groups, mTLS Other: VPC and general networking In return, they would be more »
GoLang. - Significant experience with Hadoop, Spark and other distributed processing platforms and frameworks. - Experience working with Open table/storage formats like delta lake, apache iceberg or apache hudi. - Experience of developing and managing real time data streaming pipelines using Change data capture (CDC), Kafka and Apachemore »
pipelines Know your way around Unix based operating system Experience working with any major cloud provider (AWS, GCP, Azure) Fluency in English Experience using Apache Airflow Experience using Docker Experience using Apache Spark Benefits: Salary £40-50K per annum dependant on skills and experience 25 Days annual more »
Leeds, England, United Kingdom Hybrid / WFH Options
Damia Group
Spark Scala Developer - Scala/Apache Spark - Hybrid/Leeds - £450-£550 Spark Scala Developer to join our client, one of the biggest financial services organizations in the world, with operations in more than 38 countries. It has an IT infrastructure of 200,000+ servers, 20,000+ database instances … Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible for: Designing, building, and maintaining data pipelines using Apache Spark and Scala Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP). Mandatory Skills; At least … IT Experience with designing, building, and maintaining data pipelines . At least 4+ Years of experience with designing, building, and maintaining data pipelines using Apache Spark and Scala. Programming languages: Proficiency in Scala and Spark is essential. Familiarity with Python and SQL is often a plus. Big Data technologies more »
data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc. Strong Python and SQL skills for data manipulation Experience with Apache Spark and/or Databricks. Familiarity with BI visualization tools like Power BI Experience in managing end-to-end analytics pipelines (batch and streaming … such as Azure Data Engineer Associate are desirable. Knowledge of data ingestion methods for real-time and batch processing Proficiency in PySpark and debugging Apache Spark workloads. What’s in it for you? Annual bonus scheme – up to 10% Excellent pension scheme Flexible working Enhanced family friendly policies Ongoing more »
Senior QA Automation Tester - Cypress Job Title: QA Automation Engineer Location: South West London Salary: £60,000 per year + Benefits Job type: Permanent Role: Hybrid A long established Fintech company based in London, renowned for its cutting-edge payment more »
Role : PHP Developer 🗺️ Location : Dudley - 2 days a week in office 💰 Salary : £35,000 - £45,000 ✅ Skills : PHP, Azure, Apache, CentOS, T-SQL My client is expanding and looking for a PHP Developer to join their growing team in the Dudley area. You'll be responsible, for the development … features Troubleshooting web applications Maintaining clear documentation of all work Qualifications 3+ years of experience with hands-on PHP programming Experience with IDE, Azure, Apache, CentOS, T-SQL What's in it for you: Starting salary up to £45,000 Continuous training and development Flexible working Please note : the more »
Derby, Derbyshire, East Midlands, United Kingdom Hybrid / WFH Options
Devtank Ltd
Required Skills: * Native on Linux command line. * Python web development - specifically experience with aiohttp * JavaScript/CSS/HTML/SSL * MySQL * Debian/Apache/NGINX server admin experience * Evidence of engaging with open source projects communities. * Competent at using Git for source control. * Passionate about open source more »
Employment Type: Permanent, Part Time, Work From Home
as R, Python, Azure, Machine Learning (ML), and Databricks. Essential criteria and experience Proficiency in one or more analytical tools eg R, Python, Tableau, Apache Spark, etc. Proficiency in Azure Machine Learning and Azure Data Bricks. Pro-activity and self-starting attitude. Excellent analytical and problem-solving ability. Interest more »
Glasgow, Glasgow City, City of Glasgow, United Kingdom
Nine Twenty
expertise in Windows server environments. (inc. Group Policy, DNS, DHCP, File Services, IIS etc.) Proven experience managing Enterprise Linux Operating Systems. (inc. SSH, Bind, Apache, Ngnix, MySQL, PostgreSQL, BASH, Python, Git, LDAP, NFS, Samba) Working with Server Hardware like Dell/Cisco UCS/HPE Strong knowledge of networking more »
Bingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Crimson
computer vision algorithms. Expertise in Python, Java, C++, PHP; experience with frameworks like Flask, Django. Familiar with OpenCV, TensorFlow, PyTorch. Experience with MySQL, MongoDB, Apache, and UI/UX design principles. Strong collaboration and teamwork abilities. Excellent organizational and analytical skills. What's on offer? Work on cutting-edge more »
Employment Type: Contract
Rate: £400 - £425/day Flexible working opportunity
Nottingham, Nottinghamshire, East Midlands, United Kingdom Hybrid / WFH Options
Crimson
computer vision algorithms. Expertise in Python, Java, C++, PHP; experience with frameworks like Flask, Django. Familiar with OpenCV, TensorFlow, PyTorch. Experience with MySQL, MongoDB, Apache, and UI/UX design principles. Strong collaboration and teamwork abilities. Excellent organizational and analytical skills. What's on offer? Work on cutting-edge more »
Employment Type: Contract
Rate: £400 - £425 per day + Flexible working opportunity
