development (ideally AWS) Knowledge and ideally hands-on experience with data streaming, event-based architectures and Kafka Strong communication and interpersonal skills Experience with Apache Spark or Apache Flink would be ideal, but not essential Please note, this role is unable to provide sponsorship. If this role sounds more »
managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements … Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming technologies like Apache Kafka or Azure Event Hubs Knowledge of data visualization tools, such as Power BI or Tableau Contributions to open-source projects or active participation more »
Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a very senior candidate to … Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with stakeholders Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full … without sponsorship, if you are interested please apply or email me directly - aaron.dhammi@nicollcurtin.com Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based more »
step functions and ECS services. Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation more »
GoLang. Significant experience with Hadoop, Spark and other distributed processing platforms and frameworks. Experience working with Open table/storage formats like delta lake, apache iceberg or apache hudi. Experience of developing and managing real time data streaming pipelines using Change data capture (CDC), Kafka and Apachemore »
Scripting, React, Go. Experience with deploying, configuring, and managing cloud architecture and technologies in AWS environments. Experience with web application services such as NGINX, Apache, JBoss. Knowledge of OpenShift Containerisation, RHEL 6,7,8, Docker and Kubernetes. Experience with monitoring systems eg, ELK, Nagios, New Relic, DataDog, Splunk etc. more »
integration architecture and design skills Good communication skills Desirable Skills: JavaScript - with React/Vue being even better. Docker/Kubernetes Linux - Basic sysadmin (Apache, Nginx) SQL/Oracle/PostgreSQL/MongoDB/DynamoDB Message Queues - RabbitMQ or similar AWS or GCP This an office based position DCS more »
to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool more »
City of London, London, United Kingdom Hybrid / WFH Options
Client Server
to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool …/CD and Infrastructure as Code (Terraform) You're familiar with other languages such as Java and are open to learning new things e.g. Apache Flink You've worked on systems that require high throughput and low latency You enjoy problem solving and have great communication and collaboration skills more »
to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool …/CD and Infrastructure as Code (Terraform) You're familiar with other languages such as Java and are open to learning new things e.g. Apache Flink You've worked on systems that require high throughput and low latency You enjoy problem solving and have great communication and collaboration skills more »
up and learn new technologies and frameworks Nice to have: Knowledge of databases, SQL Familiarity with Boost ASIO Familiarity with data serialization formats such Apache Arrow/Parquet, Google Protocol Buffers, Flatbuffers Experience with gRPC, http/REST and Websocket protocols Experience with Google Cloud/AWS and/ more »
integration architecture and design skills Good communication skills Desirable Skills: JavaScript – with React/Vue being even better. Docker/Kubernetes Linux – Basic sysadmin (Apache, Nginx) SQL/Oracle/PostgreSQL/MongoDB/DynamoDB Message Queues – RabbitMQ or similar AWS or GCP This an office based position more »
offs explicit and understandable to others REQUIREMENTS 7+ years' coding experience, including 3 years in a dedicated ML Engineering role 2+ years’ experience with Apache Spark Experience working with GB+ scale data Experience with deployed ML services Experience deploying multiple ML projects across different environments Productionisation experience in at more »
Bristol, England, United Kingdom Hybrid / WFH Options
Made Tech
and able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create more »
Manchester, England, United Kingdom Hybrid / WFH Options
Made Tech
and able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create more »
Python client for Google BigQuery Advanced SQL (GoogleSQL, MySQL) Google Cloud Services Advanced BigQuery Advanced Google Cloud Storage Google Dataform Google Cloud Function Advanced Apache Airflow Basic Tableau: ability to create basic visualisations Ability to integrate multiple data sources and databases into one system Able to create database schemas more »
the Midlands. Ideal Candidate Profile: We are seeking an individual who have the following attributes: Proven expertise as a Data Engineer, demonstrating proficiency in Apache Spark and cloud-based technologies, particularly Microsoft Azure and Databricks. Strong programming skills, with a focus on Python, along with proficiency in ETL frameworks more »
Leeds, England, United Kingdom Hybrid / WFH Options
Candour Solutions
employees Driving change and handling difficult situations Dealing with change on a daily basis Ability to demonstrate the value of changes introduced Web servers - Apache, nginx, IIS, Drupal Databases - Oracle, MYSQL, MSSQL Traffic Management - F5, Haproxy, Keepalived CDNS - CDNetworks, Akamai, Incapsula Scripting - Bash, Bat, Python, Perl Programming Languages - PHP more »
prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of more »
in programming languages commonly used in machine learning, preferably Python. Experience with machine learning frameworks and libraries, such as TensorFlow, PyTorch, scikit-learn, or Apache Spark. Proven track record of developing and implementing machine learning solutions in a professional setting. Passion for exploring new technologies and driving innovation in more »
Monitoring, Tuning, Housekeeping Experience working in an ITIL environment (desired) UNIX, Linux, AIX, Solaris (desired) Nice to have: Understanding/knowledge/exposure to Apache, Tomcat, Container tools, SSO technologies, and monitoring tools but certainly not critical to the functionality of this position. The above is a wish list more »
and Saltstack CI/CD: Jenkins, GitLab CI/CD Data/Messaging: Amazon Aurora (Postgres), ElastiCache (Redis), AmazonMQ (RabbitMQ) API: Tyk API Gateway, Apache Monitoring/Logging: Datadog and SumoLogic Security: IAM (Identity Access Management), Security Groups, mTLS Other: VPC and general networking In return, they would be more »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
J&C Associates Ltd
so any knowledge of cross domain solutions or air gapped is a plus AWS as initial hosting provider * Containerised apps using Docker and Kubernetes * Apache Jena * Elastic * PostGIS * Kafka * Apache NiFi * AWS Cognito * HTTP REST, GraphQL, SPARQL interfaces * Web apps based on HTML/CSS/Javascript frameworks more »
Reading, England, United Kingdom Hybrid / WFH Options
CACTUS IT SOLUTIONS
Exhibit proficiency in Java concurrency for parallel test execution, providing valuable expertise to enhance testing efficiency. • Java Libraries: Demonstrate advanced usage of libraries like Apache Commons, Guava, etc., showcasing the ability to select and implement libraries for optimized efficiency. • Automation Frameworks: Work with Selenium WebDriver, JUnit, TestNG, Cucumber BDD … advanced frameworks, contributing to their enhancement and customization to meet project requirements. • REST API Testing: Utilize advanced API testing tools like Rest Assured and ApacheHTTP Client, showcasing in-depth knowledge of API testing. • Framework Implementation: Contribute to the enhancement and customization of automation frameworks, ensuring they align with more »
