23 of 23 Contract Apache Jobs

What We're Looking For: Experience with MongoDB: Essential for this role! Technical Proficiency: Strong skills in SQL, Python, and familiarity with tools like Apache Spark, Kafka, and Airflow. Cloud Knowledge: Experience with AWS, Azure, or GCP is a plus. Data Understanding: Strong grasp of data modeling, schema design ...

role Strong hands-on experience with Snowflake data platform Proficiency in SQL and data modeling techniques Experience with ETL/ELT tools (e.g., dbt, Apache Airflow, Talend, Informatica) Experience with cloud platforms (AWS, Azure, or GCP) Familiarity with data warehousing concepts and best practices Understanding of data governance ...

Apache Spark Python AWS Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

understand where traditional patterns remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps ...

prompt engineering skills and the ability to critically evaluate AI-generated code for correctness, security, and financial accuracy Desirable, but no essential: Experience with Apache Airflow or similar workflow schedulers REST or GraphQL API design experience Knowledge of fixed income, FX, or derivatives products and associated P&L/ ...

prompt engineering skills and the ability to critically evaluate AI-generated code for correctness, security, and financial accuracy Desirable, but no essential: Experience with Apache Airflow or similar workflow schedulers REST or GraphQL API design experience Knowledge of fixed income, FX, or derivatives products and associated P&L/ ...

development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security or Security Analytics experience CI/CD and automated deployment practices Strong stakeholder engagement and communication skills You will play ...

delivery of secure, scalable and high-performance data solutions within a regulated environment. This role will focus heavily on the Elastic Stack and Apache NiFi, supporting enterprise-scale data ingestion, transformation and analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient … compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards ...

professionals with strong Python development expertise, cloud engineering experience, and exposure to modern DevOps and data engineering practices. Must Have: AWS services; Terraform; Apache Spark; Python; Apache Airflow; Docker; GitLab; Security scanning agent; Jupyter; Notebooks; Key Responsibilities Design, develop, and maintain scalable Python applications and services Build … optimize cloud-native data processing pipelines Develop and manage workflows using orchestration tools such as Airflow Work with large-scale data processing frameworks including Apache Spark Deploy and maintain containerized applications using Docker Implement infrastructure automation using Terraform Integrate solutions with enterprise data and secure file transfer systems Collaborate ...

Configuration (BigIP F5, HAProxy). Scripting using PowerShell, Bash, YAML, and Python. Email Support (Dovecot, Postfix, Spam Prevention, Mail Routing) Web Server Support (IIS, Apache, Tomcat). Public Cloud (AWS/Azure) + HSM Administration. Active SC Security Clearance is essential for this contract. ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...

such as Gitlab CI, Terraform, Ansible, Helm Charts, Python, PowerShell, and REST APIs. Experience with Kubernetes cluster build and application delivery. Application experience with Apache NiFi, Elastic ECK, and Artifactory. Knowledge of secret management tools, particularly Hashicorp Vault. Proficiency in operating systems, specifically Redhat and Windows. Degree in computer ...

environment 2+ years experience working with Red Hat Linux (or other Unix variants), including scripting 2+ years experience supporting applications such as Java, .NET, Apache or IIS Desirable: Experience within the financial services or trading environment Knowledge of Windows Server Familiarity with ITIL frameworks Exposure to market data ...

data validation and application testing processes across distributed systems Investigate production issues using data analysis to identify root causes Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures Validate data using tools such as Jupyter Notebooks and Amazon Athena Analyse data across multiple formats … additional programming language (e.g., Java) Experience with scripting languages such as Bash Strong understanding of automated testing frameworks and methodologies Hands-on experience with Apache Airflow and log analysis Familiarity with data processing tools such as Apache Spark Experience working with cloud platforms and services, including: Monitoring ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

Design, build, and maintain cloud-based infrastructure using AWS Develop and manage Infrastructure as Code using Terraform Support and optimise data processing pipelines using Apache Spark and Airflow Collaborate with cross-functional teams to deliver secure and scalable solutions Implement CI/CD pipelines using GitLab Containerise applications … Notebooks for data exploration and development Key Skills & Experience Strong experience with AWS services Expertise in Terraform (Infrastructure as Code) Hands-on experience with: Apache Spark Python Apache Airflow Docker GitLab CI/CD Experience with security scanning tools such as: Trivy Trend Micro Wiz (or similar) Knowledge ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

Design, build, and maintain cloud-based infrastructure using AWS Develop and manage Infrastructure as Code using Terraform Support and optimise data processing pipelines using Apache Spark and Airflow Collaborate with cross-functional teams to deliver secure and scalable solutions Implement CI/CD pipelines using GitLab Containerise applications … Access Layer Secure File Transfer (SFT) Key Skills & Experience Strong experience with AWS services Expertise in Terraform (Infrastructure as Code) Hands-on experience with: Apache Spark Python Apache Airflow Docker GitLab CI/CD Experience with security scanning tools such as: Trivy Trend Micro Wiz (or similar) Knowledge ...

interactive dashboards and reports using Power BI Build and optimise scalable ETL (Extract, Transform, Load) pipelines Develop and manage automated workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability, and scalability Lead end-to-end data and reporting initiatives from requirements … with Power BI Strong Python programming skills for data processing and automation Solid experience with SQL and Oracle database systems Hands-on experience with Apache Airflow for workflow orchestration Strong understanding of ETL processes, data pipelines, and data architecture Experience managing data-focused projects including planning, coordination, and risk ...

requirements 3+ years of Python in production environments Strong AWS experience across core services Strong SQL skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write … across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling ...

Data Engineer, working with large-scale, complex datasets in regulated environments Scala development experience supporting analytics or data-processing solutions Hands-on experience with Apache Spark for large-scale distributed data processing Experience with model calibration, threshold management, and score explainability to meet AML governance and regulatory standards Ability … Analyst or Data Engineer, working with large, complex datasets in regulated environments Solid Scala development experience, writing and supporting scalable data and analytics solutions Apache Spark experience, including batch and/or dynamic processing of high-volume data About Us FDM is an award-winning global leader in tech ...