26 to 50 of 115 Permanent Apache Jobs

Azure Key Vault, Azure Monitor, Azure Log Analytics, Azure API Management (APIM), Azure DevOps. Databases : SQL Server, Oracle, PostgreSQL, Delta Lake Big Data : Apache Spark Version Control : GitHub, Git, Azure DevOps Visualization : Power BI & Integration with REST APIs for custom dashboards. Data Integration & Workflow Orchestration : Azure Data Factory, Databricks ...

team members. Proficiency in Python, Java, and SQL is essential, along with experience in using AWS services and Docker. Candidates should be familiar with Apache Spark, Terraform, and GitLab for CI/CD. If you have a passion for improving testing frameworks and practices, we invite you to apply. ...

Manchester, UK, to develop scalable APIs and manage big data solutions. Candidates should have 8+ years in software or data engineering, with skills in Apache Spark, Airflow, and a strong foundation in Java, Python, or Scala. The role requires collaboration with cross-functional teams to deliver high-quality data ...

technical trade-offs, backed by a previous background as an experienced software engineer. Experience with data platform and ETL/orchestration technologies such as Apache Airflow, Spark, AWS Glue, and Snowflake. Experience with (or strong advocacy for) AI developer tooling such as Claude Code, Copilot, Windsurf, and Gemini. Proficiency ...

promote DevOps. Support internal and external stakeholders, including customers and regulatory authorities. Tools, Systems & Continuous Improvement Manage and optimise the use of tools (e.g. Apache Spark, AWS Glue, Databricks or equivalent). Support system enhancements of data processing and transformation, migrations, and process improvements. Contribute to the development ...

Data Delivery and Analytics program to support the growing need of the product like MyMPA, QMR. Tech Skills: Unix, Shell Scripting, SQL, Python, Apache Nifi, Splunk, Dynatrace, Jenkins, GIT, XLR etc. We regularly review our run state not only from an internal perspective, but also understanding and providing ...

lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership . … reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues and platform defects Risk Management & Reporting Identify, assess, and communicate quality risks across releases ...

with Python-based development workflows and tooling Technology Stack: Azure Cloud Services C# (.NET 10) Python React.js and modern JavaScript (ES6+) Snowflake (Data Warehouse) Apache Airflow Terraform dbt SQL Server ...

with Python-based development workflows and tooling Technology Stack: Azure Cloud Services C# (.NET 10) Python React.js and modern JavaScript (ES6+) Snowflake (Data Warehouse) Apache Airflow Terraform dbt SQL Server ...

ideal candidate will have a strong programming background in Python or Java, knowledge of SQL, and experience with data processing frameworks such as Apache Spark. Responsibilities include enhancing data pipelines, ensuring data quality, and collaborating with engineering teams. The position is located in London and offers significant growth opportunities ...

support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with technologies such as Python, SQL, and Apache Spark, helping drive analytics and operational decision-making. Ideal candidates possess strong programming skills, a relevant degree, and a collaborative spirit, as you will partner ...

requires a candidate with 8+ years of software and data engineering experience, focusing on API development using Spring Boot and big data technologies like Apache Spark and Airflow. Responsibilities include designing scalable systems, collaborating with cross-functional teams, and mentorship. Candidates should have strong programming skills, SQL expertise ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

data engineering Experience with Google Cloud Platform (GCP), including Compute Engine, Cloud Storage, IAM, and Cloud Functions Experience with big data technologies such as Apache Spark, Dataflow, or BigQuery Experience designing and maintaining data warehouse solutions Experience developing or integrating Artificial Intelligence and expert systems Experience designing and working ...

clouds (AWS, Azure, GCP) and cloud data warehousing solutions like Snowflake and Databricks. Certifications with each are a plus. Understanding of SQL, Python, R, Apache Spark or similar product or language are also a plus.* Strong knowledge of data analytics, data science, ETL processes, AI/ML workflows, automation ...

execute. You have deep experience designing, building, and operating production data pipelines, including owning reliability, monitoring, and failure recovery for orchestration systems such as Apache Airflow (or equivalent). You are fluent in modern data and cloud ecosystems, with hands-on experience (or the ability to ramp quickly … days a week in office Lean principles and Agile development practices Continuous deployment across all microservices Big Data ecosystem and SQL Databases (Apache Airflow, Iceberg, Spark/Thrift, PostgreSQL, Azure Hyperscale) Python as a primary backend language High-level frameworks (Flask, SQLAlchemy, Alembic, Pytest, Socket.IO) Amazon Web Services ...

Proven track record with data governance, quality, lineage, and security practices.* Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub).* Experience in, or knowledge of, DevSecOps Tooling and Processes.* Self-starter with the ability ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call ...

hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.). Proven experience in DBT for data transformation. Expertise in Cloud Composer/Apache Airflow for workflow orchestration. Advanced proficiency in Python. Solid experience with Terraform for infrastructure provisioning. Demonstrated experience in migrating legacy systems (on-prem ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Work closely with Product, Data Science, and senior stakeholders Tech Stack Cloud & DevOps: GCP, GKE, Terraform, GitHub, Cloud Build Data & Processing: GCS, Apache Spark, PostgreSQL, Redis Frontend & Analytics: React, Power BI Languages: Python, R Profile Experience as a Technical Architect/Lead/Principal Engineer Strong background in cloud ...

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial ...

skills and collaborative approach Degree in a relevant subject (or equivalent experience) Nice to have Exposure to Linux/Unix environments Familiarity with MySQL, Apache, or similar technologies Experience with Python (Flask) or backend integration work Exposure to AWS (Lambda, EC2, API Gateway, etc.) Understanding of microservices or serverless ...

strong desire to learn Python* Familiarity with modern web standards, including HTML5 and CSS3* Experience with Linux or UNIX-like systems* Experience with Apache, PostgreSQL, or ReactJS is a plus* Experience with Python unit testing and full-stack web testing is a plus**Benefits and Perks of working ...

environment and manage multiple projects simultaneously. Hands-on experience working with at least one OLAP-specific engine or analytical data warehouse technology (such as Apache Druid, ClickHouse, Amazon Redshift, Google BigQuery or Snowflake) to build scalable reporting solutions. Confidence can sometimes hold us back from applying for a job. ...