25 of 25 Remote Apache Jobs

Experience Extensive experience in data engineering Strong programming expertise in Python Hands-on experience with Databricks (workflows, notebooks, jobs, Delta Lake) Strong experience with Apache Spark/PySpark Experience building scalable ETL pipelines Proficiency in SQL and relational databases Experience with cloud platforms (AWS/Azure/GCP) Experience ...

platform role Strong hands-on experience with AWS (EC2, S3, RDS, Lambda, Redshift, Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working ...

computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Experience in big data technologies and frameworks, such as Apache Spark, Hadoop or similar platforms Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with Java Familiarity with Google Cloud ...

optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience implementing data governance, security, and quality frameworks. Strong understanding of modern data engineering ...

data modelling and processing but focuses on practical ability to implement solutions using a range of technologies and languages including SQL, Python, Databricks, Apache Spark, Lakehouse and various RDBMS. This is a senior, hands-on role. You will develop and support more junior team members whilst working ...

production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool ...

with geospatial datasets and technologies, including: Shapefiles GeoParquet GeoPackage GeoTIFF Spatial data processing and transformation techniques Geospatial analytics and data engineering workflows Experience with Apache Sedona or similar geospatial processing frameworks is highly desirable. Role and Responsibilities: Collaborate with stakeholders, product owners and technical teams to understand data requirements ...

Cloud: Hands-on experience with Kubernetes , Docker, Terraform, and CI/CD tools like Jenkins or GitHub Actions. Data & Messaging: Expert knowledge of Kafka , Apache Flink, PostgreSQL, Oracle, and Elasticsearch. Security: Deep understanding of OAuth 2.0, secure web services, and API gateway management. Candidate Profile Enterprise Experience: Proven track ...

scaling data platforms, with a strong focus on Azure Cloud technologies (e.g., Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL Database, Databricks, Apache Spark). Proven experience leading the implementation of data platform strategies and managing large‐scale data infrastructure initiatives using Azure. Demonstrated experience implementing modern ...

data models and ETL processes, to support the construction of scalable and efficient data systems. Familiarity with big data tools like DuckDB, Polars or Apache Spark for processing out-of-memory datasets" . Proven experience collaborating with first-team stakeholders within a professional sports environment, demonstrating strong interpersonal ...

professionals with strong Python development expertise, cloud engineering experience, and exposure to modern DevOps and data engineering practices. Must Have: AWS services; Terraform; Apache Spark; Python; Apache Airflow; Docker; GitLab; Security scanning agent; Jupyter; Notebooks; Key Responsibilities Design, develop, and maintain scalable Python applications and services Build … optimize cloud-native data processing pipelines Develop and manage workflows using orchestration tools such as Airflow Work with large-scale data processing frameworks including Apache Spark Deploy and maintain containerized applications using Docker Implement infrastructure automation using Terraform Integrate solutions with enterprise data and secure file transfer systems Collaborate ...

combines deep data expertise with broader engineering capability, get in touch with Justin Donaldson for a confidential chat. Skills: dbt spark sql snowflake apache airflow cloud JBLE1 ...

product and contributing to a new orchestration platform. Cloud infrastructure across AWS S3, Google Cloud Storage, and Azure. Big data stores including Hadoop and Apache Ozone. Integration with Snowflake, Databricks, and AI tooling including Claude, Gemini, and Codex. Building AI-powered applications and workflows on top of the platform. ...

data validation and application testing processes across distributed systems Investigate production issues using data analysis to identify root causes Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures Validate data using tools such as Jupyter Notebooks and Amazon Athena Analyse data across multiple formats … additional programming language (e.g., Java) Experience with scripting languages such as Bash Strong understanding of automated testing frameworks and methodologies Hands-on experience with Apache Airflow and log analysis Familiarity with data processing tools such as Apache Spark Experience working with cloud platforms and services, including: Monitoring ...

work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...

Highly competitive Status: Inside IR35 Working pattern: Full time We are seeking an experienced Technical Delivery Lead with strong expertise in Python, Databricks, and Apache Spark to lead the successful delivery of enterprise-scale data engineering initiatives.. This is a hands-on leadership role combining technical delivery, solution design … Technical Delivery Lead position. Strong hands-on expertise with Python. Extensive experience with Databricks, including Workflows, Notebooks, and Delta Lake. Strong experience with Apache Spark/PySpark. Proven track record building and optimising large-scale ETL/ELT pipelines. Strong understanding of modern data architecture and Lakehouse principles. Excellent ...

optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER - ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

What you'll be doing: * Building and maintaining scalable data pipelines and workflows * Developing Python based solutions for data processing and integration * Working with Apache Airflow to orchestrate data workflows * Supporting containerised environments using Docker * Collaborating with engineers, analysts, and client teams on technical delivery * Contributing to continuous improvement … platform reliability What you'll bring: * Strong hands on experience with Python 3 * Experience working with Apache Airflow * Experience working within Dockerised environments * Good understanding of data engineering principles and ETL processes * Strong problem solving and communication skills * Financial markets or trading domain exposure would be beneficial Interested ...

good understanding of modern coding conventions such as OOP & MVC and have used or at least dabbled with development frameworks. Key Skills: PHP MySQL Apache Linux/Windows HTML CSS JavaScript MVC Laravel My client can offer a great working environment with a benefits package which includes regular training ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real-time data processing systems using technologies like Apache Flink, Kafka. Develop high-quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system design, while … cost. What We're Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable ...

designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You'll also play a key role in pre-sales activities, solution design, and helping to drive strategic Databricks initiatives across … Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing ...

machine learning workflows at scale. As a Senior Data Engineer, you will design, build and operate large-scale batch data pipelines using Scala and Apache Spark. Working alongside Machine Learning Engineers, Researchers and Platform Engineers, you will help develop the infrastructure and tooling required to process vast datasets … scalable systems and operating them in production environments. You'll bring: Strong commercial experience developing applications and data platforms using Scala. Deep expertise with Apache Spark and distributed data processing. Proven experience designing, building and supporting production-grade data pipelines. Strong understanding of software engineering principles, testing and operational ...

support high availability and load-balancing solutions. Configure and troubleshoot networking technologies including DNS, routing and Firewalls. Manage web services and Proxy technologies including Apache, NGINX and Squid. Oversee backup, recovery and disaster recovery processes using Veeam. Manage endpoint security and device compliance through Microsoft Intune. Maintain server infrastructure … VMware ESXi administration experience. Strong networking knowledge including DNS, load balancing, routing and troubleshooting. Experience with Veeam backup and disaster recovery solutions. Experience managing Apache, NGINX, Squid or similar web technologies. Scripting and automation experience. Strong understanding of infrastructure security, system hardening and access control. Proven experience leading ...

producing a clear blueprint for future delivery. Key responsibilities include: * Mapping and documenting the current data architecture and reporting ecosystem * Analysing existing Python and Apache Airflow data pipelines * Tracing data flows from multiple partner data sources through Google Cloud environments into reporting platforms * Reviewing and documenting transformation logic within … platforms * Excellent documentation and communication skills * Experience with Tableau and Power BI environments * Knowledge of Google Cloud Platform (GCP) * Familiarity with PostgreSQL, Python and Apache Airflow * Experience within digital media, publishing, advertising technology or affiliate commerce environments * Understanding of programmatic advertising and revenue reporting models * Previous experience supporting data ...

producing a clear blueprint for future delivery. Key responsibilities include: * Mapping and documenting the current data architecture and reporting ecosystem * Analysing existing Python and Apache Airflow data pipelines * Tracing data flows from multiple partner data sources through Google Cloud environments into reporting platforms * Reviewing and documenting transformation logic within … platforms * Excellent documentation and communication skills * Experience with Tableau and Power BI environments * Knowledge of Google Cloud Platform (GCP) * Familiarity with PostgreSQL, Python and Apache Airflow * Experience within digital media, publishing, advertising technology or affiliate commerce environments * Understanding of programmatic advertising and revenue reporting models * Previous experience supporting data ...