51 to 75 of 123 Remote/Hybrid Apache Jobs

Spring Boot, REST APIs and microservices Experience with a relational database like MS SQL Server, PostgreSQL, Sybase ASE Experience with Streaming technologies like Kafka, Apache Flink Experience with cloud technologies, such as Microsoft Azure Experience with Agile process Experience with DevOps and tools like Azure DevOps Our benefits ...

tools, e.g. NetBoxLog ingestion: OpenSearch/Elasticsearch, Logstash, Kibana, Filebeat, SyslogContainerisation: Docker and/or KubernetesVirtualisation experienceCloud: AWSDatabases: PostgreSQL and/or MySQLApplication Servers: Apache or nginx, WSGIDeep understanding of key service health metricsKnowledge of current security best practices including encryption and systems hardeningExperience implementing technologies with a focus ...

models. Your Skills & Experience Strong experience with SQL and modern data engineering practices. Hands-on experience with Snowflake and dbt. Strong experience working with Apache Airflow for data orchestration. Experience working with AWS data services and cloud-based data platforms. Strong Python skills for data engineering and pipeline development. ...

years' experience delivering enterprise data platforms or analytics solutions. Strong commercial experience delivering Databricks solutions. Consulting or customer-facing delivery experience. Strong understanding of Apache Spark, modern Lakehouse architecture and Unity Catalog. Experience with Azure, AWS or GCP. Experience implementing CI/CD and deployment automation. Excellent communication ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks Certified ...

within financial markets/securities . Experience working with GCP BigQuery . Experience with GCP Cloud SQL . Experience with Terraform . Experience with Apache Airflow . Understanding of security reference data, pricing data or corporate actions. The Project The wider project is focused on creating a multi-asset ...

consumers Actively uses AI-powered tools to move faster and focus on architecture, system design, and scalability tradeoffs Nice to have: experience with Databricks, Apache Iceberg, Kafka, or similar lakehouse and streaming technologies Условия Hybrid work schedule with office attendance twice a week and flexible working hours Virtual Shares ...

operating ETL/ELT pipelines and large‐scale data architectures. Hands‐on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). Ability ...

implement highly scalable and efficient data pipelines using advanced Python (Pandas, web scraping and machine learning libraries), SQL (including advanced optimisation techniques) and Apache Airflow. Lead the extraction, transformation and loading (ETL) of large and complex datasets, including time series data, from various sources (web APIs, databases, real-time … data modelling and design skills. Extensive experience designing and building large-scale, efficient data pipelines for complex and time series data. Proven experience with Apache Airflow for data orchestration and scheduling at scale. Expertise in AWS cloud services (S3, Redshift, EC2, Lambda, etc.) is a must. Definition and design ...

implement highly scalable and efficient data pipelines using advanced Python (Pandas, web scraping and machine learning libraries), SQL (including advanced optimisation techniques) and Apache Airflow. Lead the extraction, transformation and loading (ETL) of large and complex datasets, including time series data, from various sources (web APIs, databases, real-time … data modelling and design skills. Extensive experience designing and building large-scale, efficient data pipelines for complex and time series data. Proven experience with Apache Airflow for data orchestration and scheduling at scale. Expertise in AWS cloud services (S3, Redshift, EC2, Lambda, etc.) is a must. Definition and design ...

Engineer on design and peer review. Required Skills: Terraform, Python, AWS data services; engineering standards and code review Required Tools: Lambda/S3/Apache Iceberg; GitLab CI/CD; Terraform If you're an SC-cleared Platform Engineer available for a 3-month remote contract , I'd love ...

Engineer on design and peer review. Required Skills: Terraform, Python, AWS data services engineering standards and code review Required Tools: Lambda/S3/Apache Iceberg GitLab CI/CD Terraform If you're an SC-cleared Platform Engineer available for a 3-month remote contract , I'd love ...

query optimisation C#, ASP.NET and .NET Core Cosmos DB SDKs and NoSQL data modelling Change Data Feed and Spark integration PySpark and Apache Spark Microsoft Fabric data pipelines Partitioning, indexing and consistency levels Pytest and automated testing Git and GitLab DevOps/CI pipelines Scalable application and concurrency patterns ...

configuration management) for fleet managementSolid Python skills — you'll be writing and maintaining production daemons, not just scriptsDeep Linux systems knowledge (Ubuntu) — comfortable with Apache/Nginx, PHP-FPM, Varnish, systemd, filesystem mounts, and networking fundamentalsUnderstanding of distributed systems concepts: consensus, leader election, distributed locking, eventual consistency ...

fleet management Solid Python skills - you'll be writing and maintaining production daemons, not just scripts Deep Linux systems knowledge (Ubuntu) - comfortable with Apache/Nginx, PHP-FPM, Varnish, systemd, filesystem mounts, and networking fundamentals Understanding of distributed systems concepts: consensus, leader election, distributed locking, eventual consistency ...

issues with transparency. Skills & ExperienceEssentialProven in-depth commercial experience in the following key areas: Databricks – Lakehouse architecture, Spark, Delta Lake, workflows and performance tuning. Apache Spark & Scala – High-performance distributed data processing and optimisation. Cloud Data Engineering (AWS) – Cloud-native data platforms and distributed computing. Data Services Architecture & Engineering ...

optimisation and administration Strong programming experience with Python, Go and/or SQL Experience using dbt for data modelling and transformation Experience working with Apache Airflow or similar orchestration tooling Proven experience designing and building production systems on GCP and/or AWS Strong understanding of event-driven architectures … distributed systems Experience deploying and supporting batch and real-time machine learning workloads Experience working with distributed processing technologies such as Spark or Apache Beam Strong understanding of data quality principles and engineering best practices Experience optimising database performance, troubleshooting issues and maintaining production data systems Ability to learn ...

optimisation and administration Strong programming experience with Python, Go and/or SQL Experience using dbt for data modelling and transformation Experience working with Apache Airflow or similar orchestration tooling Proven experience designing and building production systems on GCP and/or AWS Strong understanding of event-driven architectures … distributed systems Experience deploying and supporting batch and real-time machine learning workloads Experience working with distributed processing technologies such as Spark or Apache Beam Strong understanding of data quality principles and engineering best practices Experience optimising database performance, troubleshooting issues and maintaining production data systems Ability to learn ...

structured streaming, Delta Lake and Delta Live Tables Proven experience in Lakehouse migration and modernization using open table formats such as Delta Lake or Apache Iceberg Proficiency with cloud-native services on Azure and knowledge of multi-cloud environments (AWS or GCP) Hands-on experience with CI/… security practices and enterprise integration controls Background in financial trading data or related domains Official Databricks certifications such as Certified Data Engineer Professional or Apache Spark Developer We offer EPAM Employee Stock Purchase Plan (ESPP) Protection benefits including life assurance, income protection and critical illness cover Private medical insurance ...

Agile Development using SCRUM. Advanced knowledge of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Advanced knowledge of Hibernate. Advanced knowledge ...

backend systems and data-intensive applications. You are experienced with Scala or Java and at least one distributed data processing framework such as Scio, Apache Beam, Spark, or Flink. You know how to design and build reliable backend services and scalable data pipelines that support business-critical workflows. ...

performance database environments Excellent communication and cross-functional collaboration skills A passion for continuous learning and innovation Desirable skill: Databricks Azure Fabric Confluent/Apache Flink Knowledge Grow with Acorn At Acorn Insurance, we're proud of our Liverpool roots - and even prouder of how far we've come. ...

application components, microservices, and data integration layers to support high-throughput regulatory reporting. Big Data Processing: Develop and optimize distributed data processing jobs using Apache Spark, Hadoop, and Hive to aggregate and transform large-scale financial datasets. Real-Time Streaming: Build and maintain real-time data ingestion and streaming … pipelines using Apache Kafka. Database Management: Design and optimize data models in MongoDB and relational databases, ensuring high performance for complex queries and data storage. Agile Execution: Drive sprint planning, task estimation, and daily progress within an Agile/Scrum framework to ensure timely delivery of project milestones. Requirement ...

test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting, monitoring, and data quality checks as first‐class concerns. Ensure data quality and observability: Embed data testing and validation processes … event streaming platforms including Kafka and its core concepts on topics, messages, and consumers. Experience building and operating automated data workflows using tools like Apache Airflow. Experience implementing data quality and validation checks throughout pipelines to ensure accuracy, completeness, consistency, and reliability. Practical experience implementing monitoring, observability and alerting ...