1 to 25 of 30 Remote Apache Jobs

while collaborating with the Data & Analytics Lead, technical colleagues and business stakeholders. Experience in the following areas would also be useful: Materialised Lake Views Apache Spark or Python. Power BI semantic modelling. APIs and cloud business system integration. Data governance, lineage and quality frameworks. Professional services experience. What ...

management and international regulatory compliance. YOUR SKILLS AND EXPERIENCE ESSENTIAL CRITERIA Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux. Experience developing cloud-native data platforms and solutions on AWS, including working with ...

work collaboratively and autonomously. Strong problem-solving skills with a pragmatic and analytical outlook. Desirable: Familiar with analytics tools such as Power BI, Apache Superset, or similar for building interactive and impactful visualizations Familiarity with distributed systems (e.g., Spark, Kafka) and how they support scalable analytics solutions Passion ...

with monitoring/logging tools (ELK stack, Prometheus, Splunk) Familiarity with service mesh and modern networking (Istio, Envoy) Exposure to data engineering and integration (Apache ecosystem, SQL, Python) Recognised technical certifications (AWS/Azure Architect, Kubernetes CKA/CKAD, Terraform) Experience in influencing technical standards, best practices, or contributing ...

strong understanding of modern data engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou ...

scripts and CI/CD automationWorking knowledge of modern MLOps stacks including experiment tracking and artifact managementHands-on experience with orchestration tools (e.g., Kubeflow, Apache Airflow, Metaflow or Prefect)Demonstrated skills with Docker, Kubernetes and distributed deploymentsPractical knowledge of Infrastructure-as-Code (Terraform) and a major cloud provider ...

Familiarity with monitoring tools such as CloudWatch, Prometheus or Grafana. Useful additional experience Relevant AWS certifications. Exposure to data-processing environments using Databricks or Apache Spark. The person we are looking for You enjoy making systems easier to run and reducing the need for manual intervention. You investigate problems ...

Analytics, Artificial Intelligence or a related field, or equivalent experience, would be effective, although practical experience is equally valuable."Nice to Have"Azure, Databricks, Apache Spark or comparable cloud and data platforms. Data pipelines, ETL and workflow-orchestration technologies. Machine-learning methods such as forecasting, prediction or classification. Experience ...

Snowpark Iceberg Tables Secure Data Sharing Snowflake Cortex Data Integration Fivetran SnapLogic Enterprise SaaS integration patterns Data Transformation & Orchestration dbt Cloud/dbt Core Apache Airflow (MWAA) CI/CD pipelines Event-driven orchestration Data Governance & Observability Collibra Data Catalogue Data Lineage Data Governance Frameworks Acceldata Data Observability Data ...

knowledge sharing and mentoring across the team. What we are looking for Practical experience managing Databricks in a production environment. A strong understanding of Apache Spark, Delta Lake and Unity Catalog. Experience working with one or more major cloud providers, including storage, networking and identity management. Confidence using Terraform ...

with structured streaming, Delta Lake and Delta Live TablesProven experience in Lakehouse migration and modernization using open table formats such as Delta Lake or Apache IcebergProficiency with cloud-native services on Azure and knowledge of multi-cloud environments (AWS or GCP)Hands-on experience with CI/… governance, security practices and enterprise integration controlsBackground in financial trading data or related domainsOfficial Databricks certifications such as Certified Data Engineer Professional or Apache Spark DeveloperWe offerEPAM Employee Stock Purchase Plan (ESPP)Protection benefits including life assurance, income protection and critical illness cover Private medical insurance and dental care ...

quality Self-driven, motivated work ethic Energetic and enthusiastic personality What makes you stand out: IMC or another investment management qualification Experience with Apache Airflow Experience with Databricks Experience with asset management data Passion for design and architecture Why join our team: We help you be your best through ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Other helpful information Hybrid Working: At EMBL-EBI we are pleased to offer hybrid working options for all our employees. A dedicated desk ...

from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with … built-in quality assertions Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking Monitoring ...

from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with … built-in quality assertions Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking Monitoring ...

from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with … built-in quality assertions Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking Monitoring ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

business. Key Responsibilities: Design, build and enhance a secure, scalable and reliable Databricks platformDevelop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta LakeContribute to platform architecture, engineering standards and best practices across the data estateWork with Product, Analytics and Data Science teams … contribute to continuous improvement across the engineering teamJob Requirements: Significant experience building and supporting scalable, production-grade data platformsStrong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQLGood understanding of cloud-based data engineering, ideally within Microsoft Azure environmentsExperience with Infrastructure as Code tools such ...

hybrid work from home policy. Qualifications Commercial experience with web client or server-side development Proficiency with Golang, TypeScript, React, SQL, Kafka or Apache Flink Background delivering software in continuous change environments Familiarity with AI tools to enhance developer productivity Clear technical communication with cross-functional stakeholders Proven grasp ...

Java and related technologies. Document code and processes to support knowledge sharing within the team. Profile Must haves: 2+ years industry experience Java Linux Apache Mongo/Postgres AI - prompt engineering or AI-assisted development (Claude, Cursor etc) Worked on a broker platform or similar industry experience a huge ...

specific area or have broad knowledge across the systems engineering lifecycle, your skills matter. Your Impact Protecting RAF aircraft like Typhoon and Apache Advancing next-gen air combat with Team Tempest and GCAP Developing future electronic warfare systems Harnessing AI/ML to unlock intelligence from vast data What ...

data exchange platform. This is a hands-on engineering and architecture role, combining the design of reusable, reliable data pipelines with practical development using Apache NiFi, RDF, SPARQL, Python and Java. The platform will use open-source, cloud-agnostic technologies to ingest, transform, validate and exchange data securely between … systems. Skills and Experience: Proven experience designing and delivering data integration or ETL solutions using Apache NiFi. Practical project experience with RDF triples, SPARQL and semantic data modelling. Hands-on development experience in both Python and Java. Experience designing reusable pipelines across APIs, databases, files and other data sources. ...

first point of escalation for technical issues within your products Candidates will have proven hands-on experience with LAMP stack (Linux, Apache, MySQL, PHP) and experience in maintaining and developing transactional, web-based platforms. Experience or capability of leading, mentoring or supporting a small development team. Good understanding ...