11 of 11 Permanent Apache Jobs in the North West

Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake ...

organisation Supporting a move towards a product-aligned, hub-based operating model Technology Stack Cloud-first environment with Microsoft Azure Fabric Python, PyTorch SQL Apache Spark Azure Data Factory (ADF) Git What We’re Looking For 3–4 years’ experience in AI/ML engineering, data engineering, or applied ...

organisation Supporting a move towards a product-aligned, hub-based operating model Technology Stack Cloud-first environment with Microsoft Azure Fabric Python, PyTorch SQL Apache Spark Azure Data Factory (ADF) Git What We're Looking For 3-4 years' experience in AI/ML engineering, data engineering, or applied ...

server provisioning. Knowledge of CI/CD pipelines, Docker, and Git is advantageous but not essential. Experience with Linux-based environments, Nginx/Apache, and monitoring tools, is also advantageous but not essential. In return, you will be rewarded with 25-30 days holiday, flexible working, pension and ongoing ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

languages: Python, React, Go. Familiarity with deploying applications to cloud architecture and technologies in AWS environments. Experience with web application services such as NGINX, Apache, JBoss. Experience of Test Driven or Behaviour Driven development. API development and integration (preferably using Go but not essential). Experience with monitoring systems ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

Desirable Skills and Experience Experience working with cloud platforms, ideally AWS. A strong Linux background. Experience with data integration and messaging technologies such as Apache NiFi, Apache Kafka, RabbitMQ, or similar tools. Experience using Infrastructure as Code tools such as Terraform or CloudFormation. Previous experience working ...

data models Integrate and enrich data from multiple sources, ensuring consistency and quality Design and implement ETL/ELT processes (for example using Apache NiFi) Produce reusable, maintainable code with a test-driven approach Maintain and enhance existing data platforms and services Investigate and resolve operational issues in integrated … protect sensitive information Support Agile delivery, breaking down user requirements into actionable tasks Monitor and optimise system performance for reliability and efficiency Required Skills Apache Kafka Apache NiFi SQL and NoSQL databases (for example MongoDB) ETL/ELT development with Groovy, Python, or Java About the Employer With ...

will initially be for 6 months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold … version control, and automated testing for data pipelines Required Qualifications • 3+ years of experience as a Data Engineer • Strong experience with Databricks and Apache Spark • Proficiency in Python (required); SQL (advanced) • Hands-on experience with AWS or Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda ...