1 to 25 of 30 Apache Jobs in the East of England

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across security ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across security ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort keys ...

solutions.• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless data flow.• Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 3 10 years experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...

more scripting languages (Shell, Python, Ruby, etc.) Experience with Source Control Management (Git, SVN) Demonstrable Linux Systems Administration (Ubuntu, CentOS) Experience with Web servers (Apache, NGINX) Excellent written and verbal communication Experience of producing technical and process documentation Qualification: Bachelor of Science degree in Computer Science, Management Information Systems ...

more scripting languages (Shell, Python, Ruby, etc.) Experience with Source Control Management (Git, SVN) Demonstrable Linux Systems Administration (Ubuntu, CentOS) Experience with Web servers (Apache, NGINX) Excellent written and verbal communication Experience of producing technical and process documentation Qualification: Bachelor of Science degree in Computer Science, Management Information Systems ...

more scripting languages (Shell, Python, Ruby, etc.) Experience with Source Control Management (Git, SVN) Demonstrable Linux Systems Administration (Ubuntu, CentOS) Experience with Web servers (Apache, NGINX) Excellent written and verbal communication Experience of producing technical and process documentation Qualification: Bachelor of Science degree in Computer Science, Management Information Systems ...

more scripting languages (Shell, Python, Ruby, etc.) Experience with Source Control Management (Git, SVN) Demonstrable Linux Systems Administration (Ubuntu, CentOS) Experience with Web servers (Apache, NGINX) Excellent written and verbal communication Experience of producing technical and process documentation Qualification: Bachelor of Science degree in Computer Science, Management Information Systems ...

more scripting languages (Shell, Python, Ruby, etc.) Experience with Source Control Management (Git, SVN) Demonstrable Linux Systems Administration (Ubuntu, CentOS) Experience with Web servers (Apache, NGINX) Excellent written and verbal communication Experience of producing technical and process documentation Qualification: Bachelor of Science degree in Computer Science, Management Information Systems ...

more scripting languages (Shell, Python, Ruby, etc.) Experience with Source Control Management (Git, SVN) Demonstrable Linux Systems Administration (Ubuntu, CentOS) Experience with Web servers (Apache, NGINX) Excellent written and verbal communication Experience of producing technical and process documentation Qualification: Bachelor of Science degree in Computer Science, Management Information Systems ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

features Design data models Contribute to frontend development in React/Android when needed Helpful skills if you had them: Streaming or unary gRPC Apache Arrow/Parquet Observability tooling (Prometheus, Grafana, CloudWatch) If you're interested in this kind of challenge apply now - let's chat ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...

kernels Experience with RLHF pipelines (PPO, DPO, ORPO) Experience training or deploying multimodal or diffusion models Experience in large-scale data processing (Apache Arrow, Spark, Ray) Prior work in a research lab (Google Brain, DeepMind, FAIR, Anthropic, OpenAI ...