1 to 25 of 76 Apache Jobs in the South East

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

learning solutions. With published authors and award-winning data scientists who contribute some of the major machine learning and distributed data technologies, such as Apache Spark, we are a friendly, passionate group of engineers making a career out of building great software for our customers. The Adthena data team ...

strong plus Technical Skills: • Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL) • Familiarity with data pipeline and workflow management tools (e.g., Apache Airflow) • Experience with programming languages such as Python, Java, or Scala. Python is highly preferred • Basic understanding of cloud platforms and services (e.g. ...

code Proficiency in programming languages such as Python, Spark, SQL Strong experience with SQL databases Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) Experience with cloud platforms (Azure preferred) and related data services Excellent problem-solving skills and attention to detail Inclusive and curious, continuously ...

experience developing dashboards for analysis and reporting, leveraging tools such as Databricks Workspaces, Streamlit or Jupyter notebooks. Familiarity with workflow orchestration tools (e.g. Apache Airflow) or data transformation frameworks (e.g. dbt) a plus. Familiarity with autonomous systems development (e.g., perception, planning, control) or relevant domains such as robotics, simulation ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. SLURM ...

architectural strategies, blueprints for hybrid and cloud-native solutions ELT/ETL Frameworks & Pipelines Essential Develop robust ELT/ETL pipelines using tools like Apache Airflow, DBT, AWS Glue, Azure Data Factory, or Kafka Connect. Desirable Optimize data transformations for performance, reusability, and modular design (e.g., using SQL/ ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Apply now! Benefits and Contract Information Financial incentives: depending on circumstances, monthly family/marriage allowance of £278 monthly child allowance ...

cloud data warehouses (e.g., Snowflake, Redshift). ·Familiarity with data orchestration tools (e.g., Airflow). ·Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). ·Exposure to CI/CD pipelines, ideally using GitLab CI. ·Background working with media, marketing, or advertising data. The Opportunity ...

Platform Migration projects and delivering secure, scalable cloud solutions Nice to have: Understanding of Synapse Spark Architecture Familiarity with a variety of technologies including Apache Spark, Spark ML, Serverless Spark Pools, T-SQL, ETL Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment ...