10 of 10 Apache Jobs in Derbyshire

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

supporting their development. Qualifications Experience leading or mentoring data engineering teams within a SaaS or product-led environment. Deep hands-on knowledge of Databricks, Apache Spark, and Delta Lake, including large-scale or near real-time workloads. Strong proficiency in Python, SQL, and cloud data services (Azure preferred ...

Platform Migration projects and delivering secure, scalable cloud solutions Nice to have: Understanding of Synapse Spark Architecture Familiarity with a variety of technologies including Apache Spark, Spark ML, Serverless Spark Pools, T-SQL, ETL Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment ...

your specific data industry experience to keep our curriculum cutting-edge. This involves iterating on materials to reflect modern stacks (e.g. cloud data engineering, Apache Airflow, Kafka). You will collaborate with the Curriculum team to design highly effective educational experiences that give learners the AI and Data skills … data modelling, and managing data warehouses (experience with DBT is a plus). Pipelines & Orchestration: Familiarity with building data pipelines, covering batch processing (e.g., Apache Airflow) and an understanding of stream processing (e.g., Kafka/Spark). Data Statistics & Analytics: A strong grasp of statistical concepts (distributions, regression, significance ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack: Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … Hands-on experience with dbt, modern data warehouses, and AWS. Demonstrated ability to mentor and develop engineers. Desirable Experience: Experience with Snowflake. Experience with Apache Iceberg. Experience with infrastructure-as-code (Terraform preferred). Experience embedding observability and monitoring in data systems. Previous experience building and leading data teams ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack: Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … Hands-on experience with dbt, modern data warehouses, and AWS. Demonstrated ability to mentor and develop engineers. Desirable Experience: Experience with Snowflake. Experience with Apache Iceberg. Experience with infrastructure-as-code (Terraform preferred). Experience embedding observability and monitoring in data systems. Previous experience building and leading data teams ...

outside of the city or country. We are seeking a highly skilled Data Engineer with expertise in managing, designing, and optimizing data pipelines utilizing Apache Airflow, Snowflake, and Apache Kafka. This individual will play a pivotal role in architecting robust, scalable, and efficient data solutions, ensuring the integrity … infrastructure Responsibilities: Develop and implement data models to support business requirements, optimizing for performance and scalability; Design, build, and maintain scalable data pipelines using Apache Airflow; Implement and maintain Kafka-based streaming data pipelines for real-time data processing and integration with various systems; Integration to third party databases ...

outside of the city or country. We are seeking a highly skilled Data Engineer with expertise in managing, designing, and optimizing data pipelines utilizing Apache Airflow, Snowflake, and Apache Kafka. This individual will play a pivotal role in architecting robust, scalable, and efficient data solutions, ensuring the integrity … infrastructure Responsibilities: Develop and implement data models to support business requirements, optimizing for performance and scalability; Design, build, and maintain scalable data pipelines using Apache Airflow; Implement and maintain Kafka-based streaming data pipelines for real-time data processing and integration with various systems; Integration to third party databases ...