6 of 6 Apache Jobs in the East Midlands

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. Proficiency ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software quality ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance Tools: Experience ...

Your role: Joining the Reporting product line, you would work as a member of a highly focused team. This team specialises in Java-based data engineering, designing and delivering large-scale ETL workflows on a ...

systems and processes. An understanding and ability in a variety of languages and technologies would be ideal, including LAMP, PHP, Symfony2, MySQL, Linux, Apache, Nginx, JavaScript, PHPUnit, Git, YouTrack, PHPStorm and GitHub. Exposure to these is always favourable, but as an engineer they are sure youll relish the opportunity … Company Procedures, 14001 Environmental, 9001 Quality and Statutory H&S Regulations. Their ideal Software Developer will have: An understanding LAMP, PHP, Symfony2, MySQL, Linux, Apache, Javascript, PHPUnit, Git, YouTrack, PHPStorm and GitHub. Programming Experience, ideally in PHP 7.4 or higher. Experience in/understanding of object-oriented design & patterns. ...