6 of 6 Remote/Hybrid Apache Jobs in the West Midlands

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. Understanding ...

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks Certified ...

with APIs and integrating multiple data sources. Confidence working with legacy systems and non‐modernised environments. Knowledge of web scraping techniques. Experience with Tableau, Apache, or digital analytics tools is beneficial but not essential. BENEFITS The successful Data Engineer will receive the following benefits: Salary between ...

Mockito Experience with clean architecture, DI, modular design Comfortable owning CI/CD, code quality, observability Familiarity with Docker, Maven, Jenkins ⭐ Nice to Have Apache Calcite Starburst or federated query engines JVM performance tuning High-throughput service interfaces (REST/gRPC) Data governance or policy enforcement layers 👥 This Role ...

Generative AI initiatives by developing scalable, secure and reliable data platforms. Key Responsibilities Design, build and maintain high-throughput data pipelines using Apache Spark and cloud-native technologies. Develop scalable ETL/ELT workflows for structured and unstructured datasets. Build and optimise data-processing solutions within AWS environments. Develop … standards. Troubleshoot complex data-processing and distributed-system issues within production environments. Essential Experience 5+ years of commercial Data Engineering experience. Strong hands-on Apache Spark development experience. Strong programming experience with Java and/or Scala. Strong AWS experience, ideally including technologies such as S3, EMR, Glue ...

pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational and NoSQL databases to ensure data is reliable and fit for purpose Collaborating with analysts, engineers, product owners, and stakeholders … Athena, Amazon Redshift , and cloud-based data platforms Strong SQL skills and experience working with both relational and NoSQL databases Experience supporting or developing Apache Iceberg or modern lakehouse solutions Experience working in Agile delivery environments Familiarity with Linux and Git-based version control Desirable experience Experience with Amazon ...