10 of 10 Apache Jobs in the City of London

data engineering tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. ...

Apply best practices for version control, automated testing, and deployment. Workflow Orchestration Design, implement, and maintain orchestration pipelines using tools such as: Databricks Workflows, Apache Airflow, dbt. Monitor job performance and troubleshoot failures proactively. Cloud Integration & Optimization Integrate Databricks with Azure services (e.g., Data Factory, Azure Functions, storage accounts ...

data into something they can actually use and act on. What you'll be doing: Designing and building performant data ingestion pipelines using Apache Spark, ideally within Azure Databricks Contributing to the platform's data modelling and architecture Building dashboards and semantic models, and presenting these directly to stakeholders ...

focus areas: Building scalable data pipelines using Apache Spark & Airflow Working within a cloud-based, containerised environment (Kubernetes) Contributing to a wider data platform modernisation programme Supporting both batch and streaming workloads Tech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming nice to have ...

Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What ...

testable, maintainable code, pair programming and TDD are core to how they work. Tech Stack Expert Python, advanced SQL, deep Linux knowledge PostgreSQL, Snowflake Apache Kafka, Apache Airflow Django, Flask or FastAPI TDD, BDD, pair programming Java familiarity a plus What They Are Looking For Principal or Staff ...

testable, maintainable code, pair programming and TDD are core to how they work. Tech Stack Expert Python, advanced SQL, deep Linux knowledge PostgreSQL, Snowflake Apache Kafka, Apache Airflow Django, Flask or FastAPI TDD, BDD, pair programming Java familiarity a plus What They Are Looking For Principal or Staff ...

testable, maintainable code, pair programming and TDD are core to how they work. Tech Stack Expert Python, advanced SQL, deep Linux knowledge PostgreSQL, Snowflake Apache Kafka, Apache Airflow Django, Flask or FastAPI TDD, BDD, pair programming Java familiarity a plus What They Are Looking For Principal or Staff ...

create scalable how-to guides Integrate Databricks platform capabilities with client systems and existing data infrastructure Advise on Lakehouse architecture, Delta Lake, Unity Catalog, Apache Spark, and MLflow best practices Deliver training and enablement sessions to customer data teams Contribute to internal knowledge sharing and best-practice documentation Must … Have Skills & Experience 10+ years working with Big Data technologies (Apache Spark, Kafka, Data Lakes) in a customer-facing, post-sales, or consulting capacity 4+ years as a Solutions Architect designing and delivering Big Data solutions for enterprise clients Deep expertise in Apache Spark and distributed computing including ...

designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You'll also play a key role in pre-sales activities, solution design, and helping to drive strategic Databricks initiatives across … Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing ...