8 of 8 Permanent Apache Spark Jobs in Birmingham

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks ...

Generative AI initiatives by developing scalable, secure and reliable data platforms. Key Responsibilities Design, build and maintain high-throughput data pipelines using Apache Spark and cloud-native technologies. Develop scalable ETL/ELT workflows for structured and unstructured datasets. Build and optimise data-processing solutions within AWS environments. … standards. Troubleshoot complex data-processing and distributed-system issues within production environments. Essential Experience 5+ years of commercial Data Engineering experience. Strong hands-on Apache Spark development experience. Strong programming experience with Java and/or Scala. Strong AWS experience, ideally including technologies such as S3, EMR, Glue ...

with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately represent the underlying datasets. Review and align the reporting attributes against the enterprise and conceptual data ...

drift monitoring; versioning and release management. Cloud architecture (Azure/AWS/GCP), Kubernetes/Docker, serverless, IAM and network security. Data engineering depth (Spark/Databricks; ETL/ELT); cloud‐native data + AI architectures. Enterprise integration and SRE principles (SLIs/SLOs, runbooks, rollback). Consulting leadership ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

with cloud‐based data warehouses (e.g., Snowflake, GBQ). Familiarity with cloud‐based data pipeline services (e.g. AWS Glue) or distributed processing frameworks like Apache Spark. Equal Opportunity Employment Goldman Sachs is an equal opportunity employer and does not discriminate on the basis of race, colour, religion, sex, national ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...