1 to 2 of 2 Contract CI/CD Jobs in the North of England with Remote Work Options

Spark Scala Developer - Scala / Apache Spark - Hybrid / Leeds - £450-£550 Spark Scala Developer to join our client, one of the biggest financial services organizations in the world, with operations in more than 38 countries. It has an IT infrastructure of 200,000+ servers, 20,000+ database … to refactor Legacy ETL code, for example DataStage into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures / performance issues. Your responsibilities; As a Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible … platforms like AWS, Azure, or GCP for data pipelines deployment is a plus. DevOps tools: Knowledge of DevOps tools like Git, CI / CD pipelines, and containerization tools (Docker, Kubernetes) can be beneficial. Spark Scala Developer - Scala / Apache Spark - Hybrid / Leeds more »

load it into consumer models & marts as well as building and managing the infrastructure to do all of the work. About your role: (50 / 50 split between Design & Development and Leading, coaching & Mentoring) You will have an extensive ETL / ELT background developing data pipelines, optimising queries … and enhancing overall data processing performance. You will also be experienced in data modelling / data warehousing. You will have multiple year's experience working in GCP with good knowledge across the platform and deep knowledge in core processing and orchestration products such as Big Query, Data Flow, Data … Fusion, Data Stream, Cloud Functions, Data Proc and Airflow / Composer. You will have held a leading role in a Data Engineering function with responsibility for the directing the efforts of other data engineers though the design, build and deployment of complex data solutions. This includes driving the implementation more »