City of London, London, United Kingdom Hybrid / WFH Options
83zero Ltd
similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.) Data Architecture experience is a bonus Python, Scala, Databricks Spark and Pyspark with Data Engineering skills Ownership and ability to drive implementation/solution design More ❯
similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.) Data Architecture experience is a bonus Python, Scala, Databricks Spark and Pyspark with Data Engineering skills Ownership and ability to drive implementation/solution design For more information, please contact Ellis via email directly to More ❯
key role in building their scalable data capabilities; designing ingestion pipelines, high-performance APIs, and real-time data processing systems. Key Responsibilities Stack: Python, PySpark, Linux, PostgreSQL, SQL Server, Databricks, Azure, AWS Design and implement large-scale data ingestion, transformation, and analysis solutions Model datasets and develop indicators to More ❯
london (city of london), south east england, United Kingdom
Wilson Brown
key role in building their scalable data capabilities; designing ingestion pipelines, high-performance APIs, and real-time data processing systems. Key Responsibilities Stack: Python, PySpark, Linux, PostgreSQL, SQL Server, Databricks, Azure, AWS Design and implement large-scale data ingestion, transformation, and analysis solutions Model datasets and develop indicators to More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Syntax Consultancy Limited
with proficiency in designing and implementing CI/CD pipelines in Cloud environments. Excellent practical expertise in Performance tuning and system optimisation. Experience with PySpark and Azure Databricks for distributed data processing and large-scale data analysis. Proven experience with web frameworks , including knowledge of Django and experience with More ❯
schemas (both JSON and Spark), schema management etc Strong understanding of complex JSON manipulation Experience working with Data Pipelines using a custom Python/PySpark frameworks Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. … write basic scripts) LANGUAGES/FRAMEWORKS JSON YAML Python (as a programming language, not just able to write basic scripts) Pydantic experience DESIRABLE SQL PySpark Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala DESIRABLE Azure SQL Server as a HIVE Metastore DESIRABLE TECHNOLOGIES Azure Databricks Apache More ❯
london (city of london), south east england, United Kingdom Hybrid / WFH Options
Oliver Bernard
Data Engineer Hybrid - Bank, London (2-3 days p/w) Pays £600-£650p/d Inside IR35 Python/Data Engineer - Python, Databricks, PySpark, Azure, AWS Oliver Bernard have partnered with a market leading cyber insurance company who are seeking a contractor to help build out their data … team working on ingesting multiple large data sets, creating backend pipelines and providing analytics to the wider business. Python/Data Engineer - Python, Databricks, PySpark, Azure, AWS Key Skills and Experience: Python Databricks PySpark AWS or Azure This role is hybrid working (2-3 days p/w … in office) in Bank, central London and paying £600-£650p/d InsideIR35. Python/Data Engineer - Python, Databricks, PySpark, Azure, AWS More ❯
