not received on time. Communicating outages with the end users of a data pipeline What We Value Comfortable reading and writing code in Python, Pyspark and Java. Basic understanding of Spark and interested in learning the basics of tuning Spark jobs. Data pipeline monitoring team members should be able more »
London, England, United Kingdom Hybrid / WFH Options
Harnham
continual improvement of their performance. REQUIRED SKILLS AND EXPERIENCE Proficiency in Python, including its associated data and machine learning packages such as numpy, pandas, pyspark, matplotlib, scikit-learn, Keras, TensorFlow, and more. Experience working with object-oriented programming languages. Experience in Forecasting and propensity. Expertise in utilizing SQL for more »
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times per month. … a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in Databricks, coding in PySpark, and supporting internal applications as they are moving away from a legacy application into new bespoke applications which rely on Databricks. This is a … to provide thought leadership, and to innovate and experiment with new technologies to deliver benefits to the business. Requirements Excellent skills in Databricks and Pyspark Excellent experience with SQL and T-SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data more »
An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times per month. … a wide variety of technical work. Your primary focus will be working with Databricks - you will be building data pipelines in Databricks, coding in PySpark, and supporting internal applications as they are moving away from a legacy application into new bespoke applications which rely on Databricks. This is a … to provide thought leadership, and to innovate and experiment with new technologies to deliver benefits to the business. Requirements Excellent skills in Databricks and Pyspark Excellent experience with SQL and T-SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data more »
Data Engineer – SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent – London A fast-growing global Insurance broker situated in the City of London is searching for x2 Data Engineers to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they … both structured and unstructured data from the global business. Skills Required Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required. An understanding of medallion architecture and experience working within the framework in a Lakehouse platform. Experience of pipeline deployment within Azure Databricks more »
Lead Data Engineer – SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent – London A fast-growing global Insurance broker situated in the City of London is searching for a Lead Data Engineer to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At … Engineer in a previous business and can manage your own deliverables. Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required. Experience of managing a team of Engineers with varying degrees of experience. Experience of pipeline deployment within Azure Databricks in line with more »
Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect Careers at TCS: It means more TCS is a purpose-led transformation more »
London. Responsibilities: Collaborate with cross-functional teams to gather requirements and implement solutions. Develop and maintain data processing applications using Python. Optimise and tune PySpark jobs for performance and scalability. Ensure data quality, reliability, and integrity throughout the data processing pipelines. Technical Requirements: Python: Proficiency in Python programming. Object … Oriented Design: Solid understanding of object-oriented principles and design patterns. PySpark: Experience with PySpark for data processing and analytics. Azure: Familiarity with Azure services and cloud platforms. Financial Services Background: Knowledge of financial markets, instruments, and related data. more »
Global Asset Manager are looking for an experienced Pyspark Developer with meaningful Palantir Foundry experience gained in an Asset Management environment. Your experience should include; pipeline development in code repository (specifically pipeline development involving incremental data sets), Object Oriented Ontology design best practice, tools using Objects. eg AIP, Workshop more »
