1 to 25 of 59 Permanent PySpark Jobs in London

complex data workflows Excellent communication and collaboration skills in agile, cross-functional teams Ability to mentor junior engineers Nice to have: Experience with Databricks, PySpark, and Delta Lake Условия Competitive salary based on location, experience, and skills Comprehensive benefits package for employees and their families Continuous learning, structured development ...

platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Understanding of workflow orchestration and automation tools. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models ...

Complexity.* Strive for excellence and continuous improvement in software architecture, software delivery and best practices.* Hands on experience in C#, OOP python, Spark/PySpark and other C#, Python framework ecosystem.* Debug and resolve issues in large datasets quickly.* Co-ordinating handoffs between different time zones and allocating priorities ...

customers’ pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark, Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

customers' pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark , Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

good understanding of Azure PaaS management and resource monitoring CI/CD experience and DevOps Working knowledge of SQL and experience in Python/PySpark Microsoft Power Platform Ability to collect, organize, and analyze data from multiple sources to solve business challenges. Knowledge in testing and validating Analytical solutions ...

principles. Strong understanding of data modelling, governance and data quality frameworks. Experience delivering large-scale data transformation initiatives. Knowledge of technologies such as SQL, PySpark, Snowflake, Kafka and modern BI platforms including Power BI or Tableau. Excellent communication skills with the ability to influence senior technical and business stakeholders. ...

architectural direction, mentoring engineers, and defining standards in a data engineering context. Strong proficiency in Python, with experience applying data engineering frameworks (e.g. Spark, PySpark, Dask, pandas) to large, complex datasets. Familiarity with API‐driven data integration, including REST, GraphQL, and Foundry Action APIs. Experience with Git‐based development ...

also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them. Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role. Key Skills Azure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub ...

years consulting (or equivalent) experience required 7+ years Databricks solution design, implementation, engineering experience required Either 5+ years building data pipelines in Databricks using PySpark, Scala and/or Spark SQL and ability to work across structured, semi-structured and unstructured data OR 5+ years ML Engineering ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don’t meet every requirement below, feel free to still apply ...

Experience with AWS or another major cloud platform Docker and containerised application experience Infrastructure as code experience, ideally Terraform or CloudFormation Experience with SQL, PySpark, Databricks or AWS Glue Exposure to Scikit‐learn, PyTorch, LightGBM or similar libraries An understanding of LLMs, multimodal models or generative AI applications Deep ...

tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated ...

cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...

cloud‐native experience Preferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...

MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management. Strong Python experience, with helpful knowledge of Spark or PySpark for working with large‐scale data and machine learning systems. An understanding of feature stores and related data technologies used to support operational machine ...

also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them. Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role. Key Skills: Azure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub ...

experience with Azure AI Search or other vector/hybrid search solutions, including vector search, hybrid search, and retrieval evaluation. Experience with Databricks and PySpark for large‐scale data processing. Experience designing evaluation frameworks for LLM systems, including offline metrics, hallucination detection, and production monitoring. Experience implementing responsible ...

cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

science team. What we're looking for Proven experience delivering end-to-end data science solutions in a commercial environment. Strong Python, SQL and PySpark skills. Experience working with structured and unstructured data, applying NLP and GenAI techniques. Experience deploying models into the cloud (Azure preferred) with CI/ ...

communicate future challenges, ensuring operational effectiveness. Skills and Experience Essential Full‐stack Python Software Developer skills, specialising in numerical processing using Pandas, Numpy, Polars, PySpark, Coroutines, async tasks and Unix. Building scalable applications, with intensive risk‐based processing. Package software for distribution (e.g. Docker, Poetry, python‐wheels, PyInstaller, Databricks ...

Data Manager/Lead Location : London (Hybrid) Comp : £115,000 P/A (FTC) Duration: 12 Months Skills: Python (Programming Language), SQL, Apache Spark, PySpark, Azure Databricks, Data Lakes, Data Warehouse Architecture, Leadership, Software Development, Management The role We're partnering with a large, data-driven organisation seeking ...

excellence. Champion AI and data architecture as strategic enablers of business transformation—linking technology decisions directly to measurable client outcomes. Technologies & Concepts Programming & APIs: PySpark , Python, FastAPI , FastMCP , SQL, OAuth2 AI Architectures: Retrieval-Augmented Generation, In-Context Learning, Agent Design, Function Calling, LLM Fine-Tuning & Adaptation Strategies Data Analytics ...

machine learning operations. Excellent communication skills with the ability to influence cross-functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred. Well-versed in design thinking principles. Great problem-solving and analytical skills. The total cash range for this position ...