5 of 5 Permanent PySpark Jobs in the South West

implement batch and streaming data pipelines using Databricks (Spark), Delta Lake , and orchestrators (e.g., Workflows , Airflow, ADF). Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency. Build and maintain curated data models (bronze/silver/gold), data quality checks … Required qualifications, skills and capabilities Experience with building data pipelines on Databricks and/or Apache Spark in production. Strong coding skills in Python (PySpark) and SQL (Scala a plus). Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema evolution, partitioning, Z-ORDER, OPTIMIZE/VACUUM ...

languages eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field Strong programming skills - Python and SQL are essential; PySpark experience is highly advantageous Experience with version control tools (e.g. GIT) Solid understanding of analytical technologies, tools, and techniques Excellent logical thinking and problem ...

prototypes. Curiosity and a learning mindset - tracking state-of-the-art advancements and evaluating their relevance. Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud-based data tooling). Strong communication skills, capable of explaining complex ideas to technical and non-technical audiences. Collaborative approach to working with … industry collaborations). Familiarity with vector databases, embeddings, and retrieval techniques. Experience Working on large datasets (efficient loading, batching, and streaming) and related tooling (PySpark preferred). What you can expect from us We won't just meet your expectations. We'll defy them. So you'll enjoy ...