126 to 150 of 195 PySpark Jobs in London

Bonus points for You've validated or independently challenged models before, ideally from a second-line risk function. You have hands-on experience with PySpark for distributed data processing. You've worked with cloud platforms such as AWS. Things you should know before applying This position is open ...

What We’re Looking For Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field. Strong programming skills — Python and SQL are essential; PySpark experience is highly advantageous. Experience with version control tools (e.g. GIT). Solid understanding of analytical technologies, tools, and techniques. Excellent logical thinking ...

data. What Were Looking For Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field. Strong programming skills Python and SQL are essential; PySpark experience is highly advantageous. Experience with version control tools (e.g. GIT). Solid understanding of analytical technologies, tools, and techniques. Excellent logical thinking ...

technical content in commercial terms for non-technical stakeholders, such as customers, sales and product teams Desirable B2B product experience Experience with Spark SQL, PySpark, databricks Experience with CausalAI modelling frameworks (e.g. dowhy, econml) Diversity & Inclusion Intent HQ is an equal opportunities employer with an ethos of commitment ...

clientsFull SDLC process experienceExcellent communications skills, both written and verbalBonus Points: Experience with the Go Lang eco-system tools and librariesExperience with Pandas and PySpark libraries would be a plusTechnical experience with Databricks or any similar Delta Lake platforms. Experience working with large datasetsExperience with AWS cloud deployments ...

experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands‐on experience with Databricks, PySpark, Python and SQL? The role 7Dxperts is looking for a Senior Data Engineer to join our UK team. Key Responsibilities Build scalable pipelines using Databricks, Spark … processes and create reusable engineering solutions. Support and mentor junior Data Engineers. Requirements/Qualifications 5+ years’ Data Engineering experience. Strong hands‐on Databricks, PySpark, Python and SQL skills. Experience building and optimising ETL/ELT data pipelines. Knowledge of Delta Lake and data warehousing. Experience with at least ...

with 8+ years of experience, focusing on scalable data pipelines, governance, and analytics platforms. The role requires deep AWS data services expertise, Python/PySpark coding, and collaboration with globally distributed teams to deliver impact for Fortune 1000 clients. #J-18808-Ljbffr ...

applications. You will collaborate with data architects, product teams, and business stakeholders to deliver production-grade data products. Strong Foundry experience and Python/PySpark skills are essential. #J-18808-Ljbffr ...

with strong identity and networking controls and work with cross-functional teams to address complex requirements. You will demonstrate live coding in Python and PySpark, contribute to platform adoption, and influence product direction. #J-18808-Ljbffr ...

collaborate with cross‐functional teams to deliver customer outcomes. Candidates typically have 4+ years in solutions architecture or related roles, strong Python and PySpark skills, and willingness to #J-18808-Ljbffr ...

London seeks a Senior Data Engineer to design, build, and operate enterprise-scale data solutions. You will leverage Snowflake with hands-on Python, PySpark, AWS and Airflow to create scalable data platforms and robust analytics capabilities. The role emphasizes technical leadership, governance, and collaboration with cross-functional teams ...

through full lifecycle from design to production deployment, architecting secure, scalable solutions with a focus on IAM, networking, and platform administration. Strong Python/PySpark skills and a track record in data architectures are essential. #J-18808-Ljbffr ...

Dataiku platform every day. Aside from the visual tools, our team mostly uses Python and SQL, with occasional work in other languages (e.g., R, PySpark, JavaScript). An ideal candidate is excited to learn complex new technologies and modelling techniques and to explain their work to other data scientists ...

performing engineering squad and own technical challenges from design through production, driving best practices and engineering standards. You'll work with Azure, Databricks and PySpark to deliver scalable ETL pipelines and data platforms that power critical business decisions. #J-18808-Ljbffr ...

work. The contract is initially 6 months with remote working. You will own ingestion, model deployment, evaluation, and CI/CD across environments, leveraging PySpark, Unity Catalog, and batch inference on Claude. #J-18808-Ljbffr ...

IR35 . Rate: £650 - £750 Location: Hybrid – 2/3 days per week on-site Contract: 6 months | Outside IR35 Key Skills: Data Lakehouse PySpark DBT Iceberg AWS Strong data engineering and pipeline development experience You’ll be responsible for designing, building and optimising scalable data pipelines and lakehouse ...

/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards, and control evidence packs. Technical … Skills Strong proficiency in Python (data analysis/automation for metadata extraction, validation scripts, rule checks). Hands‐on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...

/PnL/Trade lifecycle/Reconciliation• Understanding of financial products such as: Derivatives (swaps, futures, options), bonds**Good-to-Have**• Exposure to **PySpark or large-scale data processing**• Experience working with **quants or pricing models**• Basic scripting (Unix/Bash) #J-18808-Ljbffr ...

engineering, product and commercial teams. You Need Expert Python and SQL, with experience building production ML systems and data pipelines (PyTorch, XGBoost, Spark/PySpark, Apache Iceberg, Ray, MLflow, SageMaker, Airflow, or equivalent). Deep experimentation and statistical inference skills, and a strong grasp of optimisation under uncertainty (bandits ...

analytics teams while applying modern data engineering patterns and strong software fundamentals. This role emphasizes ownership, observability, security, and scalable pipelines using Python, PySpark, #J-18808-Ljbffr ...

pipelines and multimodal models. You will collaborate with Applied Scientists, Data Engineers, PMs and business stakeholders to productionise solutions. Role requires strong Python, PySpark/Databricks experience, hands-on DL with PyTorch or TensorFlow, and a pragmatic, business-focused #J-18808-Ljbffr ...

high-performing engineering squad, owning technical challenges and driving best practices across the team. You’ll build scalable pipelines using Azure, Databricks and PySpark, collaborating with Product and Delivery to deliver reliable data platforms and business value. London-based with hybrid working conditions. #J-18808-Ljbffr ...