151 to 175 of 222 PySpark Jobs

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...

London, United Kingdom | Posted on 23/07/2026 Contract Role: Senior AI/ML Research Engineer Contract Location: London Contract Duration: 6 months initially (with potential extension) Contract Start Date: Immediate Contract Classification ...

London-based programme focused on data platforms, analytics engineering and Lakehouse solutions. You will design, build and support enterprise-scale data platforms with Spark, PySpark, SparkSQL and Microsoft Fabric. The role requires hands-on coding, data governance, ingestion and API integration capabilities, plus a passion for modern analytics ...

qualifications include proficiency in site reliability culture, incident management, and tools like AWS and Databricks. Candidates should also demonstrate strong skills in Python or PySpark, as well as AI-assisted software development. #J-18808-Ljbffr ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices. Proficiency in Python or PySpark for AI/ML modeling. Must be able to reduce toil by building new tools to automate repeated tasks. Hands‐on experience in system ...

data.Knowledge of Bayesian methods for causal analysis and decision-making.Experience in gaming, e-commerce, or subscription-based products.Experience working with large-scale data using PySpark or equivalent distributed data processing tools.Familiarity with production environments, MLOps, or data pipelines.Benefits: Discretionary bonus opportunityPrivate Medical InsuranceDental Scheme25 days holiday per yearOn Site ...

analytics capabilities. We welcome candidates from all backgrounds to apply, and we are committed to creating a diverse workforce.Key Responsibilities and Skills: - Proficiency in PySpark for effective data manipulation and transformation. - Experience with Microsoft B.I and DataBricks for advanced analytics solutions. - Strong problem-solving abilities to address complex challenges. ...

global organization through resourcing/location strategy. Experience and Qualifications Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript, Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high‐performing teams ...

location strategy.“I am the person Capital Group is looking for.” Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high-performing ...

structured and unstructured datasets Validate large-scale data ingestion, transformation, and processing workflows Ensure data integrity, transformation accuracy, reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis … DynamoDB, AWS CloudWatch, AWS IAM, Python, SQL, Java, Bash, GitLab CI/CD, Jupyter Notebooks, Apache Spark/PySpark, Terraform, Docker Key Skills Strong proficiency in Python, SQL, Java, and Scripting languages such as Bash Hands-on experience testing Big Data platforms and Data Lake solutions Strong experience with ...

play a key role in advancing our data capabilities and driving innovation. Job Responsibilities: Develop workflows and ELT data pipelines using Python, Spark/PySpark, and Databricks Onboard enterprise datasets into Palmos, including ingestion, transformation, and validation of data assets Build, test, and maintain scalable data pipelines and data … coding standards; contribute learnings and reusable patterns to improve broader team effectiveness Required Qualifications, Capabilities, and Skills: Hands-on experience with Databricks, Spark/PySpark, Python, and SQL Experience developing and maintaining data pipelines and data processing systems Understanding of the data lifecycle, including ingestion, transformation, storage, and consumption ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy … systems with cloud-native platforms to support analytics, reporting, and domain-owned data products.Primary Skills• Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures.• Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka.• Experience integrating legacy data sources such as DB2 (mainframe ...

accurate documentation, lineage and operational run books to support ongoing platform support Key Responsibilities Develop and maintain data pipelines using Azure Databricks (Python, PySpark and SQL) Implement ingestion and transformation across Bronze, Silver and Gold layers using Delta Lake Support and operate Azure Databricks and Azure Synapse platforms, including … pipelines and code reviews What you'll need to succeed Essential Proven experience as a Data Engineer Strong hands-on experience with AzureDatabricks, Python, PySpark and SQL Experience supporting Azure data platforms in production Understanding of medallion architecture and Delta Lake Desirable Experience with Azure Synapse Analytics Experience with ...

Data Engineer £54-59,000 + bonus Hybrid Working – 1 day on-site per week West Midlands based I'm recruiting for a Data Engineer to join an established data team, working on the development ...

JPMorgan Chase & Co. in the Corporate Sector’s agile data engineering team is seeking a Lead Software Engineer to promote the development of a trusted Global KYC and Risk Assessment Data Platform. You will lead ...

some of the following predictive modelling techniques preferred; GAMs, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Proficient in using WTWs Radar software Proficient at communicating results ...

this skill further when working with non-technical audiences.Experience using at least one data-focused programming or analytical language, such as Python, R, SQL, PySpark or similar.What's in it for youBeing a part of M&S is exactly that – playing your part to bring the magic ...

experience building production services, data pipelines, APIs, workflow systems, or developer tools.Experience with at least one distributed data or compute system such as Spark, PySpark, Flink, Kafka, Ray, Airflow, Kubernetes, BigQuery, or similar technologies.Familiarity with ML data workflows such as feature generation, training dataset creation, batch processing, real-time ...

business questions and deliver custom data products seamlesslyThis is the perfect job for someone who has:At least 2 years experience with SQL/pySpark for data analysis - MustExperience in Python scripting - MustExcellent verbal and communication skills in English - MustAWS Infrastructure experience - Big AdvantageWorking with clients - Big Advantage.Proficiency ...

passion for realtime data, The Data Scientist must have: • Experience in building complex data pipelines/ETL/ELT scripts • Python/PySpark as our Data pipelines will be built in PySpark • SQL • Knowledge of AWS and components such as S3, Glue, Athena, RDS • Experience with Data Warehouse ...

robust and standardised data platform experience.What you’ll be doingDesigning, building, and maintaining scalable data pipelines using Python and Scala, leveraging Spark and PySpark within an Azure ecosystem (including Azure Data Factory and Databricks).Developing and maintaining reusable data engineering templates, frameworks, and tooling to support data teams across … succeed.QualificationsStrong experience as a Data Engineer building scalable data platformsDeep expertise in Azure (ADF, ADLS, Databricks)Proficiency in Python and/or Scala(PySpark/Spark) for large-scale data processingHands-on experience with Databricks and Delta LakeSolid understanding of the end-to-end data lifecycle (ingestion transformation serving ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire | Hybrid (2 Days Office) | Python | SQL | PySpark | Azure | Databricks | Machine Learning | Statistics | Time Series Forecasting | Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist … Data Scientist, Machine Learning, Artificial Intelligence, Predictive Analytics, Statistical Modelling, Python, SQL, PySpark, Azure, Databricks, MLflow, GitHub Actions, CI/CD, Time Series Forecasting, Propensity Modelling, Feature Engineering, Data Engineering, Azure Machine Learning, Azure Data Platform, Experiment Design, A/B Testing, Hypothesis Testing, Predictive Modelling, Customer Analytics, Marketing ...

knowledge, with the ability to write stable, scalable and maintainable code. Experience with data science Python libraries such as Sckit-learn, Pandas, NumPy, PyTorch, PySpark, LightGBM. Have worked with a cloud service, such as AWS. Familiarity developing Infrastructure as code (e.g Terraform, cloudformation). Have some experience with data … engineering, building data pipelines with PySpark, SQL (E.g in Databricks, Glue) to power machine learning applications. Comfortable working with Docker and containerised applications. Experience leveraging AI native engineering tooling. Passion for building products that meet customer needs and business objectives. Strong sense of responsibility and a track record ...