51 to 75 of 76 Remote/Hybrid PySpark Jobs

across multiple time zones, including offshore development teams Skills required: Proven track record building scalable data pipelines (batch and streaming) in production Expert Python, PySpark, Celery and RabbitMQ skills; deep experience with AWS data stack (Glue, OpenSearch, RDS) Expert skills within SQL with experience in both transactional RDBMS systems ...

troubleshooting and incident response for deployed ML systems Required Skills and Experience Strong programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services ...

STEM subject or equivalent experience with strong statistical understanding * Proven experience delivering machine learning models into production environments * Strong Python, SQL and PySpark skills for scalable, production-grade development * Hands-on experience establishing MLOps processes within Databricks * Experience building data pipelines for structured and unstructured data * Strong stakeholder communication ...

Databricks-based data warehousing solution Designing and developing data models, ETL pipelines, and data integration processes Large scale data processing using PySpark Monitoring, tuning, and optimising data platforms for reliability and performance Upskilling the wider team in Databricks best practices, including modern architecture patterns Location: Atherstone (Hybrid – 3 days ...

timely manner. Key Experience, Skills and Knowledge: Proven 2 yrs+ experience as a Data Engineer or similar role, with a strong focus on PySpark, SQL, Microsoft Azure Data platforms and Power BI an advantage Proficiency in development languages suitable for intermediate-level data engineers, such as: Python/PySpark ...

timely manner. Key Experience, Skills and Knowledge: Proven 2 yrs+ experience as a Data Engineer or similar role, with a strong focus on PySpark, SQL, Microsoft Azure Data platforms and Power BI an advantage Proficiency in development languages suitable for intermediate-level data engineers, such as: Python/PySpark ...

World’s Most Ethical Companies for the 14th time. DUTIES (included, but not limited to): Monitor and maintain Microsoft Fabric data pipelines (Dataflows, PySpark Notebooks etc.) Develop and support self-service data transformation functionality using Powerquery (M Code) Work with front-end reporting developers to provide them with cleansed ...

work independently and collaborate within cross-functional teams Some knowledge of programming languages such as Python (preferred) Experience with data processing technologies such as PySpark (preferred) Familiarity with AWS services and cloud-based data workflows (preferred ...

solutions. Hands-on knowledge of Palantir Foundry (Ontology, pipelines, apps, AIP); Palantir certifications desirable. Proficiency in at least one coding language (e.g., Python/PySpark, R, Java, SQL, Typescript) and experience with object-oriented design or software engineering. Strong understanding of data engineering, modelling, platform integration, UX design ...

engineering is done across the organisation. Skills & Experience Strong hands-on experience with Azure data platforms Advanced SQL skills Commercial experience using Databricks and PySpark Proven background building and maintaining scalable data pipelines If you're looking for a role where you can combine technical depth, ownership, and influence ...

Data Engineer (Azure) Salary to £55,000 + Bonus Fully Remote or Hybrid This is an exciting opportunity for an Azure Data Engineer with PySpark, Python, and SQL skills (and ideally experience with Databricks) to take the next step in their career. Youll work on greenfield projects, designing ...

Defining and enforcing engineering standards across code quality, testing, CI/CD, IaC, and observability Building and optimising ELT/ETL pipelines using Glue (PySpark) , Lambda, Step Functions, and event-driven patterns Championing security-by-design in collaboration with security and assurance teams (IAM, KMS, encryption, auditability) Implementing … across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark) and SQL skills Experience implementing CI/CD pipelines and Infrastructure ...

innovative data platform. You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions … Develop automation for cluster management, integration runtimes, and networking Lead architectural design and ensure platform scalability, reliability, and governance Write efficient, maintainable code in PySpark, Python, and SQL Implement CI/CD pipelines and cloud infrastructure via Terraform/ARM Collaborate with data engineers, architects, and business stakeholders Mentor ...

Data Engineer (Azure) Salary to £55,000 + Bonus Fully Remote or Hybrid This is an exciting opportunity for an Azure Data Engineer with PySpark, Python, and SQL skills (and ideally experience with Databricks) to take the next step in their career. Youll work on greenfield projects, designing … designing and building end-to-end data solutions within an enterprise environment on Microsoft Azure based projects. Good data engineering and database skills, including PySpark , SQL and Azure technologies such as Data Factory, Synapse, Databricks . Experience working with large, event-based datasets, with a solid understanding ...

doing Design, build and deploy algorithms/data models supporting pricing, forecasting and optimisation use cases in production Develop and optimise distributed Spark/PySpark batch pipelines for large-scale data processing Write production-grade Python workflows implementing complex, explainable business logic Work with Databricks for job execution, orchestration … delivering production algorithms/data models (forecasting, pricing, optimisation or similar) Strong Python proficiency and modern data stack exposure (SQL, Pandas/NumPy + PySpark; Dask/Polars/DuckDB a bonus) build, schedule and optimiseSpark/PySpark pipelines in Databricks (Jobs/workflows, performance tuning, production delivery ...

Pyspark Engineer- (Data Engineering, AWS GLUE) SC Cleared OR EligibleStevenage (Hybrid) 2-3 days onsiteUp to £80,000High-impact programme - Revolutionary platformI am looking for a Pyspark expert to take the reins on a range of highly ambitious Data Migration projects supporting a range of truly high-impact … organisational and regulatory standards.Relevant exposure; Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL. Proficient-level SQL skills for complex query development, performance tuning, indexing, and data transformation across on-premise databases and AWS cloud environments. ...

Skillset: Strong knowledge of ETL pipelines (eg, Informatica/Azure/AWS) AWS Cloud experience Expertise in data pipelines in the cloud (eg, EMR, PySpark) Data processing experience Proficiency in PySpark/Python/ ...

support high variability Build and extend generative AI-enabled workflows as part of the core product Develop and maintain robust data pipelines using Python, PySpark, and distributed systems Balance near-term delivery with long-term platform maintainability and coherence Contribute to architectural decisions shaping the evolution of the platform … building platforms or products , not just one-off solutions Strong ability to turn ambiguous business problems into clean technical designs Solid foundations in Python, PySpark, and SQL Comfortable operating in a fast-moving startup environment Nice to Have Experience with modern data platforms (e.g. Foundry, Databricks, Snowflake, dbt, Airflow ...

support high variability Build and extend generative AI-enabled workflows as part of the core product Develop and maintain robust data pipelines using Python, PySpark, and distributed systems Balance near-term delivery with long-term platform maintainability and coherence Contribute to architectural decisions shaping the evolution of the platform … building platforms or products, not just one-off solutions Strong ability to turn ambiguous business problems into clean technical designs Solid foundations in Python, PySpark, and SQL Comfortable operating in a fast-moving startup environment Nice to Have Experience with modern data platforms (e.g. Foundry, Databricks, Snowflake, dbt, Airflow ...

Adapt and deploy the platform to customer-specific contexts and priorities Design and implement scalable generative AI-enabled workflows Execute complex data integrations using PySpark and distributed data technologies Collaborate closely with stakeholders to define success metrics and outcomes What We’re Looking For 2–4+ years’ experience … strong desire to work in such environments) Proven ability to translate ambiguous business requirements into clean, maintainable data pipelines Strong fundamentals in Python, PySpark, and SQL Ability to learn new technologies quickly and operate with a high degree of ownership Nice to Have Experience with dashboarding or data visualisation ...

Adapt and deploy the platform to customer-specific contexts and priorities Design and implement scalable generative AI-enabled workflows Execute complex data integrations using PySpark and distributed data technologies Collaborate closely with stakeholders to define success metrics and outcomes What We're Looking For 2–4+ years' experience … strong desire to work in such environments) Proven ability to translate ambiguous business requirements into clean, maintainable data pipelines Strong fundamentals in Python, PySpark, and SQL Ability to learn new technologies quickly and operate with a high degree of ownership Nice to Have Experience with dashboarding or data visualisation ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we're looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...

price scraping outputs, mystery shopping insights) into practical pricing frameworks Work with Python-based pricing models and support their migration into scalable SQL/PySpark environments Translate complex analysis into clear, commercially relevant insight for non-technical stakeholders Act as a trusted interface between Pricing, Finance, Commercial teams, Category … closely with business stakeholders, not purely in a technical silo Comfort operating with imperfect or noisy data in real-world commercial environments Desirable Python, PySpark, or similar analytical/model-driven tools Exposure to B2B pricing, wholesale, distribution, or multi-site trading environments Understanding of ERP-driven pricing processes ...

price scraping outputs, mystery shopping insights) into practical pricing frameworks Work with Python-based pricing models and support their migration into scalable SQL/PySpark environments Translate complex analysis into clear, commercially relevant insight for non-technical stakeholders Act as a trusted interface between Pricing, Finance, Commercial teams, Category … closely with business stakeholders, not purely in a technical silo Comfort operating with imperfect or noisy data in real-world commercial environments Desirable Python, PySpark, or similar analytical/model-driven tools Exposure to B2B pricing, wholesale, distribution, or multi-site trading environments Understanding of ERP-driven pricing processes ...

champion best practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … insurance pricing. Strong technical expertise in predictive modelling techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree ...