1 to 25 of 41 Remote PySpark Jobs in England

Azure data technologies. Expertise in Azure Data Factory, Azure Databricks, Apache Spark. Deep understanding of Kimball dimensional modelling and data warehousing. Proficiency in Python, PySpark, and SQL. Hands-on experience with Azure Fabric, ADLS2, and Power BI (for data visualisation). Strong understanding of SDLC, DevOps, and cloud security More ❯

or Equivalent related professional experience is applicable. 5+ years experience in a similar analytical role. Strong SQL skills; demonstrated experience of using R/PySpark to structure, transform and visualize big data, and a willingness to learn new frameworks and languages required for the task. Display a true passion More ❯

consulting solutions. Tech Savvy: Expertise in one or more of the following platforms and languages: Google Cloud Platform, AWS, Microsoft Azure, Databricks, Python, R, Pyspark, Scala, PowerBI, Tableau. Key responsibilities Support the delivery of AI, Data Science and Analytics projects and working closely with your colleagues, ensure Client expectations More ❯

Science, Data Science, Mathematics, or related field. 5+ years of experience in ML modeling, ranking, or recommendation systems . Proficiency in Python, SQL, Spark, PySpark, TensorFlow . Strong knowledge of LLM algorithms and training techniques . Experience deploying models in production environments. Nice to Have: Experience in GenAI/ More ❯

Science, Data Science, Mathematics, or related field. 5+ years of experience in ML modeling, recommendations, or ranking systems. Strong proficiency in Python, SQL, Spark, PySpark, TensorFlow . Experience with GenAI/LLMs and distributed computing tools (Hadoop, Hive, Spark). Ability to work independently and in a fast-paced More ❯

in a Data Engineering position.//Self-starter, who has experience with building data pipelines in the cloud.//Excellent knowledge of PySpark, Python and SQL fundamentals.//Familiar with Airflow, Databricks & BigQuery.//Exposure with Palantir Foundry would be a huge plus but not More ❯

e.g. Data Science, Mathematics, Statistics, Physics, Computer Science, Informatics or Engineering You have strong experience with analytics and data manipulation software e.g. R, Python, PySpark, SAS, SQL, SPSS You take a consultative approach and have polished communication and stakeholder management skills You're able to work independently and take More ❯

craft as an engineer. Work closely with product owners to shape and deliver features to customers. About you: Expertise and experience of Apache Spark, PySpark, Python based pipeline jobs. Solid Data Lake/Data Warehouse principles, techniques and technologies - Star Schema, SQL (AWS EMR, Apache Iceberg, parquet). Strong More ❯

Job summary We are seeking a skilled and motivated individual to join our Business Intelligence Team at Imperial College Healthcare. In this role, you will be responsible for developing information systems to support the Medical Director's Office, with a More ❯

of Microsoft Fabric, OneLake, Azure Data Factory, and Delta Lake. Nice to have: Hands-on experience with data testing automation. Expertise in SQL, Python, PySpark, and cloud-based test automation. Solid understanding of data governance, regulatory reporting, and risk controls. Experience working in Agile and DevOps environments. Ability to More ❯

seeking a Senior Data Engineer to join the team working on Azure stack with a mixture of technologies including Azure Databricks, ADF, Azure DevOps, PySpark, SQL and more. Essential skills for the Senior Data Engineer: Well versed with Azure Data Engineering stack Experience with SQL and Python/PySpark More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect More ❯

deep understanding of data processing and interpretation . Desirable skills include: Experience developing simulation models for real-world applications . Proficiency in Python, Pandas, PySpark , or similar. Experience working with big data, databases (PostgreSQL), or datalakes (Databricks) . A solid understanding of statistical methods . Confidence working both independently More ❯

knowledge of Python and SQL. Familiarity with pipeline orchestration tools (e.g., Airflow, Dagster). Advanced expertise in writing scalable, distributed Python applications (e.g., Ray, PySpark, Dask). A proven track record in shaping and architecting scalable data solutions. Experience building and optimizing big data pipelines, architectures, and datasets. Ability More ❯

AI Platforms: Google Cloud Platform, Amazon Web Services, Microsoft Azure, Databricks. Experience in one or more of the listed Languages or Packages: Python, R, Pyspark, Scala, PowerBI, Tableau. WHAT YOU'LL LOVE ABOUT WORKING HERE? Data Science Consulting brings an inventive quantitative approach to our clients' biggest business and More ❯

years of experience working with cloud platforms. Strong background in data engineering and building cloud-based data solutions. Proficiency in SQL, Python/PySpark for writing and optimising complex queries. Experience with ETL/ELT processes and data querying in cloud platforms. Expertise in cloud data warehouses and related More ❯

Are you passionate about revolutionising engineering with AI? Here at Monolith AI we're on a mission to empower engineers to use AI to solve even their most intractable physics problems. We've doubled in size over the last four More ❯

seeking a Senior Data Engineer to join the team working on Azure stack with a mixture of technologies including Azure Databricks, ADF, Azure DevOps, PySpark, SQL and more. Essential skills for the Senior Data Engineer: Well versed with Azure Data Engineering stack Experience with SQL and Python/PySpark More ❯

and analytical problem-solving abilities. A strong understanding of how to manipulate and interpret data. Familiarity with Python or similar programming languages (e.g., Pandas, PySpark). Knowledge of databases or data lakes (e.g., PostgreSQL, Databricks). Experience developing quantitative simulations of ‘real-world’ physical objects and scenarios. Experience with … Python or other equivalent scripting languages (Pandas, PySpark or similar). Experience processing big data and working with databases (PostgreSQL or similar) or datalakes (Databricks or similar). Interest in sustainability, the environment, decarbonisation and net zero. Ability to present complex technical findings in a clear and engaging way. More ❯

and/or algorithms Our technology stack: Python and associated ML/DS libraries (Scikit-learn, Numpy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc. MLOps: Terraform, Docker, Airflow, MLFlow More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous More ❯

Delta Lake, and Lakehouse architecture for efficient data management; experience with ETL processes and optimizing data pipelines for performance Strong in Pandas, SQL, and PySpark Strong understanding of cloud networking principles, including Azure Virtual Networks, Private Endpoints, and secure connectivity strategies Experience or knowledge with GDPR compliant architecture Experience More ❯

Senior PySpark Developer Location: Canary Wharf, London 3 days onsite Contract to Perm (inside IR35 via umbrella) Are you a skilled PySpark Developer looking to make an impact in the fast-paced world of investment banking? We are seeking a talented individual to join our dynamic team based … exciting opportunity to enhance your career and contribute to innovative projects in a collaborative environment. Key Responsibilities: Develop and maintain scalable data pipelines using PySpark to support our data processing needs. Collaborate with cross-functional teams to gather requirements and design efficient ETL processes. Optimise existing data workflows and … translate them into technical solutions. Document processes, best practises, and maintain clear communication with team members. Required Skills and Qualifications: Proven experience as a PySpark Developer or in a similar role, within the investment banking sector. Strong proficiency in PySpark and experience with data manipulation and analysis. Familiarity More ❯

training, inference, monitoring, and iteration. Strong understanding of ML/DL/LLM algorithms, model architectures, and training methodologies. Proficient in Python, SQL, Spark, PySpark, TensorFlow, or other analytical/model-building programming languages. Familiarity with tools and Large Language Models (LLMs). Ability to work both independently and More ❯

security across Databricks environments What We're Looking For: Proven experience in data architecture, analytics, and engineering Expertise in Databricks, Delta Lake, Spark, and PySpark Strong programming skills in Python, Scala, or SQL Hands-on experience with Azure, AWS, or GCP Knowledge of data governance and security best practices More ❯