76 to 100 of 410 Remote PySpark Jobs

Trusted Research Environments (TREs). We’re looking for candidates with strong experience in Python and cloud-native data processing and storage technologies, especially PySpark/Databricks, K8s, Postgres, Dagster, and Azure. If you have solid experience in similar technologies and are looking to widen your knowledge and experience More ❯

to engage both technical and non-technical stakeholders Desirable Criteria Experience with Matillion products and competitive ETL solutions Knowledge of big data technologies (Spark, PySpark), data lakes, and MPP databases (Teradata, Vertica, Netezza) Familiarity with version control tools such as Git, and experience with Python Degree in Computer Science More ❯

company Data & AI focus Hands-on experience with GCP services such as BigQuery, Dataproc, Dataform, Composer, and Pub/Sub Strong programming skills in PySpark, Python, and SQL Solid understanding of ETL/ELT processes and data quality at scale Excellent communication and documentation skills Desirable Experience: Exposure to More ❯

company Data & AI focus Hands-on experience with GCP services such as BigQuery, Dataproc, Dataform, Composer, and Pub/Sub Strong programming skills in PySpark, Python, and SQL Solid understanding of ETL/ELT processes and data quality at scale Excellent communication and documentation skills Desirable Experience: Exposure to More ❯

and data lake patterns , including ingestion, governance, and quality. Strong technical skills in BigQuery, DataProc, Dataform, Composer, Pub/Sub . Fluent in Python, PySpark, and SQL . Experience with BI tools like Looker or Power BI. Strong client-facing and communication skills — able to lead conversations with both More ❯

and data lake patterns , including ingestion, governance, and quality. Strong technical skills in BigQuery, DataProc, Dataform, Composer, Pub/Sub . Fluent in Python, PySpark, and SQL . Experience with BI tools like Looker or Power BI. Strong client-facing and communication skills — able to lead conversations with both More ❯

AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure Terraform Databricks Data Lake, Warehouse, Lakehouse architecture and design Python/Pyspark Data platforms and notebooks: Jupyter, Databricks, Azure Gitlab: repository and CI/CD Java (Spring Boot) experience is a plus Benefits: Join a rapidly More ❯

Bristol, England, United Kingdom 1 month ago London, England, United Kingdom 4 weeks ago Manchester, England, United Kingdom 1 month ago Data Engineer , Python, PySpark, and SQL, AWS London, England, United Kingdom 3 months ago City Of London, England, United Kingdom 3 weeks ago London, England, United Kingdom More ❯

and managing data sets from multiple sources. 4+ years hands-on experience in key data management technologies, including Python but not limited to SQL, PySpark, Scoop, etc. Experience working on use cases for different file formats and database management systems including NOSQL databases Conceptual understanding of data management including More ❯

high-quality documentation and delivery Your Profile 3-6 years of experience in data engineering, ideally in cloud or SaaS environments Skilled in Scala, PySpark, SQL, Databricks, Azure Synapse (or similar) Strong knowledge of ETL processes and big data handling Hands-on experience with CI/CD, version control More ❯

understanding of DevOps and CI/CD - Understanding of compliance and lifecycle of data management Desirable Skills - Coding experience in any relevant language (Python, Pyspark etc.) - Experience working with Azure Synapse, Databricks, and/or similar technology - Experience automating test cases - Experience working with non-relational databases (Cassandra, MongoDB More ❯

Ideal background: 3+ years in a Data Engineering position. Self-starter, who has experience with building data pipelines in the cloud. Excellent knowledge of PySpark, Python and SQL fundamentals. Familiar with Airflow, Databricks & BigQuery. Exposure with Palantir Foundry would be a huge plus but not essential. Ability to work More ❯

valuable insights Desirable Experience working with enterprise data warehouse or data lake platforms Experience working with a cloud platform such as AWS Have used PySpark for data manipulation Previous exposure to game or IoT telemetry events and how such data is generated Knowledge of best practices involving data governance More ❯

experience working with Azure Git/DevOps Repos experience Demonstration of problem solving ability Synapse Analytics or similar experience - desirable Visual Files experience - desirable PySpark/Python experience - desirable Powershell experience - desirable What we offer: We aim to reward your hard work generously. You'll be greeted in our More ❯

experience working with Azure Git/DevOps Repos experience Demonstration of problem solving ability Synapse Analytics or similar experience - desirable Visual Files experience – desirable PySpark/Python experience – desirable Powershell experience – desirable What we offer: We aim to reward your hard work generously. You’ll be greeted in our More ❯

experience working with Azure Git/DevOps Repos experience Demonstration of problem solving ability Synapse Analytics or similar experience - desirable Visual Files experience – desirable PySpark/Python experience – desirable Powershell experience – desirable What we offer: We aim to reward your hard work generously. You’ll be greeted in our More ❯

valuable insights. Desirable Experience working with enterprise data warehouse or data lake platforms. Experience working with a cloud platform such as AWS. Have used PySpark for data manipulation. Previous exposure to game or IoT telemetry events and how such data is generated. Knowledge of best practices involving data governance More ❯

possible standard and within industry standards. What you will be doing: Develop the data platform on Azure, using advanced T-SQL, Azure pipelines, and PySpark within Azure Synapse to produce the robust, reliable ETL/ELT processes that provide data for NHSR’s reporting, analytical, and data science functions. More ❯

cloud-based architectures on AWS, Azure, or GCP A strong background in Databricks for building enterprise data warehouses with strong knowledge of SQL and Pyspark A deep understanding of data modelling and advanced pipeline development Knowledge and understanding of best practice CI/CD approaches utilising Git. Strategic Vision More ❯

cloud-based architectures on AWS, Azure, or GCP A strong background in Databricks for building enterprise data warehouses with strong knowledge of SQL and Pyspark A deep understanding of data modelling and advanced pipeline development Knowledge and understanding of best practice CI/CD approaches utilising Git. Strategic Vision More ❯

in backend development. A strong foundation in data engineering , including designing practical data schemas and working with large-scale distributed systems. Proficiency in Python, PySpark, SQL, C#, .NET, and Typescript -and a willingness to quickly learn new technologies. Experience with Agile processes , source control (Git) , and delivering web-based More ❯

in backend development. A strong foundation in data engineering , including designing practical data schemas and working with large-scale distributed systems. Proficiency in Python, PySpark, SQL, C#, .NET, and Typescript —and a willingness to quickly learn new technologies. Experience with Agile processes , source control (Git) , and delivering web-based More ❯

of MLOps and associated tools such as Azure DevOps/Github, MLFlow, Azure ML. Experience working with large datasets/big data architectures, particularly Pyspark/Databricks. Experience deploying container technologies (e.g. Docker, Kubernetes). Experience playing a lead role on technical AI projects. Excellent communication skills with both More ❯

the technical development of greenfield solutions to MVP demonstrations Technical Skills: Python Required: Proficient in pandas, numpy and sklearn. Desired: Professional experience with Databricks, PySpark, Cloud deployment, CI/CD and Git. Required: Proficient in creating E2E pipelines to train ML models including EDA, Feature Engineering, Model Selection, Parameter More ❯

AI fields. Proven track record of designing, developing, and deploying AI systems in production environments. Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. More ❯