26 to 50 of 50 Remote/Hybrid Apache Spark Jobs

from classical statistics and regression to deep learning and NLP. Data Engineering: Proficiency in SQL and experience working with modern data stacks (e.g., Snowflake, Spark, or cloud-native tools on AWS/GCP/Azure). Scientific Rigor: A strong foundation in the scientific methodforming hypotheses, designing experiments ...

Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions Direct contact with customers/end-users on the phone and by email ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Azure Services Understanding of software architecture, design patterns, and agile delivery Experience with geospatial data, REST APIs, JSON and spatial query engines (e.g. Apache Spark) Experience with Generative AI technologies including Large Language Models (LLMs), Retrieval Augmented Generation (RAG) and Prompt/Context Engineering Passion for continuous improvement ...

skills; experience with deep learning frameworks (TensorFlow, PyTorch) Solid understanding of ML algorithms, statistics, and data modelling Experience with large-scale data tools (Hadoop, Spark, Kafka) Cloud & MLOps experience (AWS, Azure, or GCP) NLP experience highly beneficial Strong leadership, communication, and stakeholder management ...

deep learning techniques. Experience deploying ML models to production using cloud platforms (AWS, GCP or Azure). Familiarity with big-data or distributed tools (Spark, Kafka or similar). A track record of leading complex ML projects and influencing technical decisions. Excellent communication skills across distributed, cross-functional teams. ...

experience with PAAS platforms and multi-environment deployments. Strong understanding of performance optimization for data-heavy workloads. Familiarity with Big Data ecosystems (Kafka, Spark, Flink, NATS, ClickHouse, etc.). Experience with observability stacks (Prometheus, Grafana, OpenTelemetry). Strong understanding of TDD, DevSecOps, and integration into CI/CD pipelines. ...

modern development practices (including test-driven development). Extensive experience designing data architecture, data models, integrations, and migrations. Hands-on experience with Apache Spark or similar distributed processing frameworks. Understanding and practical use of CI/CD in data engineering workflows. Ideally with leadership experience managing and developing ...

DevOps, with the freedom to shape how GenAI and ML are used across the platform. Tech stack: Python PyTorch or TensorFlow scikit-learn Spark Kafka Databricks LangChain and RAG-based GenAI systems Cloud-native Azure environment Important Details: Fully remote across ...

will be able to demonstrate skills and experience in many of the following: - Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQL - Deep knowledge of AWS Cloud Platforms (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB) - Experience with data processing across structured and unstructured sources - Strong scripting ...

stores (Feast, AWS Feature Store). Containerisation (Docker) and orchestration (Kubernetes, ECS). Infrastructure as Code (Terraform, CloudFormation). Large-scale data processing frameworks (Spark, Dask). Familiarity with data governance and compliance frameworks. Experience in regulated industries such as healthcare or finance. Benefits: Competitive salary ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

practices like TDD, CI/CD, IaC and Observability. Skills: TypeScript/Node.js Backend APIs AWS or GCP Streaming systems experience (Flink, Kafka, Kinesis, Spark etc.) In return, you’ll be given real ownership in an early-stage start-up environment where you can shape direction and genuinely make ...

practices like TDD, CI/CD, IaC and Observability. Skills: TypeScript/Node.js Backend APIs AWS or GCP Streaming systems experience (Flink, Kafka, Kinesis, Spark etc.) In return, you'll be given real ownership in an early-stage start-up environment where you can shape direction and genuinely make ...

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major ...

MLOps and model serving platforms such as BentoML, MLflow, or SageMaker . Hands-on work with streaming and batch data pipelines using tools like Spark, Airflow, or Apache Beam . Background in front-end or mobile development , enabling end-to-end solution thinking. Prior experience in healthcare, life ...

orchestrate data pipelines across Snowflake and AWS environments. Apply data modeling, warehousing, and architecture principles (Kimball/Inmon). Develop pipeline programming using Python, Spark, and SQL; integrate APIs for seamless workflows. Support Machine Learning and AI initiatives, including NLP, Computer Vision, Time Series, and LLMs. Implement MLOps … data pipeline development and orchestration. Proficient with cloud platforms (Snowflake, AWS fundamentals). Solid understanding of data architecture, warehousing, and modeling. Programming expertise: Python, Spark, SQL, API integration. Knowledge of ML/AI frameworks, MLOps, and advanced analytics concepts. Experience with CI/CD, data testing frameworks, and versioning ...

Head of Data Location: Birmingham (Hybrid - 2 days per week onsite) Salary: Up to £110,000 + benefits Overview I'm supporting one of my clients in the search for a Head of Data to ...

Head of Engineering - Remote - UK - £80,000-£150,000 GenAI, ML, Spark Why Join This Company? This is a leadership role for someone who wants to work in a truly AI-first engineering environment, not a business experimenting at the edges. The company is already well ahead … solving rather than legacy ways of working. You'll Work With Cross-functional teams spanning: Web Engineering (React/TypeScript) Data Engineering (distributed systems, Spark-based platforms) Data Science & Machine Learning A highly technical CTO who is deeply invested in AI adoption and modern engineering Product leadership following significant ...

Senior DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience ...

DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands ...