1 to 25 of 38 Remote Apache Spark Jobs

code and sharing knowledge across the team Supporting production systems when needed The platform uses a mix of modern data tooling including AWS and Apache Spark, so there's plenty of opportunity to work with big data technologies. What they're hoping you'll bring … complex data problems An interest in improving pipelines, tooling and processes A collaborative approach and willingness to share ideas Exposure to tools like Apache Spark, modern data platforms, or AI tools for development productivity would be a bonus but isn't essential. The setup The team works ...

team members, building technical expertise and capability Key Responsibilities Develop production-ready data pipelines and processing jobs using batch and streaming frameworks such as Apache Spark and Apache Beam Apply expertise in data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern ...

team members, building technical expertise and capability Key Responsibilities Develop production-ready data pipelines and processing jobs using batch and streaming frameworks such as Apache Spark and Apache Beam Apply expertise in data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern ...

team members, building technical expertise and capability Key Responsibilities Develop production-ready data pipelines and processing jobs using batch and streaming frameworks such as Apache Spark and Apache Beam Apply expertise in data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern ...

team members, building technical expertise and capability Key Responsibilities Develop production-ready data pipelines and processing jobs using batch and streaming frameworks such as Apache Spark and Apache Beam Apply expertise in data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern ...

downstream data services across the organisation. Key Responsibilities Design, build, and maintain data pipelines using Databricks Develop ETL/ELT processes with PySpark and Spark SQL Transform and model structured and semi-structured datasets Improve performance, reliability, and cost efficiency of data workloads Ensure compliance with data governance, security … practice routes Required Skills & Experience Active SC Clearance - mandatory and non-negotiable Strong hands-on experience with Databricks in production environments Expert knowledge of Apache Spark , including PySpark and Spark SQL Proficiency with Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure ...

logic into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across Cloud (Azure, AWS, GCP) and Big Data (Spark, Kafka) stacks. Collaboration: Work closely with business teams to define data flows and ensure security protocols (encryption/authentication) are met. Technical Toolkit Languages ...

Production Hands-On Experience with Deep Learning Frameworks (TensorFlow, PyTorch, XGBoost) Deep Knowledge of Data Warehousing, ETL/ELT Architectures & Heavy Analytic Environments (Apache Beam, Hadoop, Spark, Hive) Responsibilities: Leading Customer-Facing AI Deployments across Europe, from the Initial Consulting Phase right through to the Live Implementation … Production ML Systems Architecting & Optimising Scalable Data Pipelines, ETL/ELT Solutions & Distributed ML Environments (using Hadoop, Spark & Apache Beam). Deploying Recommendation Engines & Deep Learning Models (TensorFlow, PyTorch) to solve specific Client Problems. Running Technical Design Sessions, Tailoring ML Ops Architectures using Vertex AI & Gen AI. Writing ...

Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake ...

within scalable cloud -based architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/ ...

within scalable cloud -based architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/ ...

deliver high-quality, consumable datasets while contributing to best practices across the wider platform. You'll be working heavily with Python , SQL and Spark , using tools such as Databricks , Airflow , dbt and Kafka within AWS . Experience with modern data stacks is important, along with a solid understanding ...

quality and reliable deliverables. Optionally contribute to on-call platform support where required. What We’re Looking For Technical Expertise Strong experience with Databricks, Apache Spark, and cloud-based data architectures (preferably Azure). Excellent programming capability in Python and SQL. Experience orchestrating pipelines with Azure Data Factory ...

seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

deploying machine learning models into production environments (MLOps experience is advantageous). Hands-on experience with big-data or distributed computing tools such as Spark and Databricks. Familiarity with visualisation tools such as Power BI, Tableau, or Plotly. Key Competencies Strong analytical and conceptual thinking. Excellent communication and data ...

teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office ...

gambling/player risk analytics Fraud, AML, or transaction monitoring models ☁️ Cloud platforms (AWS, GCP, Azure) Experimentation & optimisation frameworks ⚙️ Typical Tech Stack Python • SQL • Spark • AWS/GCP • Airflow • Tableau/Power BI • Git 🚀 Why Join Work with large-scale behavioural datasets unique to iGaming Direct commercial impact ...

orchestration, including Spring Boot, GoLang, Python, Kubernetes, Docker, and Podman; security and compliance with OAuth2, JWT, SAML, and HIPAA; data engineering with Kafka, Spark, and ETL pipelines; DevOps, including CI/CD, GitHub actions, ArgoCD, Jenkins, and Terraform; API development, including REST, GraphQL, and SOAP; monitoring tools, including Dynatrace ...

Define and enforce data architecture across mesh and domain-driven data products. Implement and govern real-time/batch processing (Kafka, Spark, Glue). Ensure strong metadata, cataloguing, and lineage practices across the enterprise. Lead teams of engineers across global hubs, mentoring and supporting high standards. Knowledge on data ...

didn't hate it. A background in behavioural science, organisational psychology, or psychometrics — the company works heavily with survey data and measurement validation. Spark, Databricks, or distributed computing experience. Published research or an academic background in statistics, ML, or a quantitative field. What's on Offer Salary ...

influence within the team and communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous). Experience contributing … Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience with streaming solutions (Kafka, Event Hubs, Spark Streaming) (desirable). Knowledge of machine learning and AI on Databricks (desirable). ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

e.g. Pandas, NumPy, Matplotlib) Data visualisation using Power BI or Tableau ideal Familiarity with Agile delivery methodologies Microsoft Fabric Power Apps, Power Automate, Dataverse Apache Spark/PySpark ...

will be able to demonstrate skills and experience in many of the following: - Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQL - Deep knowledge of AWS Cloud Platforms (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB) - Experience with data processing across structured and unstructured sources - Strong scripting ...