1 to 25 of 179 Remote Apache Spark Jobs

Senior Data Engineer, you will be a key member of our dedicated data engineering, reporting, and analytics team. You will bring deep expertise in Apache Spark to the group, complementing the existing engineering talent and strengthening our overall data engineering capability. Spark is the core distributed processing …/week onsite during probation) Employment Type: Full-time Experience Level: Senior Position Responsibilities Design, develop, and optimize large-scale distributed data pipelines using Apache Spark as the core processing engine. Implement robust batch and streaming solutions using modern Lakehouse patterns (e.g., Delta Lake, streaming ingestion, structured transformations ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional teams. ...

proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional teams. ...

Java. Hands on experience with at least one major cloud platform (Azure, AWS or GCP). Exposure to big data technologies such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar ...

Java. Hands on experience with at least one major cloud platform (Azure, AWS or GCP). Exposure to big data technologies such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar ...

control. Excellent collaboration and communication skills, with strong attention to detail and data quality. Desirable: Exposure to AI/ML data preparation, Python or Spark, Data Vault 2.0, data governance, GDPR, and experience working in mobility, logistics, financial services, or tech-enabled environments. What ...

Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta ...

deliver intelligent data products, leveraging modern cloud and AI technologies. Key Responsibilities Design and implement robust data pipelines and ML workflows using Python, SQL, Spark, and Databricks. Develop and deploy machine learning models (including NLP, deep learning, and agentic AI) in production environments. Integrate data from diverse sources, including ...

write clear and reliable Python/PySpark code. You are familiar with popular analytics tools (like pandas, numpy, matplotlib), big data frameworks (like Spark), and cloud services (like Palantir, AWS, Azure, or Google Cloud). You have a deep understanding of data models, relational and non-relational databases ...

technology (AWS or Azure). Strong experience with creation of data ingestion pipeline and ET process. Strong knowledge of big data tool such as Spark, Databricks and Python. Strong understanding of common machine learning techniques and frameworks (e.g. mlflow). Strong knowledge of Natural language processing (NPL) concepts. Strong ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

mathematics, or a similar field 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years of experience developing performant, resilient, and maintainable code 3+ years of experience with data gathering and preparation for ML models ...

transformation. Proficiency in Python and PySpark for advanced data engineering, machine learning, and large-scale distributed processing within Databricks. Hands-on experience with Spark optimizations (Adaptive Query Execution, caching, partitioning, broadcast joins) to deliver performant solutions for big data workloads. Advanced knowledge of BI and visualization tools such ...