76 to 100 of 107 Remote Apache Spark Jobs

architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/Delta Lake/BigQuery). Familiarity with eventing technologies (e.g. Event Hubs/Kafka) and file formats such as Parquet/ ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Apply now! Benefits and Contract Information Financial incentives: depending on circumstances, monthly family/marriage allowance of £278 monthly child allowance ...

services Experience with DevOps toolsets such as Jenkins, Terraform, GitHub Actions, etc. Preferred Qualifications of the Senior Software Engineer: Experience developing analytics applications in Spark or similar Please note you must currently be eligible to work and remain indefinitely without any restrictions in the country to which ...

meet non-functional requirements Here is a snapshot of the technologies that we use Azure Cloud Technologies, Databricks, Azure DevOps, Python, Java, PowerShell, Apache Spark, YAML Pipelines, Esri ArcGIS, JMeter What we're looking for Highly skilled in creating, maintaining and peer reviewing secure test automation code ...

best practices. Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data Factory … Data Engineer Associate/Professional, Azure Data Engineer Associate). * Experience with Azure Synapse SQL or serverless SQL pools. * Familiarity with streaming technologies (e.g., Spark Structured Streaming, Kafka, Event Hub). * Experience with infrastructure-as-code (Terraform or Bicep). * Background in BI or analytics engineering (Power ...

financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning, enrichment, and aggregation, ensuring accuracy and consistency across the data lifecycle. Work extensively with Unity Catalog, Delta Lake, Spark ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...

Node.js 3+ years of experience in big data technologies 3+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 3+ years of experience with industry recognized ML frameworks such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 3+ years ...