5 of 5 Apache Spark Jobs in the North East

required Do not rule yourself out if you do not have these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, Palantir Experience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLM Search and ranking experience. For example Elasticsearch ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

best practices. Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data Factory … Data Engineer Associate/Professional, Azure Data Engineer Associate). * Experience with Azure Synapse SQL or serverless SQL pools. * Familiarity with streaming technologies (e.g., Spark Structured Streaming, Kafka, Event Hub). * Experience with infrastructure-as-code (Terraform or Bicep). * Background in BI or analytics engineering (Power ...

. • Experience building and deploying applications on Kubernetes (EKS). Ask anything Important skills: Must have: 1. Bash Scripting 2.Real time with Spark structured streaming Nice to have : Familiarity with IceBerg GCP/BQexposure ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...