6 of 6 Permanent Databricks Jobs in Suffolk

bring Strong experience in data engineering, analytics engineering, or applied data science Cloud and data platform exposure, AWS, Azure, GCP, and/or Databricks Python, ideally PySpark, R helpful but not essential End-to-end pipelines, feature engineering, and production ML workflows Familiarity with LLMs, GenAI, or agent-based systems ...

with the freedom to shape how GenAI and ML are used across the platform. Tech stack: Python PyTorch or TensorFlow scikit-learn Spark Kafka Databricks LangChain and RAG-based GenAI systems Cloud-native Azure environment Important Details: Fully remote across ...

LLMs and/or Agentic Systems, from development to production. Hands-on experience with LLM frameworks (e.g. langchain, langgraph, llamaindex, langsmith), AI platforms (e.g. Databricks, mlflow) and containerization solutions (e.g. Docker) is valued. Strong software engineering fundamentals and proficiency in Python are a must. Be creative, ambitious and curious. ...

academic and professional services communities to drive adoption. Desirable Experience with major cloud and AI stacks such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service … pipelines, APIs, and microservices. Hands-on experience with cloud platforms (Azure preferred; AWS or GCP also valued) and MLOps tools (e.g., MLflow, Azure ML, Databricks, SageMaker or Vertex) plus observability practices. Familiarity with higher education processes and integrations across SIS, LMS, CRM, and ERP environments. Knowledge of data privacy, accessibility ...

will initially be for 6 months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers …/CD, version control, and automated testing for data pipelines Required Qualifications • 3+ years of experience as a Data Engineer • Strong experience with Databricks and Apache Spark • Proficiency in Python (required); SQL (advanced) • Hands-on experience with AWS or Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda ...

architectures, covering data ingestion, identity resolution, segmentation, and activation Define how the CDP integrates with, Data lake/lakehouse platforms (e.g. Databricks), CRM and sales platforms (e.g. Salesforce), Marketing automation and engagement tools (e.g. Braze) Apply strong understanding of batch vs real-time data flows, consent, and privacy-aware design … data architectures, spanning CDP and identity resolution, Marketing automation and engagement platforms, CRM and customer-facing systems, Data lake/lakehouse platforms (e.g. Databricks). Proven track record of leading discovery, requirements definition, and solution shaping in complex or ambiguous environments Previous exposure and comfortable engaging with senior business ...