151 to 175 of 388 Apache Spark Jobs in the UK

language processing, including vector databases, fine-tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAIHands-on experience working with Distributed Spark based systems.Graduate degree in a quantitative discipline (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experienceExperience communicating and teaching technical concepts … driving our values through ML[Preferred] 2+ years customer-facing experience in a pre-sales or post-sales role[Preferred] Experience working with Apache Spark to process large-scale distributed datasetsCan meet expectations for technical training and role-specific outcomes within 3 months of hireCan travel ...

rather than “telling”, preferring to inspire stakeholders through built examples. Technical Expertise: Deep experience in core data & AI technologies, including languages (Python, SQL), frameworks (Apache Spark) and platforms (Databricks, etc.). Collaboration: You can orchestrate diverse teams to achieve a common goal and explain complex tech … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

platforms that enable real‐time and batch data processing at scale. Responsibilities Drive platform capability improvements – continuously enhance distributed data platforms using knowledge of Spark, Databricks, Kafka, Pulsar, Cassandra, and object stores to maintain best‐in‐class capabilities. Enable application data consumption – understand how applications produce and consume data … structures, partitioning strategies, consistency models, and performance optimisation, as well as OLTP databases such as PostgreSQL and MySQL. Distributed compute frameworks – strong experience with Apache Spark and distributed data processing, including optimisation, performance tuning, and large‐scale batch/streaming workloads. Cloud‐native data platforms – demonstrated experience with ...

Security Groups, CloudFormation, RDS, DynamoDB and Redshift, including secure and well-governed implementations. Data engineering and pipelines, building efficient batch and streaming solutions using Apache Spark and AWS services, and working with large-scale datasets in enterprise environments. Demonstrated technical problem-solving capability, with the ability to rapidly ...

Experience with Infrastructure-as-Code tools such as Terraform Knowledge of DevOps, CI/CD, platform automation, and cloud‐native operational practices Familiarity with Apache Spark, dbt, and modern data integration technologies Delivery Experience Experience leading architecture for enterprise-wide Databricks implementations and cloud data modernization initiatives Proven ...

showing” rather than “telling”, preferring to inspire stakeholders through built examples.Technical Expertise: Deep experience in core data & AI technologies, including languages (Python, SQL), frameworks (Apache Spark) and platforms (Databricks, etc.)Collaboration: You can orchestrate diverse teams to achieve a common goal and explain complex tech to non-technical ...

Scala. Strong knowledge of SQL and experience with data warehousing solutions. Familiarity with cloud platforms (AWS, Azure, Google Cloud) and big data technologies (Hadoop, Spark). Excellent problem-solving skills and a keen eye for detail. A collaborative spirit and a genuine passion for data! Our Client's Benefits ...

services, capital markets or FinTech. Additional AWS services such as SQS, SNS, Step Functions, EventBridge or Secrets Manager. Big data technologies including DuckDB, pandas, Spark, Databricks or Snowflake. AI/ML technologies including vector databases, semantic search or LLM orchestration frameworks. Continuous delivery and modern development workflows. Data science ...

stakeholders. Strong system‐level problem‐solving skills with the ability to make architectural trade‐offs. Experience with modern analytics tools and platforms such as Spark, data lakes, and similar. Hands‐on experience with LLMs, AI prompt design, and building production‐grade AI applications. Advantage Previous experience as a DBA. ...

Computer Vision: Familiarity with computer vision techniques and libraries like OpenCV. Experience with Big Data Tools: Experience with big data tools like Hadoop, Spark, or Hive. Knowledge of Reinforcement Learning: Understanding of reinforcement learning techniques and algorithms. Familiarity with Robotics: Experience with robotics and robotic process automation (RPA) tools. ...

objectives.A bit about you: Strong Python knowledge. Ability to read through code. Demonstrable experience collaborating with engineers.Experience with big data technologies such as Hadoop, Spark, or similar. Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and data warehousing solutions.Strong knowledge in at least a few of the following areas ...

machine learning development (training and/or deploying models at scale). Outstanding programming skills in Python. Experience with distributed data processing frameworks (e.g., Spark). Experience with deep learning/NLP frameworks (e.g., PyTorch, Hugging Face). Solid understanding of software engineering principles and ML lifecycle practices (MLOps ...

experience in software engineering, MLOps, and deploying machine learning models at scale.Proficiency in SQL, Python, and familiarity with big data technologies (e.g., Kafka, Spark) and/or cloud platforms (e.g., GCP, AWS, or Azure).Industry knowledge: Experience in gaming or digital entertainment is a strong plus.Why Product Madness ...

ability to architect and demo enterprise-grade solutions liveProficiency in SQL, Python, and data engineering tools commonly used in FSI environments (dbt, Spark, Kafka, or equivalent)Excellent executive communication skills with the ability to engage credibly with CDOs, CTOs, and CIOs at global financial institutionsTrack record of leading complex ...

experience. Experience working in complex regulated sectors such as healthcare, government, or justice. Proficiency with large-scale data processing technologies such as SQL, Spark, or Hadoop. Open source contributions or personal projects demonstrating excellence in AI engineering. Our clients Offer a range of benefits for permanent workers, as well ...

both OnPrem and Cloud* Experience with processing large datasets as well as streaming data and unstructured data sources including Cassandra HBase Kafka and Spark* Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent* Strong programming background in either Java ...

incremental data pipelines leveraging Azure Data Factory for orchestration and Azure Data Lake Storage Gen2 as the primary data store.Independently implement SQL- and Spark‐based transformations to produce curated datasets that support enterprise reporting, analytics, and downstream consumption.Take ownership of assigned data pipelines and datasets, including monitoring, troubleshooting … jobs to ingest, transform, and curate data within the enterprise data platform.Build and modify Azure Data Factory pipelines for batch and incremental data ingestion.Implement Spark‐based transformations that write curated datasets to Azure Data Lake Storage Gen2 using established folder structures and naming conventions.Create and maintain SQL views ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems Experience with data engineering concepts or a good understanding of data engineering concepts Pre-sales or post-sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred Preferred: Experience working with Apache Spark (TM) to process large‐scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. ...

support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with technologies such as Python, SQL, and Apache Spark, helping drive analytics and operational decision-making. Ideal candidates possess strong programming skills, a relevant degree, and a collaborative spirit, as you will ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Essential Skills of the Analytical Platform Engineer Python Kubernetes Docker CI/CD pipelines (GitLab or similar) Desirable skills MLOps and data engineering concepts Apache Spark Scala S3-compatible object storage Graph database technologies If you are an driven and experienced Analytical platform engineer looking for their next ...

implementing distributed data platforms at scaleProven track record architecting real-time, low-latency streaming platforms and event-driven architecturesStrong hands-on experience with Apache Spark and Databricks, including performance tuning at scaleExperience with Cassandra or similar distributed databases, including partitioning, consistency models, and optimisationSolid experience with OLTP databases ...

build out technology roadmapsCodebase ownershipTechnical Application ownershipQualificationsStrong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins , HarnessStrong experience of developing on Apache Spark/HadoopStrong experience with AWS cloud services including AWS Glue, S3, StepStrong experience building data pipelines and data lakeExperience of the full ...

ownership Technical Application ownership Qualifications Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins , Harness Strong experience of developing on Apache Spark/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience ...

ownership Technical Application ownership Qualifications Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins , Harness Strong experience of developing on Apache Spark/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience ...