76 to 100 of 138 Apache Spark Jobs in England

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward ...

Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object storage) Expertise in modern engineering practices, including: Continuous ...

ideal candidate will have a strong programming background in Python or Java, knowledge of SQL, and experience with data processing frameworks such as Apache Spark. Responsibilities include enhancing data pipelines, ensuring data quality, and collaborating with engineering teams. The position is located in London and offers significant growth opportunities ...

classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualisation tools (Cassandra, Hadoop, Spark, Tableau). ...

data extraction, transformation, and pipeline development Experience with dashboarding and visualization tools (Tableau, Qlik, or similar) Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes Experience with Python or R for advanced analytics, automation, or experimentation Knowledge of statistical methods and experimentation (A/B testing) preferred ...

data extraction, transformation, and pipeline development Experience with dashboarding and visualization tools (Tableau, Qlik, or similar) Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes Experience with Python or R for advanced analytics, automation, or experimentation Knowledge of statistical methods and experimentation (A/B testing) preferred ...

Bring as Head of Data Science Proven experience leading a data science or advanced analytics function. Deep technical expertise in Python, SQL and Spark SQL. Hands-on experience with machine learning frameworks including TensorFlow, PyTorch and scikit-learn. Experience with distributed computing and cloud platforms such as AWS, Azure ...

extracting, manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like ...

learning frameworks (TensorFlow, PyTorch, Keras) Knowledge of prompt engineering, RAG (Retrieval Augmented Generation), and LLM fine‐tuning techniques Familiarity with distributed computing frameworks (eg Spark) Knowledge of graph neural networks, reinforcement learning, or causal inference Experience with AI governance, model risk management, and regulatory compliance Experience using Pro code ...

/or AI solutions Are an expert in one of predictive modelling, classification, regression, optimisation, NLP algorithms or recommendation systems Have experience with Spark Have knowledge of DevOps technologies such as Docker and Terraform and ML Ops practices and platforms like ML Flow Have experience with agile delivery methodologies ...

experience with Generative AI and LLMs, including prompt engineering, fine-tuning, evaluation, and production deployment. Strong command of modern data stacks, including Python, SQL, Spark, BigQuery, and Snowflake. Clear communication skills, able to explain complex AI concepts to both technical and non-technical audiences. Benefits and perks There ...

Skills & Abilities Strong technical competency skills in widely used database platforms. These may include but are not limited to SQL, T‐SQL, PL‐SQL, Spark, Hive, Impala. Strong technical competency on platforms such as Linux, SQL Server and Oracle. Strong understanding of Enterprise Data Catalogs along with experience implementing ...

Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive ...

Manchester, UK, to develop scalable APIs and manage big data solutions. Candidates should have 8+ years in software or data engineering, with skills in Apache Spark, Airflow, and a strong foundation in Java, Python, or Scala. The role requires collaboration with cross-functional teams to deliver high-quality ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Kafka, messaging systems, and event-driven architecture • Cloud-native development (AWS or similar) • Reactive programming (Spring WebFlux) • Big Data/streaming technologies such as Spark, Storm, Cassandra, Elasticsearch, HBase • Experience with highly available, resilient systems using clustering and load balancing ...

seasonality analysis) Solid foundation in statistical modelling and machine learning theory Proficiency in Python and experience working with large, complex datasets using SQL and Spark Ability to manage multiple priorities across a portfolio of projects Experience engaging both technical and business stakeholders Experience with libraries such as SciPy, Scikit ...

data science or statistical role. Expertise in advanced analytics techniques including machine learning, optimisation and segmentation. Strong proficiency in Python, SQL and Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation tools (Databricks, Azure Data Factory ...

working within a globally‐distributed team A background in some of the following a bonus: Java experience Python experience Ruby experience Big data technologies: Spark, Trino, Kafka Financial Markets experience SQL: Postgres, Oracle Cloud‐native deployments: AWS, Docker, Kubernetes Observability: Splunk, Prometheus, Grafana #J-18808-Ljbffr ...

source tools. Understanding of database and data analysis technologies like Azure Data Explorer (ADX), PostgreSQL, MongoDB, and data‐driven machine learning tools such as Spark, Power BI. Experience with optimisation, simulation and data analysis tools such as Matlab Simulink (e.g. optimisation and ML toolboxes), PySpark and Jupyter notebooks. Work ...

manage multiple priorities and respond calmly to issues. • Self-motivated with a collaborative approach. Preferred: • Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. • Experience supporting data products or client-facing datasets. • Understanding of release testing, UAT or production support processes. • Exposure to Jira/Agile ...

manage multiple priorities and respond calmly to issues. • Self-motivated with a collaborative approach. Preferred: • Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. • Experience supporting data products or client-facing datasets. • Understanding of release testing, UAT or production support processes. • Exposure to Jira/Agile ...

series, geospatial, image, etc. Different types of database – relational; document; graph; columnar; key‐value Large scale data processing platforms, typically based on Hadoop/Spark Business intelligence/analytics products or frameworks Data analysis and data modelling requirements Experience working with cloud platforms and working with relevant PaaS/ ...

business stakeholders to deliver robust, high-performance data solutions in a cloud-native AWS environment. The ideal candidate has strong expertise in PySpark, Python, Apache Airflow, AWS services, Terraform, and modern DevOps practices. Good to have SC eligibility or SC clearance Key Responsibilities Data Engineering & Pipeline Development Design, develop … transformation, cleansing, enrichment, and validation processes. Troubleshoot and resolve data pipeline failures, bottlenecks, and performance issues. Workflow Orchestration Design and manage complex workflows using Apache Airflow. Create and maintain DAGs with robust scheduling, dependency management, alerting, and recovery mechanisms. Monitor workflow execution and proactively address failures or performance concerns. ...

team members. Proficiency in Python, Java, and SQL is essential, along with experience in using AWS services and Docker. Candidates should be familiar with Apache Spark, Terraform, and GitLab for CI/CD. If you have a passion for improving testing frameworks and practices, we invite ...