101 to 123 of 123 Apache Spark Jobs in the UK excluding London

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

depth actually gets used. • AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis • Databricks and Snowflake running on top of AWS • Spark and distributed processing frameworks for large-scale data • Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

unit testing. Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security Knowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc. Excellent troubleshooting, analytical, and communication skills. Preferred qualifications, capabilities, and skills Experience in Data pipelines using Spark Exposure ...

market data normalisation. Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

Citi is hiring a Big Data Applications Support Analyst to monitor and troubleshoot a large-scale data platform built on Hadoop, Hive, Spark, and Kafka. You will work with global teams to ensure 24/7 availability and data integrity for business reporting. Ideal candidates have strong Linux ...

endpoint Code Data aggregation/Malware data aggregation Requirements for the Graduate C # Software Developer Proficient in C# coding and testing AWS: S3, Spark, Glue Elasticsearch Python programming: Flask, Pandas, JSON HTML, CSS, JS A great Graduate Software Developer may also have personal passion projects using the above ...

problem-solving and analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with ...

prototype to production - training, packaging, deployment, monitoring, retraining, and decommissioning - in real-world business applications. Proven experience working with large datasets and distributed compute (Spark/Databricks or equivalent), with SQL fluency and an understanding of partitioning, performance, and cost. Hands-on experience using enterprise-authorized AI-assisted software … Application Resiliency, and Security. Preferred qualifications, capabilities, and skills Production experience with Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Jobs) and workflow orchestration with Apache Airflow. Strong working knowledge of both supervised and unsupervised techniques, including tree-based and kernel methods (gradient boosting, random forest, SVM) and anomaly-detection ...

information across our organization.**The Platform:** You'll be supporting a modern Big Data platform built on industry-standard technologies including Hadoop, Hive, Impala, Spark, Kafka, and other open-source tools. This platform handles massive volumes of data daily, supporting analytics, reporting, and business-critical operations.**The Team … issues, and hand over to teams in other regions to maintain 24/7 coverage• Troubleshoot problems - Investigate and resolve issues with Hadoop, Spark, databases, and data processing jobs, working with other teams when needed• Manage scheduled jobs - Monitor thousands of automated jobs running daily, investigate failures, and coordinate ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey ...

problem-solving and analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with ...

problem-solving and analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with ...

rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models, including NLP, deep learning and agentic AI, into production environments. Integrate data from diverse sources through both … years experience with large-scale data challenges Hands-on with Infrastructure-as-Code (Terraform, Ansible) Agile and Waterfall project experience Experience withPython, SQL, Spark, Scala What you will gain from working here: Competitive salary 25 days annual leave Private medical Career progression Extensive Training If youre passionate about data ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

Build and manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python … with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark, and Amazon EMR (or equivalent). Knowledge of monitoring, logging, and security tools. Desirable Skills Kubernetes/EKS or other container platforms. Python scripting ...

driving delivery across complex engagements. Key Responsibilities Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures Provide technical leadership across Databricks, Spark and cloud data platforms Drive delivery of data engineering workstreams within Agile programmes Engage with client stakeholders to translate business objectives into technical solutions … Produce architecture documentation, design artefacts and delivery roadmaps Key Requirements 7+ years experience in data engineering or data platform development Strong experience with Databricks, Spark and distributed data processing Experience with Unity Catalog, Delta Lake and streaming architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering ...

within a technical discipline (e.g., cloud, AI, machine learning, mobile). Ability to solve data‐oriented problems using technologies such as SQL, relational databases, Spark, and NoSQL. Preferred Qualifications, Capabilities, and Skills Additional formal training or certification in software engineering concepts. Exposure to AI tools and technologies for software … development. Experience with Spark performance tuning for complex calculations on large datasets. Experience delivering production changes to complex software using Scala and Spark. If you’re ready to lead, innovate, and make an impact, we invite you to join our team and shape the future of finance technology with ...

across devices and platforms to surface key metrics. The role emphasizes coding in Python, strong SQL, and experience with large data ecosystems (HDFS, Hive, Spark, Airflow). You will influence architecture and own initiatives from concept to delivery. Hybrid work from Cambridge Office. #J-18808-Ljbffr ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Software Engineering Manager – Reminders | London or Manchester – Hybrid (1–2 days per week ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

build these systems with industry standard frameworks and tools, such as React and Angular on the front end with Java, Spring Boot and Apache Kafka on the back end. All of this runs on our cutting edge cloud delivery platform, facilitating over 60k releases to production a year. … while delivering high-impact projects. Although not a requirement, helpful experience includes: An interest in working with data at scale using tools like dbt, Spark, and AI/ML frameworks (e.g. PyTorch, TensorFlow, scikit-learn)Experience with Kafka or other event-driven architectures. During our application process, you will ...