101 to 125 of 125 Apache Spark Jobs in the UK

doing something you are passionate about. My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

mentoring capability across globally distributed teams. PreferredRedpanda architecture and operations. Event sourcing and CQRS in production environments. Stream processing with Kafka Streams, Flink, Spark Streaming, ksqlDB, or similar technologies. Financial services, banking, lending, payments, or regulated industry experience. Kubernetes and cloud-native platforms. Observability stacks including Prometheus, Grafana, OpenTelemetry ...

deploying scalable data platforms end-to-end on AWS and/or Databricks. Production Coding: Strong, hands-on production experience with Python, SQL, Spark, and Databricks or AWS data tools. Consulting/Client Delivery: Experience working in a consultancy, systems integrator, or client-facing setting with direct accountability …/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming).Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure: Exposure ...

deploying scalable data platforms end-to-end on AWS and/or Databricks. Production Coding: Strong, hands-on production experience with Python, SQL, Spark, and Databricks or AWS data tools. Consulting/Client Delivery: Experience working in a consultancy, systems integrator, or client-facing setting with direct accountability …/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure: Exposure ...

Automated system deployment using tools such as Ansible, Puppet or ChefDesirable Skills/Experience Familiar with the Big Data tech stacks, including: o Trinoo Spark o Apache Hiveo Apache Airflowo Zeppelin notebooksOur PackageTailored benefits make a real difference. That's why we offer a comprehensive range ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...

Hybrid- London, UKProduct Management & Engineering – Product Engineering/Full-time/HybridWho We AreAt Firstup, our mission is to improve the employee experience at every moment that matters, large and small. As the communication pipeline ...

technical specialist in design and architecture- Bachelor's degree, or experience in a professional field or military- Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis)- Experience in consulting, design and implementation of serverless distributed solutions- Experience in software development with object oriented language- Experience in cloud based ...

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/… pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

degree, or experience in a professional field or military- Experience as technical specialist in design and architecture- Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis)- Experience in consulting, design and implementation of serverless distributed solutions- Experience in cloud based solution (AWS or equivalent), system, network and operating … military settings- Bachelor's degree, or experience as technical specialist in design and architecture- Experience in Database like NoSQL, or experience in Hive/Spark/Hbase/Yarn and experience in any Bigdata architecture- Bachelor's degree in business administration, finance, economics, computer science, data science, engineering ...

Senior Data Scientist - Python/Machine Learning Permanent Location: UK - Remote Salary: £65,000 - £70,000 (+ benefits) Skills: Python, Machine Learning, Statistical Modelling, AWS, Data Engineering An exciting opportunity has arisen for an experienced ...

work collaboratively and autonomously. Strong problem-solving skills with a pragmatic and analytical outlook. Desirable: Familiar with analytics tools such as Power BI, Apache Superset, or similar for building interactive and impactful visualizations Familiarity with distributed systems (e.g., Spark, Kafka) and how they support scalable analytics solutions Passion ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

skills for large-scale customer and transaction analysis. Strong Python expertise covering statistical modelling, matching methodologies and analytical product development. Hands-on Databricks, Spark or PySpark experience. Experience developing robust reconciliation, audit-trail and validation frameworks. Strong stakeholder management skills with the ability to explain complex analytical outcomes … contract with potential extension opportunities. Opportunity to work within a large-scale enterprise data transformation programme. Access to modern cloud data platforms including Databricks, Spark and Azure technologies. Exposure to high-impact initiatives that directly influence customer strategy and commercial performance. ...

helping raise standards across our technology estateOur Data Technology StackCloud: Microsoft AzureData platforms: Azure Databricks, SQL Server, Cosmos DB and Blob StorageData processing: Python, Spark and SQLMessaging: Azure Service Bus and Event HubsDevOps and infrastructure: Azure DevOps, GitHub Actions and TerraformYou don't need to have worked with every … operating scalable production data pipelinesStrong understanding of ETL and ELT architectures and patternsStrong programming and data transformation skills, particularly using technologies such as Python, Spark and SQLExperience working with cloud-based data platformsExperience designing systems for reliability, observability, performance and data qualityStrong understanding of data modelling and the principles ...

with AI/ML lifecycle management and MLOpsExperience with market data, trading, sales, risk, or client analytics platformsHands-on experience with kdb+/q, Spark, Kafka, dbt, Airflow, or similar technologiesExperience leading platform transformation or modernization programmesTechnical SkillsPython, Rust, SQL, API design and distributed computing. Long-horizon agentic platforms … agent memory systems, agentic RAGKubernetes, Docker, CI/CD pipelinesData engineering, orchestration, and observabilityAI/ML platforms, MLOps, and model governanceDesirable: kdb+/q, Spark, Kafka, Temporal, ScalaLeadership CompetenciesStrategic thinking and enterprise perspectiveStrong execution and prioritizationBuilds and develops high-performing teamsComfortable operating in ambiguous and fast-paced environmentsStrong focus ...

retraining, and optimise models for reliability and cost efficiency in AWS.Collaboration & Enablement: Partner with data engineers to integrate ML workflows into wider platforms (Spark, Databricks), and share best practice and mentor other technical professionals. What You'll Love About This RoleThink Big: Build ML and AI solutions that shape … models underperform across data, features and architecture, and make reasoned trade-offs. Real-time & distributed ML: A strong grasp of production inference patterns, plus Spark and distributed data processing. Reproducibility & tooling: Reproducible environments (UV/Docker) and MLflow or equivalent, on AWS with Spark, Databricks and Snowflake. Engineering ...

retraining, and optimise models for reliability and cost efficiency in AWS. Collaboration & Enablement: Partner with data engineers to integrate ML workflows into wider platforms (Spark, Databricks), and share best practice and mentor other technical professionals. What You'll Love About This Role Think Big: Build ML and AI solutions … models underperform across data, features and architecture, and make reasoned trade-offs. Real-time & distributed ML: A strong grasp of production inference patterns, plus Spark and distributed data processing. Reproducibility & tooling: Reproducible environments (UV/Docker) and MLflow or equivalent, on AWS with Spark, Databricks and Snowflake. Engineering ...

bandwidth. The goal: no software rewrites, predictable time to production, early integration, and fast iteration. You'll work with tools such as DBT, Python, Apache Airflow, Spark, Iceberg; AWS services like Lambda, Bedrock, and SageMaker, containers, and whatever adds the most value. You'll design tools that ...

Scala programming to develop robust, scalable, and high-performance data processing applications. Build and optimise large-scale data processing and analytics pipelines using Apache Spark. Develop and maintain end-to-end data pipelines for both batch and real-time data processing. Apply solid understanding of data engineering concepts, including … business stakeholders. Skills & Experience: Proven experience as a Software Engineer with a strong focus on Scala development. Extensive hands-on experience with OpenShift and Apache Spark. In-depth understanding of data engineering principles and practises. Experience in developing and maintaining scalable data pipelines for batch and real-time processing. ...

have:·Demonstrable hands-on experience in deploying and maintaining machine learning models in production environments·Processing massive amounts of structured and unstructured data using Spark/SQL/Hive·Familiar with offline (batch) and online (live/stream) data pipelines·Writing production code in Python·Understanding the full software … state-of-the-art data analytics products and solutions·Carrying out A/B test experiments·Experience in Big Data technologies (Hadoop, Spark)·Experience in data pre-processing, Machine Learning, and data visualisation·Experience with large relational and NoSQL databases·Communicating findings to non-technical audience·Mentoring and supporting ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

Company DescriptionWe're ASOS. We blend our flair for fashion with our love of cutting- edge technology, but more importantly were interested in how we can bring the best out of you. We exist to ...

Junior Quant Research Analyst50,000 Plus BonusQuant Capital is urgently looking for a Quant Analyst to join our high profile client in their main quant research team. Our client is well-known tech-driven trading ...

Our client is a global technology company. A problem isnt truly solved until its solved for all. Thats why colleagues build products that help create opportunities for everyone, whether down the street or across the ...