26 to 50 of 261 Distributed Computing Jobs in the UK

team. Component Design: Design scalable application components, microservices, and data integration layers to support high-throughput regulatory reporting. Big Data Processing: Develop and optimize distributed data processing jobs using Apache Spark, Hadoop, and Hive to aggregate and transform large-scale financial datasets. Real-Time Streaming: Build and maintain real … experience building microservices and RESTful APIs using Spring Boot , Spring Cloud, Spring Data, and Spring Security. Big Data Technologies: Strong, hands-on experience with distributed computing frameworks, specifically Apache Spark , Hadoop , and Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience ...

Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/CD, TDD and version control. o Containerisation tools like Docker or Kubernetes ...

Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/CD, TDD and version control. o Containerisation tools like Docker or Kubernetes ...

metadata management, and data lifecycle management. Understanding of AI/ML data requirements and modern analytics platforms. Knowledge of big data processing frameworks and distributed computing concepts. Awareness of emerging capabilities in data sharing, data products, and data mesh architectures. Experience Proven experience as a Data Architect delivering ...

professional setting (e.g., internship) is a plusAbility to write clean, maintainable, scalable, and robust code in PythonFamiliarity with analytics libraries (e.g., pandas, numpy, matplotlib), distributed computing frameworks (e.g., Spark, Dask), and cloud platforms (e.g., AWS, Azure, GCP)Basic understanding or exposure to containerization technologies such as Docker ...

data from diverse sources.Conduct advanced data analysis, modelling, and visualization to identify patterns and insights.Ensure data quality, reliability, and security across systems. Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyse large datasets. Stay up to date with the latest trends and technologies ...

Strong analytical and problem-solving capabilities Self-motivated with a strong desire to learn and develop Experience in Some or All of the Following Distributed computing technologies such as Spark and Databricks Cloud platforms including AWS, Azure, or GCP Workflow orchestration tools such as Airflow CI/ ...

casesExperience working with structured, semi-structured, and unstructured dataHands-on expertise in containerization and orchestration using Docker and Kubernetes for scalable production systemsFamiliarity with distributed computing frameworks (e.g., Spark, Dask), cloud platforms (e.g., AWS, Azure, GCP), and analytics libraries (e.g., pandas, numpy, matplotlib)Exposure to DevOps, DataOps ...

pipeline orchestration . Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large, complex datasets and distributed computing environments. Proficiency in SQL , version control (e.g. Git), and CI/CD pipelines . Familiarity with Agile delivery and DevOps practices (Azure ...

future incidents.What you bring:Expert-level SQL for building performant, scalable queries and transformations on massive datasets.Strong Python programming skills with a focus on distributed computing, data manipulation, and building robust APIs.Production-level experience for large-scale batch and streaming data processing.Hands-on experience with DBT (Data Build ...

What you bring: Expert-level SQL for building performant, scalable queries and transformations on massive datasets. Strong Python programming skills with a focus on distributed computing, data manipulation, and building robust APIs. Production-level experience for large-scale batch and stream data processing. Hands-on experience with ...

development and performance tuning skills, including experience with Azure SQL Database and SQL Server.Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.Knowledge of data quality, data governance, metadata management and data security principles.Experience with ...

build CI/CD pipelines Competent in SQL and at least one modern programming language, such as Python Understanding of key core concepts like distributed computing, batch & stream processing, functional and object‐orientated programming, how pipelines are built and deployed on cloud, pipeline schedules and SLAs Well‐versed ...

should meet all or a subset of the following technical skills: Software engineering: modular code, software lifecycle processes, unit testing, regression testing Big data: distributed computing paradigms (e.g., mapreduce, dataframes, etc), optimizing distributed software Modelling/quantitative: basic modelling techniques (regression, classification, clustering, etc) Required Skills: Bachelor ...

Responsible AI, model governance, AI safety, privacy, regulatory compliance, and risk management frameworks.Experience with DevOps, CI/CD, Kubernetes, Infrastructure as Code, containerization, and distributed computing platforms.Contributions to the AI community through publications, patents, conference presentations, research, or open-source projects.EDUCATIONBachelor's degree or equivalent experience in Computer ...

Responsible AI, model governance, AI safety, privacy, regulatory compliance, and risk management frameworks.Experience with DevOps, CI/CD, Kubernetes, Infrastructure as Code, containerization, and distributed computing platforms.Contributions to the AI community through publications, patents, conference presentations, research, or open-source projects.EDUCATIONBachelor's degree or equivalent experience in Computer ...

model governance, AI safety, privacy, regulatory compliance, and risk management frameworks**.* Experience with **DevOps, CI/CD, Kubernetes, Infrastructure as Code, containerization, and distributed computing platforms**.* Contributions to the AI community through **publications, patents, conference presentations, research, or open-source projects**.## EDUCATIONBachelor's degree ...

role:Communicate regularly with product leads across the technology organization and discuss opportunities for improvement to existing and future technology solutions.Develop large-scale distributed systems to compute and report intra-day and eod-of-day risks, PnL (Profit and Loss) and market scenarios to senior management, trading desks, controllers … strategies, FID COOs, operations, controllers, and market risk department.What you'll bring to the role: Strong software engineering, analytical and problem-solving skillsExperience in distributed computing or cloud computing, Java/Scala development experience and performance tuningUnderstand DevOps and Continuous Development PrinciplesStrong interest in learning about ...

role: Communicate regularly with product leads across the technology organization and discuss opportunities for improvement to existing and future technology solutions. Develop large-scale distributed systems to compute and report intra-day and eod-of-day risks, PnL (Profit and Loss) and market scenarios to senior management, trading desks … COOs, operations, controllers, and market risk department. What you’ll bring to the role: Strong software engineering, analytical and problem-solving skills Experience in distributed computing or cloud computing, Java/Scala development experience and performance tuning Understand DevOps and Continuous Development Principles Strong interest in learning ...

What we are looking for Several years of relevant work experience Software engineering: modular code, software lifecycle processes, unit testing, regression testing Big data: distributed computing paradigms (e.g., mapreduce, dataframes, etc), optimizing distributed software Modelling/quantitative: basic modelling techniques (regression, classification, clustering, etc) Bachelor’s degree ...

What we are looking for: Several years of relevant work experience Software engineering: modular code, software lifecycle processes, unit testing, regression testing Big data: distributed computing paradigms (e.g., mapreduce, dataframes, etc), optimizing distributed software Modeling/quantitative: basic modelling techniques (regression, classification, clustering, etc) Bachelor’s degree ...

regulatory purposesWhat we are looking for:Several years of relevant work experienceSoftware engineering: modular code, software lifecycle processes, unit testing, regression testingBig data: distributed computing paradigms (e.g., mapreduce, dataframes, etc), optimizing distributed softwareModeling/quantitative: basic modelling techniques (regression, classification, clustering, etc)Bachelor’s degree in computer ...

micro services Interest and ability to learn other coding languages as needed (eg.Python, Angular, React) Experience with dependency injection frameworks (eg.Autofac) Experience in distributed computing, machine learning, data science Experience with building data pipelines, data streaming applications Experience in, or enthusiastic, about motorsport What we can offer ...

Microsoft Fabric ecosystem (OneLake, Data Factory, Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing ...

Ability to work with ambiguity and own problems end-to-end A passion for writing high quality code and building lean processes Experience with distributed data processing Experience with monitoring, testing, and data quality Experience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpoints … would be helpful to have experience/expertise/knowledge in the following: Python AWS Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Why else ...