1 to 25 of 107 Scala Jobs in the UK

cost efficiency. Implement data quality controls, validation processes, and monitoring solutions. Data Transformation & Processing Develop complex data transformation logic using Spark (PySpark or Scala). Build data cleansing, enrichment, aggregation, and processing solutions. Ensure data accuracy, consistency, and reliability throughout the data life cycle. Azure Databricks Development Develop and support ...

resilience of production data platforms.\n Skills Required \n \n Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. \nHands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop).Experience designing ...

resilience of production data platforms.\n Skills Required \n \n Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. \nHands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop).Experience designing ...

larger initiatives What You'll Bring Technical Expertise: Strong SQL—comfortable with complex transformations, performance tuning and warehouse-specific dialect Strong Python skills (or Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent ...

Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data engineering. Hands-on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect). Proven track record with data governance, quality ...

This includes proficiency in Python and other languages (eg Typescript etc Go, C#, Rust etc) Proficiency in at least one programming language (eg Python, Scala etc) plus SQL . Proficiency in ML libraries (e.g., TensorFlow, PyTorch, Hugging Face). Ability to set up and use APIs and integrate AI components ...

real-time data processing jobs. Your Skills: Hadoop Ecosystem: HDFS, Hive, Spark, MapReduce, YARN, HBase Data Integration: Sqoop, Kafka, Flume, NiFi Programming: Python, Scala, Java, Shell Scripting Databases: Oracle, SQL Server, MySQL, PostgreSQL Cloud: AWS, Azure, GCP Workflow Tools: Oozie, Airflow We are a Disability Confident Employer: Capgemini is proud ...

data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data life ...

. Advanced SQL skills, including optimisation and performance tuning. Strong experience with ETL/ELT pipelines and data transformation frameworks. Programming proficiency in Python, Scala, or Java for data processing. Deep understanding of data warehousing concepts and best practices. Experience maintaining reliable, production-grade data pipelines. Excellent stakeholder management ...

paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured ...

Engineer, Software Architect, or similar senior technical role. Strong server-side software engineering experience, with flexibility across programming languages such as Python, Java, Go, Scala, C#, or similar. Experience designing and building distributed data services or large-scale backend platforms. Experience with Apache Spark, Apache DataFusion, Trino, Presto, or similar ...

user stories and user journeys. Coaching and mentoring team members.\n MINIMUM (ESSENTIAL) REQUIREMENTS: \n \n Strong software development experience in one of Java, Scala, or Python \n Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks. Experience of developing substantial components for large ...

databases Excellent communication skills and comfort working in an Agile (Scrum/Kanban) environment Nice to Have Experience with JVM languages beyond Java (Kotlin, Scala, Groovy) Exposure to TypeScript or Node.js for a full‐stack context Background in system design and distributed systems Proficiency in Python for scripting or data ...

Experience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment) Proficient software development experience in one of Java, Scala, or Python Software development experience with data-processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools Expert in SQL or SQL extensions ...

code” tools such as Terraform, Salt or similar; 3+ years of significant professional experience developing applications written in a modern programming environment - preferably Scala/Java and/or Python; Professional experience across the entire software development life cycle, from gathering requirements to production deployment using CI & CD; Confident ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking ...

including hands‐off expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (Python, Java, Scala). Foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous. Key Notes for the role: Location for the role needs ...

user stories and user journeys. \n • Coaching and mentoring team members. \n MINIMUM (ESSENTIAL) REQUIREMENTS: \n • Strong software development experience in one of Java, Scala, or Python \n • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks. \n • Experience of developing substantial components ...

hands‐on expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (i.e., Python, Java, Scala). A foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous for the role. We will be testing your ability ...

years Mandatory Required Skills Hands-on experience with Quantexa platform/Decision Intelligence Strong in Apache Spark/PySpark Proficiency in Python/Scala Experience in ETL, Data Engineering, Data Warehousing Knowledge of entity resolution, graph analytics, link analysis Experience working with large datasets (Big Data ecosystem – Hive/HDFS ...

Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office a minimum of two days ...

Data Engineer you will have the following key skills Cloud: GCP Warehousing: BigQuery/Snowflake Orchestration: Airflow Backend: Python, SQL, Shell Languages: Scala/Java DevOps: Terraform, Docker, Kubernetes Observability: Monte Carlo BI: Looker AI/ML: MLOps London | 12 Months Contract |£400 a day Inside IR35 If you want ...

expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes ...

Bring Technical Expertise: Strong proficiency in one or more of: Python, Java, Kotlin, Go, C#/.NET, TypeScript/Node, Ruby, PHP, Scala, Rust Hands-on experience with modern frameworks (Spring, .NET, Django, FastAPI, Rails, Express/NestJS, Laravel, React, Vue, Next.js, Angular or equivalent) Solid grounding in REST ...

long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse Analytics, and/ ...