1 to 25 of 166 Scala Jobs in England

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

experience operating as a Senior Data Engineer on complex, enterprise-scale platforms Strong programming capability in Python Commercial experience with Java and/or Scala Advanced SQL and strong data modelling skills Proven experience designing and operating ETL/ELT pipelines at scale Solid understanding of distributed systems and data ...

automated pipeline development. • Hands-on experience with ETL/ELT processes, data governance, and cloud-based data platforms. • Proficiency in SQL, Python, or Scala for data processing and automation. • Familiarity with data architecture, warehousing, and business intelligence tools. Desirable • Experience with Azure Data Services, AWS, or GCP. • Knowledge ...

Knowledge of DevOps practices for data pipelines Certifications : Azure Data Engineer or Azure Solutions Architect certifications Skills Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight ...

Quantexa delivery experience Strong knowledge of Entity Resolution, Scoring Framework, Network Generation, and UI configuration 5 -10 years' experience with Big Data technologies (Scala, Spark, Hadoop, Elasticsearch) Solid data modelling and analytics platform design experience Excellent stakeholder communication skills Experience with cloud platforms (AWS, Azure, or GCP) Desirable Experience ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

Knowledge of DevOps practices for data pipelines Certifications: Azure Data Engineer or Azure Solutions Architect certifications Skills Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about ...

Experience: Proven experience as a Data Engineer or similar role, with strong knowledge of data warehousing and modelling. Proficiency in C#, Python, Java, or Scala . Hands-on experience with ETL tools (e.g., SSIS) and orchestration tools (e.g., Azure Data Factory). Strong SQL skills and experience with relational databases ...

related field. 5+ years of experience in data engineering and data quality. Strong proficiency in one the programming languages, such as Python, Java, Scala, C++, etc. Experience with distributed computing frameworks such as Ray, Spark, and MapReduce. Attention to detail and a strong commitment to data integrity. Excellent problem-solving ...

etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python, Java, Scala, Go ) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Mesh-AI Fast-growing start-up organisation ...

star schemas. Should do Command Query responsibility segregation. Good understanding of observability tools like Prometheus/Grafana/CloudWatch. Good hands-on experience with Scala/Python/SQL, IaC(Terraform), Glue/Spark, Lambda, CI/CD (Jenkins/Gitlab) Nice to have skills: - QuickSight/Tableau; Redshift tuning ...

Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise in Python, Scala, and SQL for efficient data processing. Build data pipelines using cloud-native services on AWS, including Lambda, Glue, Redshift, and API Gateway. Monitor and optimise ...

expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes ...

years' experience in data engineering and 1+ experience as Lead Data Engineer Proven expertise with Microsoft Azure Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark. Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta ...

Strong problem-solving and analytical mindset Experience designing and delivering data pipelines within big data architectures Hands-on experience with Java, Python, Scala, Spark and SQL Experience extracting and transforming data via APIs, scripts and SQL queries Experience processing large-scale data sets and integrating multiple data sources ...

least 5 years in a lead automation role, skilled in creating frameworks with strong coding experience e.g Java, Playwright, Python, Typescript, Cypher, Scala and API tooling (such as Insomnia, Apidog or Postman) Deep IAM domain knowledge Testing functions and decision points "As Code", such as Policy as code Graph ...

with multi-AZ/multi-region patterns , meeting defined RPO/RTO targets. Hands-On Engineering Write and review production-grade code using: Python, Scala, SQL Spark/AWS Glue AWS Lambda & Step Functions Build infrastructure using Terraform (IaC) . Implement CI/CD pipelines (GitLab, Jenkins). Enforce automated ...

tools like JMeter, Gatling, K6, Neoload, or Webload . Strong coding skills in at least one language such as Java, TypeScript JavaScript, Python, C#, , Scala, or PHP. Experience designing and building automation frameworks . Familiarity with Agile development environments (SCRUM, Kanban, TDD, BDD). Implementing pipelines using common tooling such ...

Experience of using a unified engine for large-scale data analytics (e.g. Spark/PySpark) Experience in writing, testing and implementing scripts (e.g. Python, Scala) Experience of cloud data stack use (e.g. SageMaker Notebooks, S3, Glue, Athena) Communicating technical concepts clearly to both technical and non-technical stakeholders using appropriate ...

Experience of using a unified engine for large-scale data analytics (e.g. Spark/PySpark) Experience in writing, testing and implementing scripts (e.g. Python, Scala) Experience of cloud data stack use (e.g. SageMaker Notebooks, S3, Glue, Athena) Communicating technical concepts clearly to both technical and non-technical stakeholders using appropriate ...

Experience of using a unified engine for large-scale data analytics (e.g. Spark/PySpark) Experience in writing, testing and implementing scripts (e.g. Python, Scala) Experience of cloud data stack use (e.g. SageMaker Notebooks, S3, Glue, Athena) Communicating technical concepts clearly to both technical and non-technical stakeholders using appropriate ...

with large, complex datasets in an Agile environment Contribute to CI/CD, DevOps, and automated testing Skills & Experience Full-stack development experience Java (Scala exposure a plus) Spark/distributed computing Azure Cloud Relational or cloud databases (Snowflake, Sybase) Front-end frameworks (Angular or similar) Unix/Linux, Agile ...

Agile delivery environment Support CI/CD, DevOps, and automated testing to improve software quality Skills & Experience Strong software engineering experience Java (Scala exposure beneficial) Spark/distributed computing experience Familiarity with Azure Cloud Experience with relational or cloud databases (Snowflake, Sybase, or similar) Exposure to front-end frameworks (Angular ...