1 to 25 of 1,246 Scala Jobs

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

high-energy, detail-oriented, proactive and have the ability to function under pressure in an independent environment. • Experience building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage. • Expertise in Data Engineering and Data Analysis: implementing multiple end-to-end DW projects ...

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

Scala Developer Senior Scala Engineer - Scala - paying up to £650/day (Inside IR35) - Hybrid (2x a week - London) - 6 month contract The role: * Build and maintain backend services that move and integrate data * Create reliable, secure and observable software with strong automation * Help define requirements and shape technical solutions … Contribute to overall engineering direction * Support and mentor team members What you'll need: * Strong commercial experience delivering complex applications * Solid Scala skills (experience with similar ecosystems beneficial) * Exposure to Docker, Kubernetes and cloud environments * Strong TDD mindset and CI/CD experience * Comfortable working in an Agile setup ...

with Hadoop platforms. -Solid understanding of software engineering principles, including object-oriented design and microservices architecture. -Proven expertise in building data processing applications using Scala and Python 3.10+. -Strong grasp of design patterns, clean code practices, and writing maintainable, scalable software. -Experience developing container-based applications in a microservices environment. ...

experience operating as a Senior Data Engineer on complex, enterprise-scale platforms Strong programming capability in Python Commercial experience with Java and/or Scala Advanced SQL and strong data modelling skills Proven experience designing and operating ETL/ELT pipelines at scale Solid understanding of distributed systems and data ...

enable data accessibility and automation.Skills:Strong SQL and database designBig Data technologies (Hadoop, Spark, Hive)Data pipeline tools (Airflow, Kafka, NiFi)Programming (Python, Scala, Java)Cloud platforms (AWS, Azure, GCP)Data warehousing (Snowflake, Redshift, BigQuery)ETL/ELT developmentData governance, security, and performance optimization ...

What You Need To Succeed 6+ years of experience developing and delivering production-grade software and data systems. Proficiency in Python, Java, or Scala - comfortable writing robust, testable, and scalable code. Deep experience with AWS (Lambda, ECS/EKS, EMR, Step Functions, S3, IAM, etc.). Strong knowledge of distributed ...

Experience managing cloud costs and IAM so value is not lost to waste Ability to work in other languages where needed. For example Java, Scala, Go or bash Experience with BI tools such as Looker or Tableau Prior consulting experience or leading client projects end to end Contributions to open ...

working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data quality, data governance processes, Git version control + Agile development environments. Azure Data Engineer certification preferred ...

Quantexa delivery experience Strong knowledge of Entity Resolution, Scoring Framework, Network Generation, and UI configuration 5 -10 years' experience with Big Data technologies (Scala, Spark, Hadoop, Elasticsearch) Solid data modelling and analytics platform design experience Excellent stakeholder communication skills Experience with cloud platforms (AWS, Azure, or GCP) Desirable Experience ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies ...

work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables ...

Azure technologies and identify areas for enhancement. Databricks (Unity Catalog, DLT), Data Factory, Synapse, Data Lake, Stream Analytics, Event Hubs. Strong knowledge of Python, Scala, C#, .NET. Experience with advanced SQL, T-SQL, relational databases. Azure DevOps, Terraform, BICEP, ARM templates. Distributed computing, cloud-native design patterns. Data modelling, metadata ...

Knowledge of DevOps practices for data pipelines Certifications: Azure Data Engineer or Azure Solutions Architect certifications Skills Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about ...

Experience: Proven experience as a Data Engineer or similar role, with strong knowledge of data warehousing and modelling. Proficiency in C#, Python, Java, or Scala . Hands-on experience with ETL tools (e.g., SSIS) and orchestration tools (e.g., Azure Data Factory). Strong SQL skills and experience with relational databases ...

systems so they run smoothly and can grow easily. Familiarity with Docker, Terraform, GitHub Actions, and Vault Experience in coding SQL, Python, Spark, or Scala to work with data. Experience with databases used in Data Warehousing, Data Lakes, and Lakehouse setups. You know how to work with both structured ...

systems so they run smoothly and can grow easily. Familiarity with Docker, Terraform, GitHub Actions, and Vault Experience in coding SQL, Python, Spark, or Scala to work with data. Experience with databases used in Data Warehousing, Data Lakes, and Lakehouse setups. You know how to work with both structured ...

related field. 5+ years of experience in data engineering and data quality. Strong proficiency in one the programming languages, such as Python, Java, Scala, C++, etc. Experience with distributed computing frameworks such as Ray, Spark, and MapReduce. Attention to detail and a strong commitment to data integrity. Excellent problem-solving ...