1 to 25 of 1,173 Scala Jobs

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder ...

/ELT processes, data integration, and real-time data pipelines. Experience with ingestion frameworks, time-series databases, and streaming analytics. Programming proficiency in Python, Scala, or Java for data engineering and automation. Strong SQL skills and familiarity with NoSQL and graph database technologies. Excellent communication skills, with the ability ...

OLAP and what scenarios to deploy them in. Understanding of incremental processing patterns. Skills Strong proficiency in Python and SQL. Experience of working with Scala would be beneficial. Proven ability to design and optimize large-scale ETL/ELT pipelines. Building and managing orchestrations. Excellent oral and written communication, both ...

OLAP and what scenarios to deploy them in. Understanding of incremental processing patterns. Skills Strong proficiency in Python and SQL. Experience of working with Scala would be beneficial. Proven ability to design and optimize large-scale ETL/ELT pipelines. Building and managing orchestrations. Excellent oral and written communication, both ...

into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning, enrichment, and aggregation, ensuring accuracy and consistency across the data lifecycle. Work extensively with Unity Catalog, Delta Lake, Spark SQL, and related services. ...

What You Need To Succeed 6+ years of experience developing and delivering production-grade software and data systems. Proficiency in Python, Java, or Scala - comfortable writing robust, testable, and scalable code. Deep experience with AWS (Lambda, ECS/EKS, EMR, Step Functions, S3, IAM, etc.). Strong knowledge of distributed ...

Experience managing cloud costs and IAM so value is not lost to waste Ability to work in other languages where needed. For example Java, Scala, Go or bash Experience with BI tools such as Looker or Tableau Prior consulting experience or leading client projects end to end Contributions to open ...

working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data quality, data governance processes, Git version control + Agile development environments. Azure Data Engineer certification preferred ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/ ...

Terraform/Bicep). Qualifications About You: Proven experience as a Data Engineer in cloud-native environments. Strong programming skills in Python (and ideally Scala) plus solid SQL knowledge. Hands-on expertise with Azure Databricks, Azure Data Factory, and Spark. Understanding of data modelling, ETL/ELT patterns, and distributed ...

query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies ...

Azure technologies and identify areas for enhancement. Databricks (Unity Catalog, DLT), Data Factory, Synapse, Data Lake, Stream Analytics, Event Hubs. Strong knowledge of Python, Scala, C#, .NET. Experience with advanced SQL, T-SQL, relational databases. Azure DevOps, Terraform, BICEP, ARM templates. Distributed computing, cloud-native design patterns. Data modelling, metadata ...

Knowledge of DevOps practices for data pipelines Certifications: Azure Data Engineer or Azure Solutions Architect certifications Skills Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about ...

Knowledge of DevOps practices for data pipelines Certifications: Azure Data Engineer or Azure Solutions Architect certifications Skills Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about ...

systems so they run smoothly and can grow easily. Familiarity with Docker, Terraform, GitHub Actions, and Vault Experience in coding SQL, Python, Spark, or Scala to work with data. Experience with databases used in Data Warehousing, Data Lakes, and Lakehouse setups. You know how to work with both structured ...

systems so they run smoothly and can grow easily. Familiarity with Docker, Terraform, GitHub Actions, and Vault Experience in coding SQL, Python, Spark, or Scala to work with data. Experience with databases used in Data Warehousing, Data Lakes, and Lakehouse setups. You know how to work with both structured ...

systems so they run smoothly and can grow easily. Familiarity with Docker, Terraform, GitHub Actions, and Vault Experience in coding SQL, Python, Spark, or Scala to work with data. Experience with databases used in Data Warehousing, Data Lakes, and Lakehouse setups. You know how to work with both structured ...

technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying ...

technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying ...

technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying ...

technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying ...

Linux system administration experience Preferred Qualifications: 7+ years of DevOps Engineering experience 4+ years of experience with coding and scripting (Python, SQL, Java, Scala, JavaScript, Golang, Bash, Perl or Ruby) 4+ years of experience with technologies Apache Mesos, Marathon, or Apache Spark 4+ years of experience using build and deployment ...

Linux system administration experience Preferred Qualifications: 7+ years of DevOps Engineering experience 4+ years of experience with coding and scripting (Python, SQL, Java, Scala, JavaScript, Golang, Bash, Perl or Ruby) 4+ years of experience with technologies Apache Mesos, Marathon, or Apache Spark 4+ years of experience using build and deployment ...