1 to 25 of 85 Scala Jobs

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

larger initiatives What You'll Bring Technical Expertise: Strong SQL—comfortable with complex transformations, performance tuning and warehouse-specific dialect Strong Python skills (or Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent ...

Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong experience with modern programming languages such as Python, Java, Scala & Pyspark. Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift ...

Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting, and AWS CLI. (Preferred) Great background in building and managing AWS platforms for analytics and data lake workloads, including application ...

Strong understanding of ethical data usage in regulated environments CRITICAL COMPETENCIES – TECHNICAL FIT Essential: Strong SQL skills Programming experience with Python and/or Scala Hands-on experience with Azure-based data platforms Experience designing, building, and maintaining data pipelines Strong understanding of data modelling (relational and analytical), including medallion ...

Databricks). Platform architecture & engineering (ETL/ELT, modelling, warehousing). Cloud platforms (AWS, Azure, GCP). Programming (SQL essential, Python, Spark, Java/Scala). Data governance & security (including GDPR). Advanced analytics & AI/ML. Experience building and scaling enterprise data platforms and leading transformation at scale. What ...

this role. Essential qualifications: • You should have hands-on experience with cloud platforms such as AWS, Azure or GCP. • Strong proficiency in Python, SQL, Scala, Spark-SQL, JavaScript or PowerShell. • Proven ability to design and build data pipelines and workflow solutions. • Experience with data tools such as Databricks, Spark, Kafka ...

flows and engineering processes for transparency and knowledge sharing. Skills & Experience Programming & Data Technologies Proficiency in Java and SQL . Experience with C# and Scala is a plus. Familiarity with ETL tools and big data platforms. Knowledge of data modelling, replication, and query optimization. Experience with SQL and NoSQL databases. ...

data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active SC Clearance (must be valid) 5 years continuous UK residency Ability to attend London office 1 day per week Why Apply? Competitive ...

Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake ...

product roadmap. What we look for: 6+ years experience in data engineering, data platforms & analytics, or software engineering Comfortable writing code in either Python, Scala, JavaScript/TypeScript, and modern frameworks Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep ...

resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication ...

experience in Data Engineering - Experience building modern data pipelines and distributed data platforms - Knowledge of AWS, Azure or GCP - Experience with Python, Java or Scala - Exposure to technologies such as Spark, Kafka, Airflow, dbt or Hadoop - Strong analytical and problem-solving skills - Excellent communication and stakeholder management - An entrepreneurial mindset ...

Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

Engineer, Software Architect, or similar senior technical role. Strong server-side software engineering experience, with flexibility across programming languages such as Python, Java, Go, Scala, C#, or similar. Experience designing and building distributed data services or large-scale backend platforms. Experience with Apache Spark, Apache DataFusion, Trino, Presto, or similar ...

including hands‐off expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (Python, Java, Scala). Foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous. Key Notes for the role: Location for the role needs ...

Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working in agile and DevOps environments Experience in sensitive or regulated data environments is highly ...

hands‐on expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (i.e., Python, Java, Scala). A foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous for the role. We will be testing your ability ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) Secondary skills API-based Data ...

Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office a minimum of two days ...

Bring Technical Expertise: Strong proficiency in one or more of: Python, Java, Kotlin, Go, C#/.NET, TypeScript/Node, Ruby, PHP, Scala, Rust Hands-on experience with modern frameworks (Spring, .NET, Django, FastAPI, Rails, Express/NestJS, Laravel, React, Vue, Next.js, Angular or equivalent) Solid grounding in REST ...

/or Microsoft SQL Server) Desirable skills: •Identity & access management tools (PingDS, PingIDM, HAProxy) •Infrastructure as Code (Terraform) •Testing tools (Karate, Playwright, Gatling/Scala) #LI-MW2 Together, as owners, let's turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) Secondary s click apply ...