1 to 25 of 164 Scala Jobs

s.Strong proficiency in SQL for data manipulation, querying, and optimizatio n.Expertise in at least one programming language commonly used in data engineering, preferably Python. Scala or Java is a plu s.Solid understanding of data warehousing concepts, data modeling techniques (dimensional modeling, Kimball, Inmon), and ETL/ELT processe s.Experience with ...

Advanced proficiency in SQL, including optimisation and performance tuning Strong experience with ETL/ELT pipelines and data transformation frameworks Programming capability in Python, Scala or Java for data processing Deep understanding of data warehousing concepts and best practices Experience designing and maintaining reliable, production-grade data pipelines Ability ...

mentor other engineers as a senior technical contributor Preferred/Nice-to-Have Skills: Agentic AI frameworks: LangGraph, LangChain, A2A Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake ...

Experience building or improving medallion architecture, including Bronze, Silver and Gold data layers. Strong SQL skills for transformation, validation and data analysis. Python or Scala experience for data engineering, automation or scripting. Experience extracting, ingesting and integrating data from APIs. Good understanding of data quality, data controls and reliability within ...

Bachelor's degree in computer science, engineering, or related fields Over 5 years of experience with data, machine learning and python, typescript, Java, or Scala Previous experience at a product company building SaaS platforms is highly desirable Expert in designing data stores (relational, NoSQL, blob storage & vector) Experience with Azure ...

data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active SC Clearance (must be valid) 5 years continuous UK residency Ability to attend London office 1 day per week Why Apply? Competitive ...

office environment with regular social and charity events And Much More!!! DATA ENGINEER - ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta ...

Advanced knowledge of database technologies such as Microsoft SQL Server, Oracle, or NoSQL databases Advanced knowledge of multiple programming languages, such as Python, SQL, Scala, or similar Advanced knowledge of IT infrastructure standards and tools, such as application performance monitoring, IT service management, or DevOps software Bachelor's degree ...

Advanced knowledge of database technologies such as Microsoft SQL Server, Oracle, or NoSQL databases Advanced knowledge of multiple programming languages, such as Python, SQL, Scala, or similar Advanced knowledge of IT infrastructure standards and tools, such as application performance monitoring, IT service management, or DevOps software Bachelor's degree ...

Advanced knowledge of database technologies such as Microsoft SQL Server, Oracle, or NoSQL databases Advanced knowledge of multiple programming languages, such as Python, SQL, Scala, or similar Advanced knowledge of IT infrastructure standards and tools, such as application performance monitoring, IT service management, or DevOps software Bachelor's degree ...

design with implementation. Experience building RESTful and/or gRPC services to facilitate communication between distributed components. Proficient in at least one programming language: Scala, Java, Go, or Python. Familiar with AWS, CI/CD pipelines, and Kubernetes. Proficient in observability and data tools (Datadog, Splunk, Grafana, Databricks) to monitor ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking ...

environment. Validated knowledge of operating large-scale high-availability backend services and JVM services Expertise in functional programming patterns and experience building RESTful services (Scala APIs) Understanding of async programming models (events, callbacks, promises, async/await) and threading/concurrency Strong grasp of computer science fundamentals (data structures, algorithms ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) Secondary skills API-based Data ...

expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes ...

Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working in agile and DevOps environments Experience in sensitive or regulated data environments is highly ...

least 1 year of experience working with AWS At least 1 year of experience managing people At least 5 years' experience in Python, Scala, or R for large scale data analysis At least 5 years' experience with machine learning Capital One will consider sponsoring a new qualified applicant for employment ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services ...

Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services) Secondary s click apply ...

Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office a minimum of two days ...

Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Mandatory Required Skills Python/PySpark/Scala, SQL and data warehousing concepts Preferred/Desired Skills Design and build data pipelines (ETL/ELT) Manage data infrastructure (databases, lakes, warehouses) Handle large ...

Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilise programming expertise in Python, Scala, and SQL for efficient data processing. Build data pipelines using cloud-native services on AWS, including Lambda, Glue, Redshift, and API Gateway. Monitor and optimise ...

long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse Analytics, and/ ...