1 to 25 of 182 Scala Jobs

cost efficiency. Implement data quality controls, validation processes, and monitoring solutions. Data Transformation & Processing Develop complex data transformation logic using Spark (PySpark or Scala). Build data cleansing, enrichment, aggregation, and processing solutions. Ensure data accuracy, consistency, and reliability throughout the data life cycle. Azure Databricks Development Develop and support ...

ongoing operation, observability and resilience of production data platforms. Skills Required Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. Hands on experience building and operating large scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience ...

ongoing operation, observability and resilience of production data platforms. Skills Required Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. Hands on experience building and operating large scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience ...

ongoing operation, observability and resilience of production data platforms. Skills Required Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. Hands on experience building and operating large scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience ...

resilience of production data platforms.\n Skills Required \n \n Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. \nHands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop).Experience designing ...

resilience of production data platforms.\n Skills Required \n \n Experience in data engineering using modern programming languages such as Python, Java or Scala, and SQL. \nHands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop).Experience designing ...

larger initiatives What You'll Bring Technical Expertise: Strong SQL—comfortable with complex transformations, performance tuning and warehouse-specific dialect Strong Python skills (or Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent ...

Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data engineering. Hands-on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect). Proven track record with data governance, quality ...

Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong experience with modern programming languages such as Python, Java, Scala & Pyspark. Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift ...

This includes proficiency in Python and other languages (eg Typescript etc Go, C#, Rust etc) Proficiency in at least one programming language (eg Python, Scala etc) plus SQL . Proficiency in ML libraries (e.g., TensorFlow, PyTorch, Hugging Face). Ability to set up and use APIs and integrate AI components ...

real-time data processing jobs. Your Skills: Hadoop Ecosystem: HDFS, Hive, Spark, MapReduce, YARN, HBase Data Integration: Sqoop, Kafka, Flume, NiFi Programming: Python, Scala, Java, Shell Scripting Databases: Oracle, SQL Server, MySQL, PostgreSQL Cloud: AWS, Azure, GCP Workflow Tools: Oozie, Airflow We are a Disability Confident Employer: Capgemini is proud ...

. Advanced SQL skills, including optimisation and performance tuning. Strong experience with ETL/ELT pipelines and data transformation frameworks. Programming proficiency in Python, Scala, or Java for data processing. Deep understanding of data warehousing concepts and best practices. Experience maintaining reliable, production-grade data pipelines. Excellent stakeholder management ...

lakehouse architecture, schema design, and GDPR-compliant solutions Working knowledge of DevOps tools and CI/CD processes Bonus Points For Development experience in Scala or Java Familiarity with Cloudera, Hadoop, HIVE, and Spark ecosystem Understanding of data privacy regulations, including GDPR, and experience working with sensitive data Ability ...

paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured ...

5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Docker ...

5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Docker ...

5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Docker ...

5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Docker ...

5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Docker ...

Engineer, Software Architect, or similar senior technical role. Strong server-side software engineering experience, with flexibility across programming languages such as Python, Java, Go, Scala, C#, or similar. Experience designing and building distributed data services or large-scale backend platforms. Experience with Apache Spark, Apache DataFusion, Trino, Presto, or similar ...

user stories and user journeys. Coaching and mentoring team members.\n MINIMUM (ESSENTIAL) REQUIREMENTS: \n \n Strong software development experience in one of Java, Scala, or Python \n Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks. Experience of developing substantial components for large ...

engineering solutions. Support and mentor junior engineers, contributing to knowledge sharing across the team. What We’re Looking For Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka ...

databases Excellent communication skills and comfort working in an Agile (Scrum/Kanban) environment Nice to Have Experience with JVM languages beyond Java (Kotlin, Scala, Groovy) Exposure to TypeScript or Node.js for a full‐stack context Background in system design and distributed systems Proficiency in Python for scripting or data ...

Experience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment) Proficient software development experience in one of Java, Scala, or Python Software development experience with data-processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools Expert in SQL or SQL extensions ...

with Cloud Experience with High Performance Compute (HPC) Preferred Qualifications: Knowledge and use of at least one common programming language: e.g., Python, Go, C++, Scala, Java, including toolchains for documentation, testing, and operations/observability Expertise in modern software development tools/ways of working (e.g. git/GitHub, devops ...