1 to 25 of 147 Scala Jobs

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong experience with modern programming languages such as Python, Java, Scala & Pyspark. Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift ...

Synapse), AWS (Redshift, Glue), or GCP (BigQuery, Dataflow). Experience contributing to cloud data architecture and technical solution design. Strong programming skills in Python, Scala, or Java. Advanced SQL skills, including optimisation and performance tuning. Experience building modern ETL/ELT pipelines and distributed data processing solutions. Strong understanding ...

Deep understanding of Quantexa components such as: Entity Resolution (ER), Scoring Framework, Contextual Network Generation, UI Configuration. Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch. Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable ...

Deep understanding of Quantexa components such as: Entity Resolution (ER) Scoring Framework Contextual Network Generation UI Configuration Strong background in Big Data technologies, including:Scala, Apache Spark, Hadoop, ElasticSearch Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable ...

Advanced proficiency in SQL, including optimisation and performance tuning Strong experience with ETL/ELT pipelines and data transformation frameworks Programming capability in Python, Scala or Java for data processing Deep understanding of data warehousing concepts and best practices Experience designing and maintaining reliable, production-grade data pipelines Ability ...

real-time data processing jobs. Your Skills: Hadoop Ecosystem: HDFS, Hive, Spark, MapReduce, YARN, HBase Data Integration: Sqoop, Kafka, Flume, NiFi Programming: Python, Scala, Java, Shell Scripting Databases: Oracle, SQL Server, MySQL, PostgreSQL Cloud: AWS, Azure, GCP Workflow Tools: Oozie, Airflow We are a Disability Confident Employer: Capgemini is proud ...

Strong experience with data warehousing, data lakes, and lakehouse architectures. Hands‐on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms ...

encourage the responsible use of approved AI tools and automation to improve collaboration and delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java with hands-on experience in Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Practical experience building real-time event streaming ...

consulting (or equivalent) experience required 7+ years Databricks solution design, implementation, engineering experience required Either 5+ years building data pipelines in Databricks using PySpark, Scala and/or Spark SQL and ability to work across structured, semi-structured and unstructured data OR 5+ years ML Engineering or AI Engineering deploying ...

Azure, or similar Infrastructure-as-code (Terraform, CloudFormation, etc.) Containerised deployments using Docker, ECS, Kubernetes, or equivalent Nice to Have Exposure to Scala or functional programming concepts Experience with asynchronous and highly concurrent backend frameworks (e.g. Ktor, http4k, Play, RxJava) NoSQL experience (DynamoDB, Cassandra, BigTable, Cosmos DB, etc.) Strong ...

flows and engineering processes for transparency and knowledge sharing. Skills & Experience Programming & Data Technologies Proficiency in Java and SQL . Experience with C# and Scala is a plus. Familiarity with ETL tools and big data platforms. Knowledge of data modelling, replication, and query optimization. Experience with SQL and NoSQL databases. ...

experience using AI-enabled tools responsibly to improve productivity while maintaining appropriate human oversight, governance, and solution quality. Bonus Points For Development experience using Scala or Java. Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems. Experience working with sensitive data and applying data privacy regulations, including GDPR. ...

Databricks product roadmap. What we look for: Extensive experience in data engineering, data platforms & analytics, or software engineering Comfortable writing code in either Python, Scala, JavaScript/TypeScript, and modern frameworks Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep ...

effective and responsible use of approved AI tools and automation to enhance collaboration and delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Experience building real-time event streaming solutions ...

What we look for: Experience in data engineering, data platforms & analytics, or software engineering/full stack development Comfortable writing code in either Python, Scala, JavaScript/TypeScript, and modern frameworks Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep ...

resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication ...

their reasoning capabilities Deep Databricks experience (DLT, Delta Lake, Unity Catalog governance) Solid grasp of streaming technologies (Spark Structured Streaming, Autoloader) Python, SQL, or Scala proficiency Experience with ETL/ELT, data modelling, and data architecture Azure cloud experience With a focus within Energy Trading, Oil & Gas, Financial Markets ...

code” tools such as Terraform, Salt or similar; 3+ years of significant professional experience developing applications written in a modern programming environment - preferably Scala/Java and/or Python; Professional experience across the entire software development life cycle, from gathering requirements to production deployment using CI & CD; Confident ...

. Advanced SQL skills, including optimisation and performance tuning. Strong experience with ETL/ELT pipelines and data transformation frameworks. Programming proficiency in Python, Scala, or Java for data processing. Deep understanding of data warehousing concepts and best practices. Experience maintaining reliable, production-grade data pipelines. Excellent stakeholder management ...

Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience with Microsoft Fabric Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake ...

quality code using a variety of languages and frameworks, including but not limited to: Java, C#/.NET, Python, TypeScript, JavaScript, React, Go, Ruby, Scala, R, and SQL Leveraged AI-assistive development tools for tasks like scaffolding, refactoring, debugging, test generation, and documentation Experience building or integrating AI/ ...

Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience working in a client-facing environment. A proactive approach with ...

working knowledge of Azure Data Factory for building complex ETL workflows Experience with performance optimization of data pipelines and distributed processing setups Proficiency in Scala development (hands‐on experience highly desirable) Solid understanding of Azure services relevant to data engineering and cloud architecture Strong problem‐solving ability with effective communication ...

product, a side project. You know the difference between that and maintaining what already exists Deep fundamentals in Python or a functional language like Scala Experience designing and building big data applications with stacks like Databricks, Apache Spark, HDFS, HBase, Snowflake Real command of test-driven development and code quality ...