1 to 25 of 158 Scala Jobs

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

with NoSQL databases, such as MongoDB, Cassandra, or DynamoDB, and an understanding of their appropriate use cases. • Strong programming skills in Python, Java, or Scala, with experience in data processing frameworks (e.g., Apache Spark, Hadoop). • 3-5 years of experience with cloud platforms (AWS, Azure, GCP) and data services ...

mentor other engineers as a senior technical contributor Preferred/Nice-to-Have Skills: Agentic AI frameworks: LangGraph, LangChain, A2A Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark ...

with enterprise data management frameworks, such as Master Data Management (MDM) and metadata management. Advanced skills in programming and scripting languages (e.g., Python, Java, Scala) for developing and automating data workflows. Experience with real-time data processing and event-driven architectures, leveraging tools such as Apache Kafka, Spark Streaming. Requirements ...

with NoSQL databases, such as MongoDB, Cassandra, or DynamoDB, and an understanding of their appropriate use cases. • Strong programming skills in Python, Java, or Scala, with experience in data processing frameworks (e.g., Apache Spark, Hadoop). • Experience with cloud platforms (AWS, Azure, GCP) and data services, such as AWS Redshift ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

looking for Must have solid experience as a Senior/Lead Data Engineer in complex enterprise environments. Can demonstrate strong coding skills in Python (Scala or functional languages a plus). Expertise with Databricks, Apache Spark, and Snowflake is a must (HDFS/HBase also useful). Has experience integrating ...

Databricks). Platform architecture & engineering (ETL/ELT, modelling, warehousing). Cloud platforms (AWS, Azure, GCP). Programming (SQL essential, Python, Spark, Java/Scala). Data governance & security (including GDPR). Advanced analytics & AI/ML. Experience building and scaling enterprise data platforms and leading transformation at scale. What ...

etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python, Java, Scala, Go ) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Indicium AI Fast-growing start-up organisation ...

flows and engineering processes for transparency and knowledge sharing. Skills & Experience Programming & Data Technologies Proficiency in Java and SQL . Experience with C# and Scala is a plus. Familiarity with ETL tools and big data platforms. Knowledge of data modelling, replication, and query optimization. Experience with SQL and NoSQL databases. ...

stack & DataOps (Snowflake, Databricks)Platform architecture & engineering (ETL/ELT, modelling, warehousing)Cloud platforms (AWS, Azure, GCP)Programming (SQL essential, Python, Spark, Java/Scala)Data governance & security (including GDPR)Advanced analytics & AI/MLExperience building and scaling enterprise data platforms and leading transformation at scaleWhat ...

tools such as Databricks; Azure's Machine Learning and AI Services; AWS's SageMaker and Bedrock Experience programming in languages such as Python, R, Scala, SQL, JavaScript, C/C++, and Java Experience using libraries and frameworks such as TensorFlow, PyTorch, mpi4py, Spark ML/MLlib, Jupyter, h2o, keras ...

teams to deliver data-driven solutions Support data modelling, governance, and quality initiatives What were looking for Experience with Python, SQL, Spark (and ideally Scala) Hands-on delivery of ML solutions in production Exposure to cloud platforms (AWS, Azure, or GCP) Understanding of DevOps, containers, and Infrastructure-as-Code Strong ...

years of industry experience as a Data Engineer Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks Expertise developing in Python. Scala knowledge is a plus Good command of Apache Airflow for workflow orchestration Experience working in cloud environments, preferably GCP Strong hands-on experience with modern ...

years of industry experience as a Data Engineer Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks Expertise developing in Python. Scala knowledge is a plus Good command of Apache Airflow for workflow orchestration Experience working in cloud environments, preferably GCP Strong hands-on experience with modern ...

years of industry experience as a Data Engineer Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks Expertise developing in Python. Scala knowledge is a plus Good command of Apache Airflow for workflow orchestration Experience working in cloud environments, preferably GCP Strong hands-on experience with modern ...

years of industry experience as a Data Engineer Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks Expertise developing in Python. Scala knowledge is a plus Good command of Apache Airflow for workflow orchestration Experience working in cloud environments, preferably GCP Strong hands-on experience with modern ...

years of industry experience as a Data Engineer Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks Expertise developing in Python. Scala knowledge is a plus Good command of Apache Airflow for workflow orchestration Experience working in cloud environments, preferably GCP Strong hands-on experience with modern ...

years of industry experience as a Data Engineer Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks Expertise developing in Python. Scala knowledge is a plus Good command of Apache Airflow for workflow orchestration Experience working in cloud environments, preferably GCP Strong hands-on experience with modern ...

etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Software development experience with one or more languages (e.g. Python, Java, Scala, Go) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Indicium AI Fast-growing start-up organisation ...

Experience building or improving medallion architecture, including Bronze, Silver and Gold data layers. Strong SQL skills for transformation, validation and data analysis. Python or Scala experience for data engineering, automation or scripting. Experience extracting, ingesting and integrating data from APIs. Good understanding of data quality, data controls and reliability within ...

Bachelor's degree in computer science, engineering, or related fields Over 5 years of experience with data, machine learning and python, typescript, Java, or Scala Previous experience at a product company building SaaS platforms is highly desirable Expert in designing data stores (relational, NoSQL, blob storage & vector) Experience with Azure ...

resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication ...

deliver production-grade data solutions. Ensure pipelines are documented, production-ready, and transition smoothly to BAU operations. Required Skills & Qualifications: Proficiency in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Composer. ...

data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active SC Clearance (must be valid) 5 years continuous UK residency Ability to attend London office 1 day per week Why Apply? Competitive ...