1 to 25 of 73 Scala Jobs

grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. ...

Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data engineering. Hands-on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect). Proven track record with data governance, quality ...

pipelines and data quality solutions using tools like Airflow, Luigi, or Azkaban. Codification: Translate intricate business logic into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across Cloud (Azure, AWS, GCP) and Big Data (Spark, Kafka) stacks. Collaboration: Work closely with business teams ...

with Big Data. Certification in data architecture or governance frameworks (e.g., TOGAF, DAMA, DCAM, EDMC). Experience of using programming languages such as Python, Scala and SQL Welsh language skills. Key Responsibilities (at a glance): Establish Data strategies and data modelling internally within the data estate Lead the design ...

with Big Data. Certification in data architecture or governance frameworks (e.g., TOGAF, DAMA, DCAM, EDMC). Experience of using programming languages such as Python, Scala and SQL Welsh language skills. Key Responsibilities (at a glance): Establish Data strategies and data modelling internally within the data estate Lead the design ...

degree in Computer Science, Data Engineering, Mathematics, or a related discipline Strong programming skills in languages such as Python, SQL, and Java or Scala Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) Expertise in building and maintaining ETL pipelines and data workflows Familiarity with cloud ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

scaling data platforms and pipelines Deep cloud experience (AWS, Azure, or GCP) Advanced SQL skills and experience with at least one backend language (Python, Scala, Java, etc.) Hands-on experience with data warehouses, ETL/ELT, and distributed systems A mindset focused on performance, reliability, automation, and scalability Confidence working ...

etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python, Java, Scala, Go ) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Indicium AI Fast-growing start-up organisation ...

cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills in Python, Java, or Scala for data engineering Experience with real-time/streaming data technologies, data Ingestion/ETL Deep knowledge of data transformation and ETL pipelines and APIs ...

deliver high-quality data solutions. Profile: Proven experience as a Data Engineer within a cloud-based environment. Strong technical capability in SQL, Python or Scala . Hands-on experience with Microsoft Fabric or other major cloud platforms (Azure, AWS or GCP). Strong understanding of data modelling, pipeline design ...

e.g. Power BI , Tableau ). Proficiency in Databricks Workflows , Delta Live Tables , and Spark for batch and streaming pipelines. Strong programming capability in Python , Scala , and/or SQL . Practical experience with at least one major cloud platform ( Azure , AWS , or GCP ), with a good understanding of how Databricks ...

Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.* Hands ...

Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.* Hands ...

Expertise in data modelling (Kimball, Data Vault, 3NF) Experience integrating Databricks platforms with Power BI/Tableau Strong coding skills in Python, SQL, or Scala Experience across Azure, AWS, or GCP ecosystems Nice to Have Exposure to Databricks governance tooling (Unity Catalogue/Purview) Experience with ML/AI workloads ...

continuous improvement by evaluating new tools, frameworks and approaches. The ideal Data Engineer will have: Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing ...

office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking ...

plus) Proficiency in AWS Glue, Qlik Talend, DBT, Airflow, and modern data integration tools. Excellent knowledge of Python, SQL, PowerQuery (M), and preferably Scala or PySpark Working knowledge with enterprise architecture frameworks (e.g., TOGAF), MLOps, and BI tools like Power BI and QuickSight Experience of generative AI platforms (e.g., Amazon ...

Background in robotics, CV, or autonomous systems. Technical Self-Assessment (1-10) Candidates will be asked to rate their knowledge of: Languages: Python, Java, Scala Compute/Distributed: RAY , Spark, Databricks, Hadoop Orchestration/Cloud: Kafka, Airflow, Prefect, AWS Storage/Warehouse: Clickhouse, Snowflake, Redshift, Greenplum Note: Experience with Petabyte ...

team quality Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using Python and SQL Experience working ...

Solid experience with Databricks (Azure or AWS) Good understanding of tools like Delta Lake, Unity Catalog, MLflow Strong SQL and Spark (Python or Scala) Experience working with data pipelines and modern data platforms A good grasp of data modelling, warehousing, and general data engineering principles Someone who's comfortable ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...