1 to 25 of 143 Scala Jobs

diverse data sources, transformations, and targets. Strong experience scheduling and orchestrating pipelines using Airflow or similar tools. Programming & Databases: Advanced Python and/or Scala/Java skills and strong software engineering fundamentals (version control, CI, code reviews). Excellent SQL abilities, including performance tuning on large datasets. Big Data ...

grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. ...

pipelines and data quality solutions using tools like Airflow, Luigi, or Azkaban. Codification: Translate intricate business logic into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across Cloud (Azure, AWS, GCP) and Big Data (Spark, Kafka) stacks. Collaboration: Work closely with business teams ...

Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data engineering. Hands-on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect). Proven track record with data governance, quality ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

data pipelines Strong understanding of data quality, governance, and lineage Experience working in Agile/Scrum environments Good to Have Experience with Python or Scala for data validation Knowledge of CI/CD pipelines (Jenkins, Azure DevOps, GitHub Actions) Exposure to big data ecosystems and distributed processing Certifications in Databricks ...

degree in Computer Science, Data Engineering, Mathematics, or a related discipline Strong programming skills in languages such as Python, SQL, and Java or Scala Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) Expertise in building and maintaining ETL pipelines and data workflows Familiarity with cloud ...

with technologies such as Apache Beam, Pub/Sub, Redis , and other large-scale data processing frameworks. Expertise in backend development with Python and Scala ; knowledge of Node.js or Golang is a plus. Proficient with both SQL and NoSQL databases, and experience with data warehousing solutions. Demonstrated experience building robust ...

etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python, Java, Scala, Go ) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Indicium AI Fast-growing start-up organisation ...

Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.* Hands ...

Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.* Hands ...

cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills in Python, Java, or Scala for data engineering Experience with real-time/streaming data technologies, data Ingestion/ETL Deep knowledge of data transformation and ETL pipelines and APIs ...

/Azure/GCP), Docker, Kubernetes, CI/CD Skills & Experience Experience as a Data Engineer/Big Data Engineer Strong coding in Python, Scala or Java Hands-on with Spark, Kafka, ETL/data pipelines Knowledge of cloud platforms (AWS, Azure or GCP) Familiar with Agile and software engineering ...

cloud-native tools and CI/CD platforms to maintain secure, observable, and high-performing environments. Relevant Skills: Essential Skills: Proficiency in Python or Scala for data processing Strong SQL skills for querying and managing relational databases Experience with AWS services including S3, Glue, Redshift, Lambda, and Athena Knowledge ...

office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta ...

e.g. Power BI , Tableau ). Proficiency in Databricks Workflows , Delta Live Tables , and Spark for batch and streaming pipelines. Strong programming capability in Python , Scala , and/or SQL . Practical experience with at least one major cloud platform ( Azure , AWS , or GCP ), with a good understanding of how Databricks ...

data science and AI initiatives • Collaborating with cross-functional teams to deliver data solutions Essential skills • Strong experience in data engineering (SQL, Python, or Scala) • Hands-on experience with Microsoft Fabric or similar cloud platforms (Azure, AWS, GCP) • Solid understanding of data modelling and pipeline design • Experience with data visualisation ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking ...

production-grade data solutions. Ensure pipelines are production-ready, well-documented, and ready for business-as-usual handover. Required Skills & Qualifications: Proficient in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong hands-on experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/ ...

plus) Proficiency in AWS Glue, Qlik Talend, DBT, Airflow, and modern data integration tools. Excellent knowledge of Python, SQL, PowerQuery (M), and preferably Scala or PySpark Working knowledge with enterprise architecture frameworks (e.g., TOGAF), MLOps, and BI tools like Power BI and QuickSight Experience of generative AI platforms (e.g., Amazon ...

modern data platforms Data modelling experience (e.g. 3NF, dimensional, or similar approaches) Experience with reporting/visualisation tools Programming in Python, SQL, or Scala Exposure to at least one major cloud platform (Azure, AWS, or GCP) Nice to Have Exposure to data governance or cataloguing tools Experience with ML/ ...

expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes ...

Solid experience with Databricks (Azure or AWS) Good understanding of tools like Delta Lake, Unity Catalog, MLflow Strong SQL and Spark (Python or Scala) Experience working with data pipelines and modern data platforms A good grasp of data modelling, warehousing, and general data engineering principles Someone who's comfortable ...

stakeholder management skills. Bonus Points for: Previous experience in a consultancy environment . Hands-on coding experience in additional languages like Python, Ruby, Scala, PHP, or C++ . Whats in It for You? At Ten10, we believe in recognizing and rewarding great work. Heres what you can expect: 25 Days ...

supporting Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions Direct contact with customers/end-users on the phone and by email ...