1 to 25 of 84 Scala Jobs

grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. ...

pipelines and data quality solutions using tools like Airflow, Luigi, or Azkaban. Codification: Translate intricate business logic into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across Cloud (Azure, AWS, GCP) and Big Data (Spark, Kafka) stacks. Collaboration: Work closely with business teams ...

with Big Data. Certification in data architecture or governance frameworks (e.g., TOGAF, DAMA, DCAM, EDMC). Experience of using programming languages such as Python, Scala and SQL Welsh language skills. Key Responsibilities (at a glance): Establish Data strategies and data modelling internally within the data estate Lead the design ...

with Big Data. Certification in data architecture or governance frameworks (e.g., TOGAF, DAMA, DCAM, EDMC). Experience of using programming languages such as Python, Scala and SQL Welsh language skills. Key Responsibilities (at a glance): Establish Data strategies and data modelling internally within the data estate Lead the design ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

delivery teams Key Requirements: Proven experience as a Palantir Data Engineer , Data Engineer, or similar role Strong software development experience in Python, Java, or Scala Experience with cloud data platforms such as AWS, Azure, GCP, or Databricks Proficiency in SQL , including analytical query extensions Strong understanding of ETL/ ...

etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python, Java, Scala, Go ) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Indicium AI Fast-growing start-up organisation ...

cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills in Python, Java, or Scala for data engineering Experience with real-time/streaming data technologies, data Ingestion/ETL Deep knowledge of data transformation and ETL pipelines and APIs ...

e.g. Power BI , Tableau ). Proficiency in Databricks Workflows , Delta Live Tables , and Spark for batch and streaming pipelines. Strong programming capability in Python , Scala , and/or SQL . Practical experience with at least one major cloud platform ( Azure , AWS , or GCP ), with a good understanding of how Databricks ...

Spark, PySpark, Delta Lake, and Databricks workflows. * Experience building scalable ETL/ELT pipelines, including Delta Live Tables. * Strong programming skills in Python, Scala, or SQL. * Solid understanding of data modelling (3NF, Kimball, Data Vault). * Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau. * Hands ...

Spark, PySpark, Delta Lake, and Databricks workflows. * Experience building scalable ETL/ELT pipelines, including Delta Live Tables. * Strong programming skills in Python, Scala, or SQL. * Solid understanding of data modelling (3NF, Kimball, Data Vault). * Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau. * Hands ...

continuous improvement by evaluating new tools, frameworks and approaches. The ideal Data Engineer will have: Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands‐on experience with Azure, AWS or GCP (storage, compute, networking ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking ...

minimum 2 years in Ops or DevOps experience in trading environments, with expertise in large-scale distributed systems; recent work in Java, Go, or Scala is preferred. Hands-on experience with container orchestration (Kubernetes, Docker, etc.) and cloud infrastructure, especially AWS; familiarity with Infrastructure-as-Code tools like Terraform ...

Background in robotics, CV, or autonomous systems. Technical Self-Assessment (1-10) Candidates will be asked to rate their knowledge of: Languages: Python, Java, Scala Compute/Distributed: RAY , Spark, Databricks, Hadoop Orchestration/Cloud: Kafka, Airflow, Prefect, AWS Storage/Warehouse: Clickhouse, Snowflake, Redshift, Greenplum Note: Experience with Petabyte ...

Solid experience with Databricks (Azure or AWS) Good understanding of tools like Delta Lake, Unity Catalog, MLflow Strong SQL and Spark (Python or Scala) Experience working with data pipelines and modern data platforms A good grasp of data modelling, warehousing, and general data engineering principles Someone who's comfortable ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...

expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...

hybrid work model (minimum 3 days in our Cheadle office) Nice-to-Have Skills Prior exposure to F# or other functional languages (e.g., Haskell, Scala). Hands-on experience with Event Sourcing and CQRS (or similar event-driven architectures) in production environments. Experience with cloud platforms, primarily GCP (Google Cloud ...

least 1 year of experience working with AWS At least 1 year of experience managing people At least 5 years' experience in Python, Scala, or R for large scale data analysis At least 5 years' experience with machine learning Capital One will consider sponsoring a new qualified applicant for employment ...

Engineering, or Mathematics), or PhD in "STEM" field (Science, Technology, Engineering, or Mathematics) Experience working with AWS At least 2 years' experience in Python, Scala, or R At least 2 years' experience with machine learning At least 2 years' experience with SQL Prior experience in AI, information retrieval ...

Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office a minimum of two days ...