1 to 25 of 70 Scala Jobs in England

grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. ...

Spark, Flink, Hadoop). Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services. Strong programming skills in Python, Java, or Scala for data engineering. Hands-on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect). Proven track record with data governance, quality ...

pipelines and data quality solutions using tools like Airflow, Luigi, or Azkaban. Codification: Translate intricate business logic into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across Cloud (Azure, AWS, GCP) and Big Data (Spark, Kafka) stacks. Collaboration: Work closely with business teams ...

with technologies such as Apache Beam, Pub/Sub, Redis , and other large-scale data processing frameworks. Expertise in backend development with Python and Scala ; knowledge of Node.js or Golang is a plus. Proficient with both SQL and NoSQL databases, and experience with data warehousing solutions. Demonstrated experience building robust ...

/Azure/GCP), Docker, Kubernetes, CI/CD Skills & Experience Experience as a Data Engineer/Big Data Engineer Strong coding in Python, Scala or Java Hands-on with Spark, Kafka, ETL/data pipelines Knowledge of cloud platforms (AWS, Azure or GCP) Familiar with Agile and software engineering ...

degree in Computer Science, Data Engineering, Mathematics, or a related discipline Strong programming skills in languages such as Python, SQL, and Java or Scala Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) Expertise in building and maintaining ETL pipelines and data workflows Familiarity with cloud ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

Interest in AI, machine learning, and data-driven tools Desired Skills · Experience with Databricks and DBT · Experience with other programming languages (C++, SAS, R, Scala, etc.) · Intellectually curious and with a passion for continuous learning · Experience working within an Agile environment · Has numerical and analytical skills Preferred Qualifications · A degree ...

/Azure/GCP), Docker, Kubernetes, CI/CD Skills & Experience Experience as a Data Engineer/Big Data Engineer Strong coding in Python, Scala or Java Hands-on with Spark, Kafka, ETL/data pipelines Knowledge of cloud platforms (AWS, Azure or GCP) Familiar with Agile and software engineering ...

etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python, Java, Scala, Go ) Pragmatic approach to solving problems Nice to have: keen interest in modern AI/ML techniques Why Indicium AI Fast-growing start-up organisation ...

cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills in Python, Java, or Scala for data engineering Experience with real-time/streaming data technologies, data Ingestion/ETL Deep knowledge of data transformation and ETL pipelines and APIs ...

deliver high-quality data solutions. Profile: Proven experience as a Data Engineer within a cloud-based environment. Strong technical capability in SQL, Python or Scala . Hands-on experience with Microsoft Fabric or other major cloud platforms (Azure, AWS or GCP). Strong understanding of data modelling, pipeline design ...

e.g. Power BI , Tableau ). Proficiency in Databricks Workflows , Delta Live Tables , and Spark for batch and streaming pipelines. Strong programming capability in Python , Scala , and/or SQL . Practical experience with at least one major cloud platform ( Azure , AWS , or GCP ), with a good understanding of how Databricks ...

Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience integrating Lakehouse architectures with BI tools such as Power BI and Tableau.* Hands ...

CAVU. Qualifications & Experience Strong experience with medallion architecture and Databricks Proficiency with ETL tools (e.g., Rivery) and ML-Ops frameworks Strong programming skills (Python, Scala or Java) Experience with cloud platforms (AWS, Azure, or GCP) Excellent communication skills with the ability to bring clarity to complexity Proven ability to anticipate ...

continuous improvement by evaluating new tools, frameworks and approaches. The ideal Data Engineer will have: Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing ...

office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta ...

production-grade data solutions. Ensure pipelines are production-ready, well-documented, and ready for business-as-usual handover. Required Skills & Qualifications: Proficient in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong hands-on experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/ ...

Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking ...

plus) Proficiency in AWS Glue, Qlik Talend, DBT, Airflow, and modern data integration tools. Excellent knowledge of Python, SQL, PowerQuery (M), and preferably Scala or PySpark Working knowledge with enterprise architecture frameworks (e.g., TOGAF), MLOps, and BI tools like Power BI and QuickSight Experience of generative AI platforms (e.g., Amazon ...

team quality Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using Python and SQL Experience working ...

Solid experience with Databricks (Azure or AWS) Good understanding of tools like Delta Lake, Unity Catalog, MLflow Strong SQL and Spark (Python or Scala) Experience working with data pipelines and modern data platforms A good grasp of data modelling, warehousing, and general data engineering principles Someone who's comfortable ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...

expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes ...

experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. What's on Offer: Generous annual leave Private medical insurance Wellbeing support ...