1 to 25 of 120 Scala Jobs

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure ...

larger initiatives What You'll Bring Technical Expertise: Strong SQL—comfortable with complex transformations, performance tuning and warehouse-specific dialect Strong Python skills (or Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent ...

Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong experience with modern programming languages such as Python, Java, Scala & Pyspark. Expertise in Data Storage Technologies: In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift ...

Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting, and AWS CLI. (Preferred) Great background in building and managing AWS platforms for analytics and data lake workloads, including application ...

technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures ...

software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling tools such as ERwin, ER/Studio, PowerDesigner ...

Advanced proficiency in SQL, including optimisation and performance tuning Strong experience with ETL/ELT pipelines and data transformation frameworks Programming capability in Python, Scala or Java for data processing Deep understanding of data warehousing concepts and best practices Experience designing and maintaining reliable, production-grade data pipelines Ability ...

s.Strong proficiency in SQL for data manipulation, querying, and optimizatio n.Expertise in at least one programming language commonly used in data engineering, preferably Python. Scala or Java is a plu s.Solid understanding of data warehousing concepts, data modeling techniques (dimensional modeling, Kimball, Inmon), and ETL/ELT processe s.Experience with ...

Strong understanding of ethical data usage in regulated environments CRITICAL COMPETENCIES – TECHNICAL FIT Essential: Strong SQL skills Programming experience with Python and/or Scala Hands-on experience with Azure-based data platforms Experience designing, building, and maintaining data pipelines Strong understanding of data modelling (relational and analytical), including medallion ...

this role. Essential qualifications: • You should have hands-on experience with cloud platforms such as AWS, Azure or GCP. • Strong proficiency in Python, SQL, Scala, Spark-SQL, JavaScript or PowerShell. • Proven ability to design and build data pipelines and workflow solutions. • Experience with data tools such as Databricks, Spark, Kafka ...

flows and engineering processes for transparency and knowledge sharing. Skills & Experience Programming & Data Technologies Proficiency in Java and SQL . Experience with C# and Scala is a plus. Familiarity with ETL tools and big data platforms. Knowledge of data modelling, replication, and query optimization. Experience with SQL and NoSQL databases. ...

Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake ...

lakehouse architecture, schema design, and GDPR-compliant solutions Working knowledge of DevOps tools and CI/CD processes Bonus Points For Development experience in Scala or Java Familiarity with Cloudera, Hadoop, HIVE, and Spark ecosystem Understanding of data privacy regulations, including GDPR, and experience working with sensitive data Ability ...

product roadmap. What we look for: 6+ years experience in data engineering, data platforms & analytics, or software engineering Comfortable writing code in either Python, Scala, JavaScript/TypeScript, and modern frameworks Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep ...

resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication ...

experience in Data Engineering - Experience building modern data pipelines and distributed data platforms - Knowledge of AWS, Azure or GCP - Experience with Python, Java or Scala - Exposure to technologies such as Spark, Kafka, Airflow, dbt or Hadoop - Strong analytical and problem-solving skills - Excellent communication and stakeholder management - An entrepreneurial mindset ...

Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

Engineer, Software Architect, or similar senior technical role. Strong server-side software engineering experience, with flexibility across programming languages such as Python, Java, Go, Scala, C#, or similar. Experience designing and building distributed data services or large-scale backend platforms. Experience with Apache Spark, Apache DataFusion, Trino, Presto, or similar ...

solutions Support internal capability development by sharing your expertise and experience What We’re Looking For Strong hands-on experience with Python, Java, or Scala Proficiency in AWS cloud environments and big data tech (Spark, Hadoop, Airflow) Solid understanding of SQL, ETL/ELT approaches, and data modelling techniques Experience ...

engineering solutions. Support and mentor junior engineers, contributing to knowledge sharing across the team. What We’re Looking For Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka ...

Product/Business). Provide excellent customer support and troubleshoot issues. Core Requirements 5+ years in enterprise-level cloud design. Hands on experience with Scala Hands-on experience with container technologies (Kubernetes, Docker, Rancher). Strong experience in setting up and maintaining CI/CD pipelines. Integration experience with ...

including hands‐off expertise with sophisticated proofs‐of‐concept and public cloud platform(s). Coding expertise in a core programming language (Python, Java, Scala). Foundational understanding of Apache Spark architecture is preferable; hands‐on skills will be advantageous. Key Notes for the role: Location for the role needs ...

Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working in agile and DevOps environments Experience in sensitive or regulated data environments is highly ...