20 of 20 Apache Spark Jobs in Glasgow

large-scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data quality, security, and lineage ...

automated unit testing.Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and SecurityKnowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc.Excellent troubleshooting, analytical, and communication skills.Preferred qualifications, capabilities, and skillsExperience in Data pipelines using SparkExposure to AWS & Databricks Platform administration.Knowledge of containerization (Docker ...

Terraform development and understanding of Terraform enterprise.Experience in delivering system design, application development, testing, and operational stability.Knowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc.Excellent troubleshooting, analytical, and communication skills.Preferred Qualifications, Capabilities, and Skills:Multi Region disaster recovery setup, monitoring and testing.Experience in Data pipelines using ...

secure handling of inputs/outputs, and adherence to resiliency and security expectationsPreferred qualifications, capabilities, and skillsExperience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open-source frameworksFamiliarity with AWS-native data services such as Glue, Lake Formation, Redshift, or AthenaExposure to data governance practices ...

Security Groups, CloudFormation, RDS, DynamoDB and Redshift, including secure and well-governed implementations. Data engineering and pipelines, building efficient batch and streaming solutions using Apache Spark and AWS services, and working with large-scale datasets in enterprise environments. Demonstrated technical problem-solving capability, with the ability to rapidly ...

machine learning development (training and/or deploying models at scale). Outstanding programming skills in Python. Experience with distributed data processing frameworks (e.g., Spark). Experience with deep learning/NLP frameworks (e.g., PyTorch, Hugging Face). Solid understanding of software engineering principles and ML lifecycle practices (MLOps ...

Candidate Requirements Extensive experience building and deploying machine learning models in production, with strong hands‐on Python capability. Experience with distributed computing frameworks (e.g., Spark or similar) and scalable data processing environments. Exposure to cloud-based platforms (e.g., AWS, Azure, GCP or Databricks) and modern ML/MLOps practices. ...

essential: Background in financial services or regulated environments. Exposure to financial crime domains such as fraud, AML or sanctions. Experience with Spark or PySpark. Familiarity with AWS cloud services and data platforms. You will be assessed on key capabilities relevant to the role, including risk and controls, change ...

action and escalation proceduresExperience using analytical tools for data exploration, analysis, and visualizationSome other highly valued skills may include;Experience coding in SQL, Scala, Spark, Python, etcAppreciation of financial crime, AML, and transaction monitoring/detection systems and processes, including AML and terrorist financing trends and typologiesExcellent verbal ...

scaling patterns and reuse. Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

environmentFocus on delivering secure and scalable solutionsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration ...

leaders on safe scaling patterns and reuse.Preferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration ...

unit testing. Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security Knowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc. Excellent troubleshooting, analytical, and communication skills. Preferred qualifications, capabilities, and skills Experience in Data pipelines using Spark Exposure ...

inclusive, collaborative teamworkStrong problem-solving and analytical skillsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeHands-on expertise with Spark/PySpark and big data processing technologiesKnowledge of open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks ...

problem-solving and analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with ...

Hands‐on experience in system design, application development, testing, and operational stability Proficient in coding in one or more languages such as Java or Spark Experience developing, debugging, and maintaining code in a large corporate environment with modern programming and database querying languages Knowledge of the Software Development Life … within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile) Ability to solve data‐oriented problems using technologies such as SQL, Relational DB, Spark, NoSQL, optimizing for performance Preferred Qualifications, Capabilities, and Skills Experience with Spark performance tuning of complex calculations on large datasets Experience delivering production ...

within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile)Ability to solve data-oriented problems using technologies such as SQL, Relational DB, Spark, NoSQL, optimizing for performancePreferred Qualifications, Capabilities, and Skills:Experience with Spark performance tuning of complex calculations on large datasetsExperience delivering production changes ...

within a technical discipline (e.g., cloud, AI, machine learning, mobile). Ability to solve data-oriented problems using technologies such as SQL, relational databases, Spark, and NoSQL. Preferred Qualifications, Capabilities, and Skills Additional formal training or certification in software engineering concepts. Exposure to AI tools and technologies for software … development. Experience with Spark performance tuning for complex calculations on large datasets. Experience delivering production changes to complex software using Scala and Spark. If you’re ready to lead, innovate, and make an impact, we invite you to join our team and shape the future of finance technology with ...

corporate environmentHands-on experience in system design, application development, testing, and operational stabilityProficiency in coding in one or more languages such as Java or Spark, with experience developing, debugging, and maintaining codeKnowledge of modern programming and database querying languages, including SQL, relational databases, and NoSQLSolid understanding of agile methodologies … processes within a technical discipline (e.g., cloud, AI, machine learning, mobile)Ability to solve data-oriented problems using technologies such as SQL, relational databases, Spark, and NoSQLHands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation ...