12 of 12 Apache Spark Jobs in Lanarkshire

large-scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data quality, security, and lineage ...

automated unit testing.Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and SecurityKnowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc.Excellent troubleshooting, analytical, and communication skills.Preferred qualifications, capabilities, and skillsExperience in Data pipelines using SparkExposure to AWS & Databricks Platform administration.Knowledge of containerization (Docker ...

Terraform development and understanding of Terraform enterprise.Experience in delivering system design, application development, testing, and operational stability.Knowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc.Excellent troubleshooting, analytical, and communication skills.Preferred Qualifications, Capabilities, and Skills:Multi Region disaster recovery setup, monitoring and testing.Experience in Data pipelines using ...

secure handling of inputs/outputs, and adherence to resiliency and security expectationsPreferred qualifications, capabilities, and skillsExperience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open-source frameworksFamiliarity with AWS-native data services such as Glue, Lake Formation, Redshift, or AthenaExposure to data governance practices ...

MLOps/LLMOps principles, including CI/CD for ML, model monitoring, and governance frameworks.Proficiency with large-scale data processing and storage technologies (SQL, Spark, Hadoop) is a plus.Excellent stakeholder management and communication skills, with proven ability to translate complex AI concepts for diverse audiences.You can understand client challenges ...

action and escalation proceduresExperience using analytical tools for data exploration, analysis, and visualizationSome other highly valued skills may include;Experience coding in SQL, Scala, Spark, Python, etcAppreciation of financial crime, AML, and transaction monitoring/detection systems and processes, including AML and terrorist financing trends and typologiesExcellent verbal ...

environmentFocus on delivering secure and scalable solutionsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration ...

every move, grounded in our firm’s values – purposefully driven, actively curious and candid but kind.We’re looking for people who want to contribute, spark fresh ideas and go beyond expectations. People who want to be able to proudly do what’s right, for the firm, our clients ...

leaders on safe scaling patterns and reuse.Preferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration ...

inclusive, collaborative teamworkStrong problem-solving and analytical skillsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeHands-on expertise with Spark/PySpark and big data processing technologiesKnowledge of open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks ...

within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile)Ability to solve data-oriented problems using technologies such as SQL, Relational DB, Spark, NoSQL, optimizing for performancePreferred Qualifications, Capabilities, and Skills:Experience with Spark performance tuning of complex calculations on large datasetsExperience delivering production changes ...

corporate environmentHands-on experience in system design, application development, testing, and operational stabilityProficiency in coding in one or more languages such as Java or Spark, with experience developing, debugging, and maintaining codeKnowledge of modern programming and database querying languages, including SQL, relational databases, and NoSQLSolid understanding of agile methodologies … processes within a technical discipline (e.g., cloud, AI, machine learning, mobile)Ability to solve data-oriented problems using technologies such as SQL, relational databases, Spark, and NoSQLHands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation ...