26 to 29 of 29 Apache Spark Jobs in Scotland

based systems, summarization/extraction pipelines, chat/coplay experiences, and tool-using agents. Proven experience working with large datasets and distributed compute (Spark/Databricks or equivalent), with SQL fluency and an understanding of partitioning, performance, and cost. Hands-on experience using enterprise-authorized AI-assisted software development … Application Resiliency, and Security. Preferred Qualifications, Capabilities, And Skills Production experience with Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Jobs) and workflow orchestration with Apache Airflow. Experience with evaluation frameworks and approaches (golden datasets, LLM-as-judge, human-in-the-loop review, red teaming). Solid grounding in data ...

Software Engineer you must have the following essential skills: Strong hands-on experience building data pipelines and streaming solutions using Python, PySpark, Spark Structured Streaming, or similar technologies. Solid understanding of distributed data processing concepts, including event ordering, partitioning, consumer groups, stateful processing, and delivery guarantees. Experience working with … resilience, observability, recovery, and data quality. Some other highly valued skills may include: Experience with Databricks or similar modern data engineering platforms. Proficiency in Spark SQL or similar technologies for large-scale data transformation and querying. Good working knowledge of Java, Scala, or other languages commonly used in distributed ...

Hands‐on experience in system design, application development, testing, and operational stability Proficient in coding in one or more languages such as Java or Spark Experience developing, debugging, and maintaining code in a large corporate environment with modern programming and database querying languages Knowledge of the Software Development Life … within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile) Ability to solve data‐oriented problems using technologies such as SQL, Relational DB, Spark, NoSQL, optimizing for performance Preferred Qualifications, Capabilities, and Skills Experience with Spark performance tuning of complex calculations on large datasets Experience delivering production ...

within a technical discipline (e.g., cloud, AI, machine learning, mobile). Ability to solve data‐oriented problems using technologies such as SQL, relational databases, Spark, and NoSQL. Preferred Qualifications, Capabilities, and Skills Additional formal training or certification in software engineering concepts. Exposure to AI tools and technologies for software … development. Experience with Spark performance tuning for complex calculations on large datasets. Experience delivering production changes to complex software using Scala and Spark. If you’re ready to lead, innovate, and make an impact, we invite you to join our team and shape the future of finance technology with ...