2 Apache Spark Jobs in Northern Ireland

design, and ensuring low-latency, high-quality decisioning. Architect, deploy, and optimize Databricks solutions on AWS for streamlined data operations and enhanced deployments. Utilize Spark, Java, Python, Databricks, Tecton, and AWS services (S3, Redshift, EMR, Athena, Glue) for data processing implementations. Coach and mentor team members, fostering growth and … processing systems. Deep knowledge of data processing, comfortable with multi-terabyte datasets, skilled in high-scale data ingestion, transformation, and distributed processing, particularly with Apache Spark or Databricks. Proficient in building low-latency, high-availability data stores for real-time or near-real-time processing, using Python, Scala … Java, or JavaScript/TypeScript, as well as SQL and NoSQL for data retrieval. Hands-on expertise in data technologies including Spark, Airflow, Databricks, AWS services (SQS, Kinesis, etc.), and Kafka, with a knack for recommending tailored architectural solutions. Keen awareness of the latest trends in Data, ML, and more »

REMOTE BASED WITH VERY OCCASIONAL TRAVEL TO CLIENT SITES AND OFFICE. Would you like to the opportunity to expand your skillset across Java, Python, Spark, Hadoop, Trino & Airflow across the Banking & Financial Services industries? How about if you worked with an Innovation Partner of the Year Winner (2023 Oracle … date with the latest trends and best practices, and share knowledge with the team. Qualifications You will have expertise within the following: Java, Python, Spark, Hadoop (Essential) Trino, Airflow (Desirable) Architecture and capabilities. Designing and implementing complex solutions with a focus on scalability and security. Excellent communication and collaboration more »