76 to 81 of 81 Apache Spark Jobs in the UK

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey ...

solving complex challenges and improving data quality as the platform scales. The environment is modern and cloud based, with exposure to technologies such as Spark, Snowflake and BigQuery across AWS, GCP and Azure. You will have the opportunity to support and mentor other engineers, contribute to engineering standards … engineers What We Are Looking For Proven Python and SQL experience within production environments Experience delivering data transformation projects end to end Experience with Spark, Snowflake, BigQuery or similar technologies Solid experience working with AWS, GCP or Azure Comfortable working with complex, imperfect datasets Experience owning solutions from design ...

time inference systems with low latency and high throughput Partner with data engineers to integrate ML workflows into wider data platforms and infrastructure, including Spark and Databricks Implement model monitoring, drift detection, alerting, and retraining strategies Optimise models for reliability and cost efficiency in AWS Prototype and evaluate … learning frameworks Experience creating & maintaining reproducible environments and familiarity with tools such as UV/docker Experience with MLflow or equivalent tooling Experience with Spark and distributed data processing Strong understanding of real-time ML systems and production inference patterns A strong engineering mindset, with a focus on reliability ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure ...

customers achieve more with the AWS cloud. BASIC QUALIFICATIONS - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in consulting, design and implementation of serverless distributed solutions - Experience in cloud based solution (AWS or equivalent), system, network and operating … Computer Science or related field, or experience working with or evaluating AI systems - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. ...