126 to 138 of 138 Apache Spark Jobs in the UK excluding London

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/… pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/… pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

such as Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS … such as Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS ...

Senior Data Scientist - Python/Machine Learning Permanent Location: UK - Remote Salary: £65,000 - £70,000 (+ benefits) Skills: Python, Machine Learning, Statistical Modelling, AWS, Data Engineering An exciting opportunity has arisen for an experienced ...

Kafka Connect, Schema Registry, Cluster Linking and ksqlDB. Other highly valued skills may include Experience with streaming technologies such as Kafka Streams, Flink or Spark Streaming. Experience working with cloud-native technologies and Kubernetes-based platforms in enterprise environments. Effective collaboration, communication and problem-solving skills, with the ability ...

CoreWeave is The Essential Cloud for AITM. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI ...

team capability growth and development. What We’re Looking For Experience as a Data Engineer with strong skills in areas such as Python, NumPy, Spark and Apache Pig. Proven experience in designing, developing and deploying scalable systems. Familiarity with CI/CD, containerisation, deployment technologies and cloud platforms ...

team capability growth and development. What We’re Looking For Experience as a Data Engineer with strong skills in areas such as Python, NumPy, Spark and Apache Pig. Proven experience in designing, developing and deploying scalable systems. Familiarity with CI/CD, containerisation, deployment technologies and cloud platforms ...

driving delivery across complex engagements. Key Responsibilities Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures Provide technical leadership across Databricks, Spark and cloud data platforms Drive delivery of data engineering workstreams within Agile programmes Engage with client stakeholders to translate business objectives into technical solutions … Produce architecture documentation, design artefacts and delivery roadmaps Key Requirements 7+ years experience in data engineering or data platform development Strong experience with Databricks, Spark and distributed data processing Experience with Unity Catalog, Delta Lake and streaming architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering ...

iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment … plus) Experience debugging moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure ...

clear SLAs and backups. Own the observability platform (ClickHouse, OpenTelemetry): logs, metrics, traces, synthetics, SLOs and actionable alerting. Own the data platform: Glue pipelines, Apache Iceberg lakehouse, Redshift and CDC; serve BI users with traceable datasets and handle data requests with strong privacy practice. Operate platform security controls (identity … security practice; willing to participate in the on‐call rota. Excellent communication; comfortable prioritising, working with stakeholders and reporting upwards. Desirable ClickHouse, Redshift or Apache Iceberg; data engineering with AWS Glue or Spark. Delivering the technical side of a security standard (Cyber Essentials Plus, ISO 27001). Experience overseeing ...

Hands-on experience in system design, application development, testing, and operational stability Proficient in coding in one or more languages such as Java or Spark Experience developing, debugging, and maintaining code in a large corporate environment with modern programming and database querying languages Knowledge of the Software Development Life … within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile) Ability to solve data-oriented problems using technologies such as SQL, Relational DB, Spark, NoSQL, optimizing for performance Preferred Qualifications, Capabilities, and Skills: Experience with Spark performance tuning of complex calculations on large datasets Experience delivering production ...

Hands-on experience in system design, application development, testing, and operational stability Proficiency in coding in one or more languages such as Java or Spark, with experience developing, debugging, and maintaining code Knowledge of modern programming and database querying languages, including SQL, relational databases, and NoSQL Solid understanding … processes within a technical discipline (e.g., cloud, AI, machine learning, mobile) Ability to solve data-oriented problems using technologies such as SQL, relational databases, Spark, and NoSQL Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting ...

software solutions across complex technology environments. Build and maintain production code, ensuring security, stability and scalability. Develop and optimise data processing solutions using Java, Spark and SQL. Analyse large datasets and identify opportunities to improve performance and system architecture. Contribute to technical design, architecture and implementation decisions. Collaborate with … improvement across coding standards, system resiliency and software delivery practices. Key Skills & Experience Strong hands-on Java software development experience. Experience developing and optimising Spark based data processing solutions. Strong SQL skills, including querying and performance optimisation. Knowledge or experience of cloud technologies and platforms. Experience developing, debugging ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

SparkMLlib, and Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data ...

Our client is a global technology company. A problem isnt truly solved until its solved for all. Thats why colleagues build products that help create opportunities for everyone, whether down the street or across the ...