76 to 100 of 260 Apache Spark Jobs in the UK

Work with container technologies Core Data Engineering Strong programming proficiency in Java or Python. Hands-on experience with at least one of: Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ ...

data engineering, ETL development or data platform delivery. Strong programming skills in Java or Python. Exposure to modern data technologies such as Kafka, Spark or Flink. Experience working within cloud environments, ideally AWS. Understanding of software engineering principles, version control and CI/CD practices. Familiarity with container technologies ...

datasets Preferred Qualifications Knowledge or interest in investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka Equal Opportunity Employer Goldman Sachs is an equal opportunity employer ...

Python. Proven experience designing and building distributed systems and APIs at scale. Hands‐on experience with real‐time data processing frameworks (e.g. Kafka, Flink, Spark Streaming, Pulsar). Experience working with cloud platforms (AWS, GCP, or Azure) and containerisation/orchestration (Docker, Kubernetes). Strong understanding of data modelling ...

learning, model development, and data engineering, with an appreciation of responsible AI principles. Experience with cloud environments (Azure, AWS, GCP) and tools such as Spark, Hive, and Redshift. Demonstrated ability to lead cross-functional teams and mentor junior practitioners. Ability to communicate complex technical concepts clearly to non-technical ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

scale datasets Preferred Qualifications Knowledge or interestin investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka Goldman Sachs Highlights At Goldman Sachs, we commit our people, capital ...

datasets Preferred Qualifications Knowledge or interest in investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital ...

Computational Complexity. Strive for excellence and continuous improvement in software architecture, software delivery and best practices. Hands on experience in C#, OOP python, Spark/PySpark and other C#, Python framework ecosystem. Debug and resolve issues in large datasets quickly. Co-ordinating handoffs between different time zones and allocating ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

Computational Complexity.* Strive for excellence and continuous improvement in software architecture, software delivery and best practices.* Hands on experience in C#, OOP python, Spark/PySpark and other C#, Python framework ecosystem.* Debug and resolve issues in large datasets quickly.* Co-ordinating handoffs between different time zones and allocating ...

Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic … Cache, Lambda Working experience with Terraform Experience in creating workflows for Apache Airflow What the job involves As a senior technical lead, you consider yourself a platform services developer and develop innovative solutions using modern software frameworks and paradigms You are self‐driven and a problem solver, with ...

modern data engineering best practices You have experience with Databricks, ideally also Azure You have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You're excited to join a start-up in a role that you can shape and influence ...

ability to help refine problem statements and propose solutions taking effort-impact-scalability tradeoff into account. Some skills that will make you stand out: Apache Spark, Iceberg, Kafka, dbt Scikit-Learn, XGBoost, PyTorch, MLFlow,, GraphFrames, Ray AWS (S3, EMR, SageMaker, Lakeformation), Terraform, Docker, GitHub CI/CD Knowledge ...

+ ETL/ELT experience Knowledge of Python/T-SQL Exposure to DBT Exposure to cloud platforms (Azure preferred) Nice to have: Databricks, Spark, CI/CD, big data This is a great opportunity to join a high-impact data team in a global organisation and shape ...

tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated ...

preparation. Machine learning and statistical methods, including model validation. Data analytics and visualisation techniques. Processing large datasets using batch or streaming tools such as Apache Spark. Data acquisition and fusion approaches. Cloud platforms (ideally AWS) and cloud-based data science solutions. DataOps principles and practices. Structured and unstructured databases. ...

Computer Vision: Familiarity with computer vision techniques and libraries like OpenCV. Experience with Big Data Tools: Experience with big data tools like Hadoop, Spark, or Hive. Knowledge of Reinforcement Learning: Understanding of reinforcement learning techniques and algorithms. Familiarity with Robotics: Experience with robotics and robotic process automation (RPA) tools. ...

problem-solving skills to collaborate across global teams and translate complex data insights into actionable outputs Familiarity with data platforms such as Databricks, Spark, Snowflake, or similar technologies Ability to communicate technical concepts clearly to non‐technical stakeholders Basic understanding of artificial intelligence concepts, with curiosity and enthusiasm ...

auction systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

such as MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management. Strong Python experience, with helpful knowledge of Spark or PySpark for working with large‐scale data and machine learning systems. An understanding of feature stores and related data technologies used to support ...

Agentic AI, applied within enterprise environments. Experience with energy system modelling, grid analytics, demand forecasting or energy market data. Familiarity with distributed computing, Spark, PySpark or cloud-native data platforms. Experience developing models for planning, scenario analysis, operational decision support, model governance or regulatory reporting. Why Join Capco Deliver ...

designing and enforcing data contracts and quality SLAs in distributed data ecosystems. Proficiency in Python, Java, or Scala, and experience building pipelines with Databricks, Spark, or Kafka. Strong understanding of data governance principles, privacy regulations (GDPR, CCPA), and secure data handling practices. Familiarity with metadata management and data catalog ...

libraries (e.g., scikit‐learn, pandas, PyTorch or TensorFlow). Practical experience with Databricks, including MLflow for experiment tracking and model management, and Spark-based data processing. Familiarity with Generative AI concepts and tooling, including working with LLMs, prompt engineering, RAG patterns, and vector search. A solid understanding of MLOps ...