76 to 100 of 304 Apache Jobs in England

tooling, automated testing and reliable deployment processes. Startup Mindset: Proactive, resourceful and comfortable taking responsibility in a small, fast‐moving engineering team. Experience with Apache Airflow, Kubernetes, real‐time data platforms, AI/ML infrastructure, LLM agents, GPU infrastructure or financial‐market systems would be useful ...

Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem-solving mindset. ...

scripts and CI/CD automationWorking knowledge of modern MLOps stacks including experiment tracking and artifact managementHands-on experience with orchestration tools (e.g., Kubeflow, Apache Airflow, Metaflow or Prefect)Demonstrated skills with Docker, Kubernetes and distributed deploymentsPractical knowledge of Infrastructure-as-Code (Terraform) and a major cloud provider ...

platforms using AWS, Azure or Google Cloud. Expertise in data modelling, SQL, NoSQL and modern database technologies. Experience with big data technologies, such as Apache Spark, Hadoop or distributed computing frameworks. Programming knowledge in Python, Scala, Java or similar languages. Experience architecting AI and machine learning solutions, including deploying ...

Experience with non-relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed ...

Analytics, Artificial Intelligence or a related field, or equivalent experience, would be effective, although practical experience is equally valuable. “Nice to Have” Azure, Databricks, Apache Spark or comparable cloud and data platforms. Data pipelines, ETL and workflow‐orchestration technologies. Machine‐learning methods such as forecasting, prediction or classification. Experience ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models ...

with Linux and networking. Experience with build tooling such as Bazel would be beneficial. Exposure to analytics, workflow or distributed‐compute technologies, such as Apache Airflow, Dask, JupyterHub or comparable tools, would be helpful. An interest in applying AI to software engineering, with experience of AI‐assisted development tools ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deploymentsWorking knowledge of MLOps, ML/AI models ...

enquiring and creative mind. It would be nice if you had Microsoft - C#, .NET, SharePoint, SQL. Data Engineering – experience of one or more: Apache ecosystem, SQL, Python. Web - HTML, CSS, JavaScript, XML, SOAP. Experience with Secure DevSECOps within an Agile/SAFe environment. Containerisation - Docker, Kubernetes, Kubeflow etc. Software ...

data generation for code or language models. Training LLMs in distributed environments. Reinforcement learning, preference optimisation or reward modelling. Data tooling such as SQL, Apache Iceberg or DuckDB. LLM‐as‐a‐judge systems or automated code evaluation. Reward‐hacking detection, robustness evaluation or safety‐focused training. Open‐source contributions ...

expertise in writing complex, optimized SQL queries for data extraction and transformation. ETL/ELT: Hands-on experience building data pipelines using frameworks like Apache Spark, Apache Airflow, DBT, Fivetran, Matillion, or equivalent. Databases: Solid understanding of relational databases (e.g., PostgreSQL, MySQL) and experience with modern data warehousing ...

experience with BigQuery . Experience building and supporting production data pipelines. Experience developing transformation layers using dbt . Experience with orchestration tools such as Apache Airflow or Cloud Composer . Strong SQL and Python development skills. Experience designing scalable data models and data warehouse solutions. Strong stakeholder engagement ...

years' experience delivering enterprise data platforms or analytics solutions. Strong commercial experience delivering Databricks solutions. Consulting or customer-facing delivery experience. Strong understanding of Apache Spark, modern Lakehouse architecture and Unity Catalog. Experience with Azure, AWS or GCP. Experience implementing CI/CD and deployment automation. Excellent communication ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

subject, preferred knowledge of AI infrastructure.Proficiency in programming languages such as Python, Java, or C++.Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow).Strong problem-solving skills and ability to work in a fast-paced environment.Excellent communication and collaboration skills.Professional experience in AI/ML infrastructure ...

Experience with non-relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed ...

platforms. You will leverage cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You’ll tackle high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion ...

build elegant solutions Understanding of system administration tasks on some of the following; Operating systems (e.g. Linux, CoreOS and Windows) Application stacks (e.g. nginx, Apache, Tomcat, JBoss, Websphere, Hybris, IIS, .Net, Node.js, Solr) RDBMS (e.g. PostgreSQL, MySQL, Oracle, MS SQL) NoSQL (e.g. MongoDB, Cassandra, Riak) Containerisation and microservices (e.g. ...

build elegant solutions Understanding of system administration tasks on some of the following; Operating systems (e.g. Linux, CoreOS and Windows) Application stacks (e.g. nginx, Apache, Tomcat, JBoss, Websphere, Hybris, IIS, .Net, Node.js, Solr) RDBMS (e.g. PostgreSQL, MySQL, Oracle, MS SQL) NoSQL (e.g. MongoDB, Cassandra, Riak) Containerisation and microservices (e.g. ...

data Experience with data visualization tools to create dashboards and reports Understanding of data engineering concepts (ETL, data pipelines) and automation tools such as Apache Airflow Familiarity with cloud based computing resources such as AWS Interviewing with Veeva We value your time and believe in a transparent hiring process. ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

migration strategies as well as with machine learning, LLMs, and agentic AI workflows. Proficient in programming, debugging, and problem‐solving using SQL, Python, Apache Spark, cloud platforms, and Lakehouse architectures and with AI tools. Experience collaborating with Global System Integrators (GSIs) and third‐party consulting organizations to drive customer ...

help design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit … opportunity to grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data ...

deliver scalable data architectures across AWS and Azure environments. Define and implement automated data pipelines using cloud-native technologies and frameworks such as Apache Spark. Design data integration solutions connecting cloud platforms with on-premises data sources. Establish event-driven architectures to support efficient data processing, workflow orchestration … Azure. Strong understanding of cloud data architecture, data integration and distributed data processing. Experience designing and implementing automated ETL/ELT pipelines. Experience with Apache Spark or equivalent distributed data processing technologies. Experience designing event-driven architectures and data processing workflows. Strong understanding of data pipeline orchestration, performance optimisation ...