101 to 125 of 304 Apache Jobs in England

stores). Hands-on experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure … data pipeline lifecycle development, including extensive experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced SQL skills and proficiency in Python. Strong background ...

play a key role in shaping the future of the engineering function. Skills required: Strong experience with Python Excellent SQL knowledge Experience with Apache technologies (Spark, Airflow or Kafka) Proven experience designing and building scalable data pipelines Strong understanding of data architecture and distributed systems Experience working within ...

colleagues Must-have skills: RabbitMQ Java and microservices MongoDB and MySQL Kubernetes Grafana and Prometheus GitLab Job scheduling tooling (eg JS7 Job Scheduler, TWS, Apache Airflow) Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects) Nice to have: Databases and data platforms, ideally Oracle or Cloudera ...

traditional data engineering background You have strong Python coding skills You have experience of building and optimising data pipelines You have strong experience with Apache Airflow or similar orchestration technologies You have experience with CI/CD and modern software engineering practices You have a good understanding of data ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

languages like Python, or functional programming languages like Scala Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources ...

teams in data engineering, data platforms, software engineering, or AI/ML. Technical Depth: Strong technical background capable of evaluating architectures spanning distributed computing (Apache SparkTM), Python/Scala, modern cloud ecosystems (AWS, Azure, GCP), CI/CD, and MLOps/GenAI frameworks. Leadership Skills: Proven ability to manage ...

Experience with Slack, Jira, GitHub or equivalent version control, Google Platform or equivalent cloud platforms. Nice to have Experience of using tools such as Apache Airflow, Mode Analytics, Terraform. Experience of New Product Introduction (NPI) processes or onboarding new products and features into a delivery pipeline. Experience with ...

knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem‐solving skills and ability to work in a fast‐paced environment. Excellent communication and collaboration skills. Significant experience ...

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks Certified ...

configuration management and an interest in migrating to Ansible and cloud-native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

software engineers and product managers to deliver robust data solutions. The role requires 7+ years in data engineering, including leadership, and strong expertise in Apache Spark and Azure Data Factory, with hands-on cloud experience across Azure/AWS/GCP. #J-18808-Ljbffr ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external client ...

Experience with streaming and/or messaging technologies (for example, Kafka or IBM MQ). Experience with caching technologies (for example, Redis, GemFire, or Apache Ignite). Working knowledge of relational and non-relational databases. Experience working in agile teams with strong engineering hygiene (testing, reviews, and operational readiness ...

databasesExperience with one of Azure/AWS/GCPETL tools like Informatica, Alteryx and Business Glossary tools like Collibra, Azure Purview or Apache Atlas.TDD/BDD, Experience working in an Agile development environmentIdentity management and synchronisation will be an add on for the resourcesExperience with Data Dictionaries, Business glossaries ...

Java and Spring components, including Spring Data JPA. Experience with containerisation technologies such as Docker and Kubernetes. Experience with stream processing frameworks such as Apache Flink is a plus but not required. Familiarity with SSO mechanisms including OpenID is a plus but not required. A basic understanding of core ...

etc.) Exposure to Angular, AlpineJS, Bootstrap Database tools: Toad, DBeaver, SQL Developer IDEs: VS Code, Eclipse, etc. Typescript TLS, PKI – certs etc. Keyfactor, Sectigo Apache config Containers (Docker, Podman, etc) Testing tools: Selenium, JUnit Data formats: XML, JSON, YAML AWS, Azure, Cloud etc. Login Authentication (SSO, MFA) CI/ ...

pipelines, inference serving, and GenAI/RAG architectures grounded in proprietary content. Lakehouse and modern data platform design: strong knowledge of open table formats (Apache Iceberg, Delta Lake), zone architecture (landing, cleansed, curated), streaming and batch pipeline patterns, and data quality frameworks. Project engagement and design assurance: able ...

latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about ...

operating ETL/ELT pipelines and large-scale data architectures. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). Ability ...

environments. Technical Skills: Experience building and operating ETL/ELT pipelines. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with some of these or similar technologies ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

support comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, UnityCatalog, and Apache Atlas tomaintaindata integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data … latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta TablesorApache Iceberg:Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance Tools:Experience with data governance tools like Azure Purview, UnityCatalog, or Apache ...

support comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, UnityCatalog, and Apache Atlas tomaintaindata integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data … latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta TablesorApache Iceberg:Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance Tools:Experience with data governance tools like Azure Purview, UnityCatalog, or Apache ...