176 to 200 of 234 Apache Jobs in the UK

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

software and site reliability engineering. Preferred: Experience with distributed ML frameworks such as Horovod or TensorFlow Distributed. Familiarity with data engineering pipelines such as Apache Airflow or Apache Spark. Knowledge of chaos engineering tools and compliance frameworks such as GDPR, SOC 2, or ISO 27001. Relocation benefits ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

maintaining scalable data pipelines and integrations. Developing robust ETL and data transformation processes to support analytics and reporting requirements. Working with Snowflake, DBT, Apache Airflow, AWS, SQL and Python to deliver high-quality data solutions. Collaborating with Data Architecture, DevOps and business stakeholders to ensure trusted and accessible data … ideally within AWS. Data modelling, transformation and orchestration methodologies. Delivering high-quality, well-documented and thoroughly tested data solutions. Experience with Snowflake, DBT and Apache Airflow. Interest in AI and emerging technologies within the data engineering landscape. THE BENEFITS: You will receive a salary ...

documentation and technical reports. MOD or Defence security standards and accreditation processes. Working with secure or safety-critical systems. Exposure to technologies such as Apache Kafka, Apache NiFi, Node.js, TypeScript, MongoDB, AI or Machine Learning would also be beneficial. Security Clearance Due to the nature of the work ...

License. Experience in Operations, Infrastructure or Systems Engineering Solid networking, high availability and security knowledge Experience with technologies such as Veeam, Intune, NGINX, HAProxy, Apache and scripting/automation A proactive, customer-focused approach and excellent leadership skills The ability to thrive in a fast-paced managed services environment ...

serverless data platform company. Data teams write plain Python, and Tower handles packaging, dependency resolution, scheduling, and execution across a serverless runtime built on Apache Iceberg. The product aims to let local Python scripts run in production at scale without a Databricks detour. The team is small and senior ...

experience supporting product launches from concept through to market. Strong intellectual property expertise, particularly copyright risk and open-source licensing, including CC-BY-4.0, Apache 2.0, and MIT. Strong understanding of AI-related legal, regulatory, and commercial considerations. Experience partnering closely with product, engineering, and technology teams. Track record ...

Will Work With Designing, building and maintaining scalable data pipelines. Developing ETL/ELT processes to ingest and transform data from multiple sources. Apache Airflow for workflow orchestration, scheduling and automation. Azure SQL and cloud-based data platforms. Data modelling, warehousing and optimisation activities. Data quality, governance and validation … optimising data pipelines. Knowledge of ETL/ELT development and data integration. Python scripting for automation, transformation and data engineering tasks. Experience with Apache Airflow or similar orchestration tools. Understanding of data warehousing and data modelling principles, including dimensional modelling. Experience working with cloud-based data platforms. Familiarity with ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io. About this role: At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi‐structured financial data logs (JSON/… such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event‐driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python, SQL, or an Object‐Oriented language (Java/Scala). Nice to Haves Experience operating data assets ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python, SQL, or an Object-Oriented language (Java/Scala). Nice to Haves Experience operating data assets ...

software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands‐on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross‐functional … highly scalable data engineering solutions that power Moody’s next‐generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody’s technical teams ...

Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes for efficient data integration Build and maintain data pipelines using tools such as FME, Apache NiFi, and SQL Loader Develop Python scripts and automated processes to support data ingestion Systems & Development Support data streaming solutions via REST APIs … data concepts Experience or knowledge of SQL and/or Python Good communication skills and attention to detail Desirable: Experience with ETL tools (e.g. Apache NiFi, FME, SQL Loader) Knowledge of AWS services (e.g. Lambda, APIs) Understanding of data modelling, data mining, or segmentation Hands-on experience with databases ...

software development team Hands-on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands-on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross-functional … highly scalable data engineering solutions that power Moody’s next‐generation digital content platform Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody’s technical teams ...

governance frameworks covering data ownership, stewardship, classification (PII, sensitive, public), and retention policies Establish data lineage and cataloguing standards, working with tooling such as Apache Atlas, Collibra, or Snowflake Horizon Catalog Design and enforce data quality rules and SLAs at ingestion, transformation, and consumption layers Collaborate with the Risk … documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS 239, MDM AI/ML Data Query & Performance SQL optimisation, clustering keys, partitioning, query profiling, cost ...

follow up corrective actions Good knowledge of TCP/IP networking concepts including Routing, Switching, Firewalling, including Layer 7 firewalls Linux (CentOS/Ubuntu, Apache, MySQL) Desirable: Project planning and delivery experience Asterisk/VoIP platforms Windows Server and VMware intermediate level experience Hardware and/or software systems ...

good understanding of modern coding conventions such as OOP & MVC and have used or at least dabbled with development frameworks. Key Skills: PHP MySQL Apache Linux/Windows HTML CSS JavaScript MVC Laravel My client can offer a great working environment with a benefits package which includes regular training ...

strong and motivated FX Risk Lead Java Developer.**Key Responsibilities:*** Design, develop, and maintain Java-based microservices for high-throughput application* Integrate and optimize Apache Ignite based solution: in memory data grid for FX trades processing* Implement real time data ingestion and processing pipelines using Apache Kafka/… with JVM performance optimization and memory profiling* Familiarity with distributed systems architecture and in-memory computing concepts* Proven experience with in-memory caching solution Apache Ignite in production environment* Solid experience with MongoDB (CRUD, indexing, performance tuning)* Deep SQL knowledge and query optimization in Oracle database* Solid understanding ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … analytics and AI. the company is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow the company on Twitter, LinkedIn, and Facebook. Benefits At the company, we strive to provide ...