226 to 233 of 233 Apache Airflow Jobs in England

Key Skills: Snowflake Agile methodology and experience working within small, multiskilled feature teams Proficiency with GIT and version control systems Knowledge of older coding standards and practices Experience with Airflow and Python (nice to have) If you find this opportunity intriguing and it aligns with your skill set, we welcome the submission of your CV. Carbon60, Lorien & SRG - The More ❯

management disciplines, including data integration, modeling, optimisation, data quality and Master Data Management. Experience with database technologies such as RDBMS (SQL Server, Oracle) or NoSQL (MongoDB). Knowledge in Apache technologies such as Spark, Kafka and Airflow to build scalable and efficient data pipelines. Have worked on migration projects and some experience with management systems such as SAP More ❯

management disciplines, including data integration, modeling, optimisation, data quality and Master Data Management. Experience with database technologies such as RDBMS (SQL Server, Oracle) or NoSQL (MongoDB). Knowledge in Apache technologies such as Spark, Kafka and Airflow to build scalable and efficient data pipelines. Have worked on migration projects and some experience with management systems such as SAP More ❯

position? We are seeking a passionate DataOps Engineer who loves optimizing pipelines, automating workflows, and scaling cloud-based data infrastructure. Key Responsibilities: Design, build, and optimize data pipelines using Airflow, DBT, and Databricks. Monitor and improve pipeline performance to support real-time and batch processing. Manage and optimize AWS-based data infrastructure, including S3 and Lambda, as well as … experience supporting high-velocity data/development teams and designing and maintaining data infrastructure, pipelines, and automation frameworks. You should also have experience streamlining data workflows using tools like Airflow, DBT, Databricks, and Snowflake while maintaining data integrity, security, and performance. Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent work experience. Minimum of … years of experience in DataOps or similar. Proficiency in key technologies, including Airflow, Snowflake, and SageMaker. Certifications in AWS/Snowflake/other technologies a plus. Excellent communication and interpersonal skills. Ability to work in a fast-paced environment and manage multiple priorities effectively. What's in it for you? We offer our employees more than just competitive compensation. More ❯

Glasgow may also be options). Rate: up to £414 p/d Umbrella inside IR35 Key Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and … performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high availability, scalability, and fault tolerance of Airflow clusters. Implement monitoring, alerting, and logging for Airflow and related components. Perform upgrades and patches for platform-related components. Oversee capacity planning, resource allocation, and optimization of Airflow workers. Maintain and configure integrations with More ❯

end data quality, from raw ingested data to business-ready datasets Optimise PySpark-based data transformation logic for performance and reliability Build scalable and maintainable pipelines in Databricks and Airflow Implement and uphold GDPR-compliant processes around PII data Collaborate with stakeholders to define what "business-ready" means, and confidently sign off datasets as fit for consumption Put testing … internal and external customers Skills & Experience Required Extensive hands-on experience with PySpark, including performance optimisation Deep working knowledge of Databricks (development, architecture, and operations) Proven experience working with Airflow for orchestration Proven track record in managing and securing PII data, with GDPR compliance in mind Experience in data governance processes; Alation experience preferred, but similar toolswelcome Strong SQL More ❯

Head of AI & Technology Shape the Future of AI Recruitment Are you passionate about AI, technical leadership, and building scalable, high-impact products? Join us as a Head of AI & Technology and take the reins of a cutting-edge AI More ❯

Build the Future of AI Recruitment with us! Do you have a passion for AI, technical leadership, and building scalable, high-impact products? We're looking for a Lead AI & Tech Architect to ensure the success of our cutting-edge More ❯