12 of 12 Apache Airflow Jobs in the Midlands

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...

need to have: AWS Data tooling such as S3/Glue,Redshift. Familiarity with containerization (e.g. Docker/ec2), Orchestraion in enterprise environment (Airflow), Infrastructure automation (Terraform), and CI/CD platform (Github Actions and Admin), Password/Secret Management (hashicorp vault). Strong Data related programming skills ...

business data for senior management. What You'll Bring Technical ability. Relevant languages: Python, SQL etc. Data Engineering/ETL skills : Pipeline Development: Airflow, Fabric, Azure, Logging, API Integration: REST API, JSON Processing, Data Mapping, Validation & Quality Controls Programs/Tech Stack : SSMS - SQL Server Management Studio, Docker, Apache Airflow, Power BI, Looker Studio, Excel or similar, preferred but not all essential Version Control : Git/Github Retail/supply chain, distribution or similar background preferable Salary: £38,000 Location: Coventry - On-site Job Type: Permanent ...

team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data pipelines Strong data modelling, CI/CD, Git, and Terraform knowledge Experience ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong Automation Skills: Comfortable using Python and Shell ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

data platform, blending hands-on delivery with leadership and mentorship responsibilities. The role requires strong GCP experience (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow), advanced Python and SQL, and a track record of building scalable batch and real-time pipelines. #J-18808-Ljbffr ...

Lead Data Engineer Location: West Midlands | Hybrid 3 days per week onsite The Role Were looking for an experienced Lead Data Engineer to provide hands-on technical leadership within a data engineering team for a ...

The Role We’re looking for an experienced Lead Data Engineer to provide hands‐on technical leadership within a data engineering team for a large retail brand. You’ll lead the design and delivery of ...

ground running on Python and SQL. Key Responsibilities Data Pipelines and Integration Build Python jobs in Prefect (our Client’s Airflow equivalent) to pull data from APIs into our PostgreSQL data warehouse. Work with APIs, both consuming and building integrations, to get more data into the platform. Ingest … help ensure the data platform remains secure, dependable and fit for purpose as it grows. Desirable experience and skills PostgreSQL specifically. Workflow orchestrators (Prefect, Airflow, Dagster). FastAPI or similar Python web frameworks (e.g. Django). Terraform or other infrastructure-as-code tooling. MQTT or any pub/ ...