51 to 75 of 171 Apache Airflow Jobs in England

preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers and semantic models Data Migration & Mapping Demonstrated ...

tools. Experience building and optimising scalable data pipelines and data warehouses. Knowledge of AWS technologies such as Redshift, S3 and Athena. Experience with Airflow, Fivetran or similar orchestration and integration tools. Strong Linux/Unix and Bash scripting skills. A solid understanding of data quality, governance, lineage and monitoring. ...

modern cloud based data platforms. Solid understanding of data modelling and data transformation principles. Ability to work effectively within collaborative engineering teams. Desirable Experience: Airflow Databricks Experience supporting AI or machine learning initiatives. Semantic layer experience. Exposure to Azure and multi cloud environments. Understanding of Inmon 3NF data modelling ...

database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life Cycle Advanced understanding of agile methodologies, CI/CD, application ...

MLOps principles with experience deploying models in production Proficiency in Python and tools/platforms such as Azure, AWS, GCP, Databricks, MLFlow, and Airflow Strong communication skills with the ability to engage business and technical stakeholders We offer/Benefits EPAM Employee Stock Purchase Plan (ESPP) Protection benefits including ...

database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life Cycle Advanced understanding of agile methodologies, CI/CD, application ...

database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise‐authorized AI‐assist­ed software development tools within the work environment (e.g., for coding, code review, test acceleration ...

systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

Styled Components), React, Redux, Redux Hooks, and other modern state management libraries. Kotlin on Android and Swift on iOS. Data: SQL, Python, Snowflake, dbt, Airflow & Looker AI at Marshmallow: Sierra.ai for conversational AI, Python and LangChain for agentic AI solutions, Sagemaker and MLflow for Machine Learning, Cursor and Claude ...

requirements into Data Science deliverables. The opportunity to work with leading data engineering technologies, including Google Vertex AI tools, Google BigQuery, BigQuery Pipelines, and Airflow, with leading Data Science tools and emerging technologies for model building and deployment. Opportunities to develop your career in a friendly, diverse, innovative, international ...

Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache … Lambda Working experience with Terraform Experience in creating workflows for Apache Airflow What the job involves As a senior technical lead, you consider yourself a platform services developer and develop innovative solutions using modern software frameworks and paradigms You are self‐driven and a problem solver, with ...

query optimisation. Redis - caching, pub/sub, distributed locks and idempotency patterns. Serverless Framework v3, Docker (container-based Lambdas), Terraform, Jenkins CI/CD. Apache Airflow DAG authoring and AWS Glue with PySpark for batch ETL. pytest and moto (offline AWS service mocking), Black formatter, ruff linter. Datadog … retry patterns. Hands-on AWS infrastructure experience: Serverless Framework v3, Terraform, ECR, IAM. Experience deploying Docker container-based Lambda functions. Data engineering background with Airflow DAGs and PySpark/Glue ETL pipelines is an advantage. Multi-tenant SaaS platform experience at scale is desirable. Familiarity with telecom, OEM device ...

best practices and coding standards. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using Apache Airflow, Spark, SQL, Python, and ETL tools. CI/CD & DevOps Design and implement CI/CD pipelines for data platforms. Automate code ...

join their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work ...

isolation Experience with CI/CD, databases, infra-as-code Comfortable debugging production systems Nice to Have Security/compliance (SOC2, HIPAA) Exposure to AirFlow and MLFlow for scientific workflows MSC/PHD in Machine Learning Biotech/pharma experience Why Helical Live with top pharma High ownership, small ...

Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions, Azure DevOps Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest AI based Code developed and AI-built automated data pieplines Key Characteristics Technology expert who constantly pursues knowledge enhancement ...

Practical experience with Azure (Azure OpenAI, Azure AI Foundry, AI Search) and familiarity with AWS or GCP Proficiency with containerized deployment, MLOps tooling (MLFlow, Airflow), and infrastructure‐as‐code practices Bachelor’s or Master’s degree in Computer Science, Data Science, or related field Nice to have Experience with ...

cluster management and ML training workloads (NVIDIA, CUDA, distributed training). Familiarity with MLOps tooling: Experiment tracking (MLflow, Weights & Biases). Workflow orchestration (Airflow, Prefect, Argo). Data versioning (DVC). Background in scientific computing or HPC environments. Prior experience at a deep tech or computational science company. ...

Python and SQL, familiarity with Scala or R advantageous Experience with data orchestration and workflow management tooling such as Azure Data Factory or Airflow Please see full job description attached. What you can expect from us We believe doing your best work starts with feeling supported both professionally ...

data modelling Databricks as our datalake platform Kubernetes for data services Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer for job scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data ...

understanding of cloud infrastructure, observability, monitoring, incident response, and operational best practices relevant technologies (we use): AWS incl. S3, ECS, API Gateway, Batch, Redshift, Airflow, GitHub Actions, Docker, Pulumi, Python, Javascript/react high ownership mentality who can work across the stack with a primary responsibility for DevOps reliability ...

reproducibility, dataset versioning, and efficient access Working knowledge of cloud platforms (AWS, GCP, or Azure) and modern MLOps tooling (e.g. MLflow, Weights & Biases, DVC, Airflow) Strong experience with Python and associated scientific software packages such as PyTorch, OpenCV, Pandas, SciPy, NumPy, SciKit-learn, etc. Strong software engineering practices including ...

applying DevSecOps practices within cloud or controlled environments Exposure to large language models or generative AI systems Experience with data engineering tools (e.g. Spark, Airflow, Databricks) Experience applying AI and automation to operational or productivity-focused use cases Experience working in secure, restricted, or air-gapped environments Experience supporting ...

systems (CMS), subscription platforms, ad tech, and social media. Proven ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models and reporting layers to support performance dashboards … experience in a data engineering role. Tools & Technologies: Databases: Proficient in relational SQL databases. Workflow Management Tools: Experience with orchestration platforms such as Apache Airflow. Programming Languages: Skilled in one or more of the following languages, i.e.: Python, Java, Scala. Cloud Infrastructure: Strong understanding of cloud infrastructure such ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant ...