76 to 100 of 141 Apache Airflow Jobs

Comfortable acting as a technical authority - advising on approach and best practice and communicating clearly with non-technical stakeholders Experience with Azure, SQL, Dagster, Airflow or similar tools acceptable Experience with Python scripting, React-based applications, FactSet and third-party web APIs Desirable: Understanding of financial data experience with ...

Comfortable acting as a technical authority - advising on approach and best practice and communicating clearly with non-technical stakeholders Experience with Azure, SQL, Dagster, Airflow or similar tools acceptable Experience with Python scripting, React-based applications, FactSet and third-party web APIs Desirable: Understanding of financial data experience with ...

Viya 4 • Experience delivering large-scale migration programmes Desirable • Knowledge of CI/CD pipelines and DevOps practices • Experience integrating SAS with: o Airflow or alternative schedulers o Data platforms (e.g. Snowflake, Databricks) • Understanding of data security and access models • Experience in public sector/regulated environments Qualifications • Degree ...

writing/documenting Working knowledge of R Familiarity with cloud environments (ideally AWS) Familiarity with containerisation Familiarity of workflow management systems (e.g. Snakemake, Nextflow, Airflow, Dagster) Familiarity with MLOps Why Join Us: 25 days of annual leave, plus public holidays in England and Wales A fast-growing, mission-driven ...

processes, with experience working with APIs and data ingestion. Preferred - Familiarity with big data processing frameworks and related technologies such as Spark, Hadoop, Airflow, and Data Lakes. Preferred - 2+ years of development experience with Ruby on Rails, JavaScript, or Node.js. Preferred - 2+ years of FAST API experience. Working ...

engineering, model evaluation, and experiment design (A/B testing, holdout strategies, stratification). Experience developing production-quality data pipelines and automated workflows using Airflow or similar orchestration tools. Practical familiarity with graph databases and/or graph frameworks (Neo4j, AWS Neptune, GraphFrames, DGL, PyTorch Geometric) and graph algorithms ...

talks, or threads about building with AI. MLOps and model serving experience (BentoML, MLflow, Vertex AI, SageMaker). Streaming and batch ingestion pipelines (Spark, Airflow, Beam, Glue). Healthcare or life sciences domain exposure. AWS Professional certification or other relevant industry certifications. What We Offer At Newpage ...

Data Engineer in secure or government environments Strong skills in Python, SQL, and data pipeline development Experience with data integration tools (e.g. Airflow, NiFi, Azure Data Factory, AWS Glue, or similar) Hands-on experience with cloud platforms (AWS, Azure, or GCP - secure tenants preferred) Knowledge of data modelling, data … environments Strong understanding of data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...

work independently and help drive things forward Nice to have: Time-series, high-volume or event-driven data experience Orchestration exposure such as Airflow, Dagster, Prefect, Temporal or similar Finance or market data experience Details: Permanent role London/hybrid Small, technically strong team Salary flexible depending ...

GitHub Copilot) with significant examples of delivery improvement AWS (S3, Lambda, EC2, Glue), Snowflake, Git, CI/CD, Datadog, MS SQL Server, REST, GraphQL, Airflow (as many as possible) Degree educated or higher in a relevant technical discipline from a leading university This is a £650-700/ ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

Collaborating closely with consultants, developers, and project teams Helping shape the future of the company’s data capability Tech You’ll Work With Python Airflow Git & GitHub RDF/SPARQL/Semantic Web technologies Cloud and modern data tooling What They’re Looking For Strong experience building scalable data ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation: experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

deployments for Viya 4 * Experience delivering large-scale migration programmes Desirable * Knowledge of CI/CD pipelines and DevOps practices * Experience integrating SAS with: - Airflow or alternative schedulers - Data platforms (e.g. Snowflake, Databricks) * Understanding of data security and access models * Experience in public sector/regulated environments Qualifications * Degree ...

Viya 4 Experience delivering large-scale migration programmes Desirable Knowledge of CI/CD pipelines and DevOps practices Experience integrating SAS with: o Airflow or alternative schedulers o Data platforms (eg Snowflake, Databricks) Understanding of data security and access models Experience in public sector/regulated environments (eg HMRC ...

APIs can be exposed to LLM-based agents. Experience with search relevance & recommendation systems — ranking algorithms, semantic search, personalisation. Hands-on with Snowflake, Databricks, Airflow, Kafka . Why Join Us Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC Shape ...

/CD terminology and pipelines in GIT, Jira Cloud & Infrastructure: AWS BedRock, SageMaker AI, Azure Machine Learning, GCP Vertex AI, Kubernetes, Terraform Data Engineering: Apache Kafka, Spark, Airflow, Parquet, SQL, NoSQL and graph databases. Optimization & Scheduling: Constraint optimization (eg. LP), Reinforcement Learning. Education Minimum Bachelors in Computer Science ...

using assistive technologies such as JAWS and Dragon. Support Infrastructure as Code (IaC) initiatives using Terraform and Docker. Work with data engineering tools including Apache Spark, Python, Airflow, and Jupyter Notebooks. Participate in security and vulnerability scanning using tools like Trend Micro, Wiz, and Trivy/Trixy. Collaborate … frameworks Cloud & DevOps AWS Azure exposure GitLab Jenkins/Concourse Docker Terraform Testing & Quality TDD/BDD Playwright Selenium Cucumber Mockito Swagger Data & Integration Apache Spark Python Airflow Jupyter Notebooks Security & Accessibility WCAG 2.2 compliance Accessibility testing tools (JAWS, Dragon) Security scanning tools such as Trend Micro ...

Power BI Advanced Excel and Power Query Ability to write and optimise DAX Solid understanding of database and data model design Desirable: Python or Apache Airflow SSRS/Power BI Report Builder Experience with automation tools Who you are A problem-solver with a curious mindset. Because ...

Experience with Go and/or Rust - CockroachDB or similar distributed SQL databases - HPC or storage domain knowledge - Workflow orchestration tools such as Temporal, Airflow or Prefect - Data movement tooling at scale - Front-end development experience with frameworks such as React ...