76 to 100 of 130 Apache Airflow Jobs

libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like private healthcare & dental insurance, a generous work from ...

/CD terminology and pipelines in GIT, Jira Cloud & Infrastructure: AWS BedRock, SageMaker AI, Azure Machine Learning, GCP Vertex AI, Kubernetes, Terraform Data Engineering: Apache Kafka, Spark, Airflow, Parquet, SQL, NoSQL and graph databases. Optimization & Scheduling: Constraint optimization (eg. LP), Reinforcement Learning. Education Minimum Bachelors in Computer Science ...

requires a candidate with 8+ years of software and data engineering experience, focusing on API development using Spring Boot and big data technologies like Apache Spark and Airflow. Responsibilities include designing scalable systems, collaborating with cross-functional teams, and mentorship. Candidates should have strong programming skills, SQL expertise ...

development experience, with strong skills in Python. Hands‐on experience with building and deploying data pipelines Familiarity with modern infrastructure (CI/CD, Kafka, Airflow) Excellent communication and collaboration skills Detail orientated, with a commitment to best engineering practices The ability to prioritise, plan and deliver to projects ...

skills ✔ Experience working with cloud platforms (AWS preferred) ✔ Knowledge of data modelling, data architecture and governance ✔ Experience with orchestration tools such as Airflow or Databricks Workflows ✔ Comfortable working closely with stakeholders, working independantly delivering on high profile projects and mentoring team members ✔ Experience delivering complex data solutions from scratch ...

skills ✔ Experience working with cloud platforms (AWS preferred) ✔ Knowledge of data modelling, data architecture and governance ✔ Experience with orchestration tools such as Airflow or Databricks Workflows ✔ Comfortable working closely with stakeholders, working independantly delivering on high profile projects and mentoring team members ✔ Experience delivering complex data solutions from scratch ...

XGBoost, or equivalent tools Experience building and deploying software services, APIs, data pipelines, or internal platforms using tools such as FastAPI, Flask, SQL, Spark, Airflow, dbt, or similar technologies Experience working with time-series, sensor, event, equipment, MES, historian, quality, or other industrial data Experience training, validating, and deploying ...

APIs can be exposed to LLM-based agents. Experience with search relevance & recommendation systems — ranking algorithms, semantic search, personalisation. Hands-on with Snowflake, Databricks, Airflow, Kafka . Why Join Us Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC Shape ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...

love to see: Knowledge of Database Systems and trade offs in the distributed systems Familiarity with API Designs Familiarity with Orchestration Frameworks such as Apache Airflow, Argo Workflows, Dagster etc. Experience working with and designing systems utilizing AWS Bloomberg is an equal opportunity employer and we value diversity ...

understanding of functional paradigms and type theory. Confident JVM knowledge. Modern programming languages knowledge in our primary languages (Java, Python, Clojure). Experience with Airflow or other Python-based workflow orchestration tools. Proficiency in domain-driven design and domain modeling. Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git. ...

GitHub Copilot) with significant examples of delivery improvement AWS (S3, Lambda, EC2, Glue), Snowflake, Git, CI/CD, Datadog, MS SQL Server, REST, GraphQL, Airflow (as many as possible) Degree educated or higher in a relevant technical discipline from a leading university This is a £650-700/ ...

Collaborating closely with consultants, developers, and project teams Helping shape the future of the company’s data capability Tech You’ll Work With Python Airflow Git & GitHub RDF/SPARQL/Semantic Web technologies Cloud and modern data tooling What They’re Looking For Strong experience building scalable data ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

elevate personal and professional impact. Clear communication of objectives and rationale to foster commitment from teammates. Experience with data‐driven workflows using tools like Airflow, EMR, Glue, or Spark. Core Value Embodiment Embody our core values to foster a culture of excellence that drives meaningful impact and collective success. ...

Job Title : Analytical Engineer Target Start Date: ASAP Contract Type: Permanent Salary Range: £55,000 - £70,000 Location: Reigate - Hybrid Closing Date for applications: 8th June Analytical Engineer: We are looking for a talented Analytical ...

following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 at a top tier university Excellent training ...

following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training ...

with AWS/Azure and Kubernetes Proven delivery of large-scale migration programmes Desirable: CI/CD and DevOps experience Integration with tools like Airflow, Snowflake, Databricks Experience in regulated/public sector environments What you need to do now If you're interested in this role, click 'apply ...

Comfortable acting as a technical authority - advising on approach and best practice and communicating clearly with non-technical stakeholders Experience with Azure, SQL, Dagster, Airflow or similar tools acceptable Experience with Python scripting, React-based applications, FactSet and third-party web APIs Desirable: Understanding of financial data experience with ...

creating. You'll have experience with: AWS and cloud-native technologies Snowflake or similar cloud data platforms Data orchestration tools such as Airflow, Prefect or similar Amazon S3 and modern data architectures Postgres and semi-structured data models Event-driven architectures and scalable systems You'll understand how data ...

Robert Half Technology are assisting a rapidly growing sports fashion brand to recruit a Data Engineer on a contract basis. This is an exciting opportunity to join a fast-paced SME environment at a pivotal ...

Skill Requirements:*** Strong experience in **Solution Architecture** and **Cloud-Native Architecture Design*** Hands-on expertise in **Snowflake Architecture*** Experience with **Data Lakehouse architectures**, including **Apache Iceberg*** Proficiency in designing and managing **S3-based Data Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge … large-scale data processing* Ability to create **Architecture Design Documents (ADDs)*** Deep understanding of **cloud-native design patterns*** Experience in **performance tuning** across:* Snowflake* Airflow* Iceberg* Focus on **platform reliability, scalability, and observability*** Experience designing and operating **data platforms** in production environments #J-18808-Ljbffr ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...