teams to support the orchestration of our ETL pipelines using Airflow and manage our tech stack including Python, Next.js, Airflow, PostgreSQL MongoDB, Kafka and Apache Iceberg. Optimize infrastructure costs and develop strategies for efficient resource utilization. Provide critical support by monitoring services and quickly resolving production issues. Contribute to more »
in alignment with strategic business priorities. Workflow Development: gathering requirements and design solutions alongside stakeholders to build workflows which enhance user experience, using the Apache Groovy programming language or Python Develop and implement integrations between Collibra and different platforms and systems within the Society Build, design and upload Microsoft more »
science, e.g., SQL, R and Python alongside the ability to use tools and packages such as Alteryx, Jupyter notebook, R Markdown, TensorFlow, Keras, Pytorch, Apache Spark etc. oPractical proficiency in producing reproducible code and pipelines including documentation, governance and assurance frameworks, automation and code review using tools such as more »
of the day to day role): Virtualisation with KVM/QEMU Scripting skills (Powershell, Python, Bash, Ruby, Perl, etc.) LAMP (or components of - Linux, Apache, MySQL, PHP) OpenStack (or similar cloud software platform) VMware ESXi Hypervisor Data Modelling tools (XML, NETCONF, YANG, JSON) Must have the ability to break more »
to develop unit test cases. Help in backlog grooming. Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache Spark Expertise in performing complex data transformation using Spark SQL queries Experience in orchestrating data pipelines using Apache Airflow Proficiency in Git based more »
South East London, England, United Kingdom Hybrid / WFH Options
Maclean Moore
given requirement.Ensure to develop unit test cases.Help in backlog grooming.Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache SparkExpertise in performing complex data transformation using Spark SQL queriesExperience in orchestrating data pipelines using Apache AirflowProficiency in Git based version control toolsProficiency more »
to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool …/CD and Infrastructure as Code (Terraform) You're familiar with other languages such as Java and are open to learning new things e.g. Apache Flink You've worked on systems that require high throughput and low latency You enjoy problem solving and have great communication and collaboration skills more »
City of London, London, United Kingdom Hybrid / WFH Options
Client Server
to production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool …/CD and Infrastructure as Code (Terraform) You're familiar with other languages such as Java and are open to learning new things e.g. Apache Flink You've worked on systems that require high throughput and low latency You enjoy problem solving and have great communication and collaboration skills more »
