engineers of varying levels of experience. Flexibility and willingness to adapt to new software and techniques. Nice to Have Experience working with projects in Apache Spark, Databricks of similar. Expert cloud platform knowledge, e.g. Azure What will be your key responsibilities? A technical expert and leader on the Petcare more »
Belfast, Northern Ireland, United Kingdom Hybrid / WFH Options
Version 1
Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks). Experience building data warehouse solutions using ETL/ELT tools such as SQL Server Integration Services (SSIS), Oracle Data Integrator … ODI), Talend, and Wherescape Red. Experience with Azure Event Hub, IOT Hub, Apache Kafka, Nifi for use with streaming data/event-based data Experience with other Open Source big data products eg Hadoop (incl. Hive, Pig, Impala) Experience with Open Source non-relational/NoSQL data repositories (incl. more »
API/Microservices .Containerization (Kubernetes) and Workflow orchestration (Temporal) .Strong skills in distributed architecture – local and cross site resiliency and failover .Achieving scalability on Apache Nifi based data pipelines to run several concurrent data movement feeds .Being able to visualize and integrate the platform and application architecture .Own and … product (Kinisi) Strongly preferred skills: OpenSearch, Prometheus, Grafana, log management and observability tools/technologies, Java - API/Microservices, UI/UX, Kubernetes, Temporal, Apache Nifi Soft Skills: .Strong skills in communicating architecture, pros and cons of design/architecture and being able to lead customer a solution proactively. more »
Derby, Derbyshire, East Midlands, United Kingdom Hybrid / WFH Options
Devtank Ltd
Required Skills: * Native on Linux command line. * Python web development - specifically experience with aiohttp * JavaScript/CSS/HTML/SSL * MySQL * Debian/Apache/NGINX server admin experience * Evidence of engaging with open source projects communities. * Competent at using Git for source control. * Passionate about open source more »
Employment Type: Permanent, Part Time, Work From Home
to create scalable code. Application testing and bug fixing. Creating the Back End elements. Must Have Skills : Python, Pandas, PySpark, Kubernetes, Rest API, S3, Apache AirFlow Recruiter Email: (see below more »
Extremely talented in applying SCD, CDC and DQ/DV framework. Familiar with JIRA & Confluence . Must have exposure to technologies such as dbt, Apache airflow, and Snowflake . Desire to continually keep up with advancements in data engineering practices. Knowledge of AWS cloud, and Python is a plus. … Requirements 5+ years of IT experience with major focus on data warehouse/database related projects Must have exposure to technologies such as dbt, Apache Airflow, Snowflake. Experience in data platforms: Snowflake, Oracle, SQL Server, MDM etc Expertise in writing SQL and database objects - Stored procedures, functions, and views. … Hands-on experience in ETL/ELT and data security, SQL performance optimization and job orchestration tools and technologies e.g., dbt, APIs, Apache Airflow, etc. Experience in data modeling and relational database design Well-versed in applying SCD, CDC, and DQ/DV framework. Demonstrate ability to write new more »
Excellent written and verbal communication skills Experience with DevOps frameworks Entity Framework or similar ORM. Continuous Integration, Configuration Management. Enterprise Service Bus (ESB) Management (Apache Active MQ or NIFI) Technical Writing. Past Intelligence Systems experience. Experience with Test Driven Development Some system administration experience Experience with Jira, Confluence U.S. more »
professionalism in a diverse customer environment • Currently hold an active TS/SCI with Polygraph clearance Preferred Qualifications: • Database Administration • PostgreSQL (or equivalent) • ActiveMQ • HTTPD and website maintenance • PKI management and user authentication • SIGINT processing experience • Experience with agile development • Experience with Geographic Information Systems (GIS) or Signal Intelligence (SIGINT more »
professionalism in a diverse customer environment • Currently hold an active TS/SCI with Polygraph clearance Preferred Qualifications: • Database Administration • PostgreSQL (or equivalent) • ActiveMQ • HTTPD and website maintenance • PKI management and user authentication • SIGINT processing experience • Experience with agile development • Experience with Geographic Information Systems (GIS) or Signal Intelligence (SIGINT more »
professionalism in a diverse customer environment • Currently hold an active TS/SCI with Polygraph clearance Preferred Qualifications: • Database Administration • PostgreSQL (or equivalent) • ActiveMQ • HTTPD and website maintenance • PKI management and user authentication • SIGINT processing experience • Experience with agile development • Experience with Geographic Information Systems (GIS) or Signal Intelligence (SIGINT more »
professionalism in a diverse customer environment • Currently hold an active TS/SCI with Polygraph clearance Preferred Qualifications: • Database Administration • PostgreSQL (or equivalent) • ActiveMQ • HTTPD and website maintenance • PKI management and user authentication • SIGINT processing experience • Experience with agile development • Experience with Geographic Information Systems (GIS) or Signal Intelligence (SIGINT more »
Engineering, providing DevOps support, and/or RHEL administration for mission-critical platforms, ideally Kafka. 4+ years of combined experience with Kafka (Confluent Kafka, Apache Kafka, Amazon MSK) 4+ years of experience with Ansible automation Must be able to obtain and maintain a Public Trust. Contract requirement. Selected candidate … Solid experience using version control software such as Git/Bitbucket including peer reviewing Ansible playbooks Hands-on experience administrating Kafka platform (Confluent Kafka, Apache Kafka, Amazon MSK) via Ansible playbooks or other automation. Understanding of Kafka architecture, including partition strategy, replication, transactions, tiered storage, and disaster recovery strategies. … STAND OUT FROM THE CROWD (Desired Skills) Showcase your knowledge of modern development through the following experience or skills: Preferred Confluent Certified Administrator for Apache Kafka (CCAAK) or Confluent Certified Developer for Apache Kafka (CCDAK) Practical experience with event-driven applications and at least one event processing framework more »
City of London, London, United Kingdom Hybrid / WFH Options
TECHNOLOGY RECWORKS LIMITED
sponsors) Knowledge and experience of the following would be advantageous: Knowledge of Enterprise Architecture Frameworks Good knowledge of Azure DevOps Pipelines Strong experience in Apache Spark framework Previous experience in designing and delivering data warehouse and business intelligence solutions using on-premises Microsoft stack (SSIS, SSRS, SSAS) Knowledge of more »
Manchester, North West, United Kingdom Hybrid / WFH Options
TECHNOLOGY RECWORKS LIMITED
sponsors) Knowledge and experience of the following would be advantageous: Knowledge of Enterprise Architecture Frameworks Good knowledge of Azure DevOps Pipelines Strong experience in Apache Spark framework Previous experience in designing and delivering data warehouse and business intelligence solutions using on-premises Microsoft stack (SSIS, SSRS, SSAS) Knowledge of more »
required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes, Helm and CI more »
required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes, Helm and CI more »
eCommerce or other complex applications. - Proficiency in OOP PHP (7.*), software design patterns, and MySQL databases. - Basic knowledge of JavaScript, HTML, CSS. - Familiarity with Apache or Nginx and basics of Linux. **Desirable:** - Familiarity with PSR coding standards and open-source frameworks (e.g., Zend, Symfony, Laravel). - Experience developing APIs more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Colossus Recruitment Limited
eCommerce or other complex applications. - Proficiency in OOP PHP (7.*), software design patterns, and MySQL databases. - Basic knowledge of JavaScript, HTML, CSS. - Familiarity with Apache or Nginx and basics of Linux. **Desirable:** - Familiarity with PSR coding standards and open-source frameworks (e.g., Zend, Symfony, Laravel). - Experience developing APIs more »
Key responsibilities: Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem. Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments. Read, understand, and modify open-source code to implement bug fixes and perform upgrades. Ensure all … applications. Your Profile Key Skills/Knowledge/Experience: Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios. Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or … Google Cloud Platform. Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (eg, HDFS, Hive, HBase, Spark, Ranger, Kafka, Yarn etc.). Proficiency in Kubernetes for container orchestration. Strong understanding of security practices within big data environments. more »
integration architecture and design skills Good communication skills Desirable Skills: JavaScript - with React/Vue being even better. Docker/Kubernetes Linux - Basic sysadmin (Apache, Nginx) SQL/Oracle/PostgreSQL/MongoDB/DynamoDB Message Queues - RabbitMQ or similar AWS or GCP This an office based position DCS more »
