101 to 111 of 111 Apache Jobs

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven ability to design, build and lead delivery of reliable data products. This is a permanent role based … Strong proficiency in SQL and Python - Experience with modern cloud data platforms and lakehouse architectures - Hands-on experience with big data technologies such as Apache Spark or Databricks - Strong knowledge of data warehousing concepts - Experience with build, test and deployment automation - Proven leadership capability leading or mentoring data engineering ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop … Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We understand the usage ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

vector databases like Pinecone, FAISS, Weaviate. Develop embedding pipelines and semantic search. Optimize indexing and retrieval performance. Spark & Data Processing Build data pipelines using Apache Spark. Handle large-scale data processing. Optimize performance and scalability. CI/CD & DevOps Implement CI/CD pipelines. Manage deployments and version control. … like Docker. Required Skills 6–10+ years of experience in development. Strong Python programming skills. Experience with Gen AI and vector DB. Experience with Apache Spark. Preferred Skills Experience with Google Cloud Platform (GCP). Knowledge of AI/ML lifecycle practices. ...

requirements 3+ years of Python in production environments Strong AWS experience across core services Strong SQL skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write … across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

Cloud Engineer – Azure Annual Salary: £55491 Location: Newquay - one day per week on site Job Type: Full-time Reed Technology are delighted to be working with a highly regarded organisation with their search for an ...

part of a team, and on your own projects Good programming experience in some or all the following programming technologies: Linux (Debian, Ubuntu), Apache, Database Administration (MySQL), Programming knowledge (Bash, Python, PHP, ReactJS and NodeJS) Experience of CI/CD pipelines, Bitbucket and JIRA environments Experience of at least … Technology, you will also lead and mentor the Developer and Graduate Developer working in your immediate team. The main development software technologies include Debian, Apache, MySQL, Python, PHP, ReactJS and NodeJS. As part of this role my client expect the successful candidate to continuously improve their skill ...

customer a Financial Technlogy organisation, we are seeking a Linux Engineer with strong Apache CloudStack skills for a 12 month contract The role requires 3 days per week onsite presence in either London (Canary Wharf) or Birmingam (Central) Linux Platform Engineering • Design, document, deploy, and manage Ubuntu-based Linux … automation using tools such as Ansible, Terraform, and shell/Python scripting • Translate system, software, and operational requirements into scalable, resilient Linux infrastructure designs Apache CloudStack & Virtualisation • Design, deploy, and operate Apache CloudStack environments including management servers, zones, pods, clusters, and primary/secondary storage • Manage KVM hypervisors ...

operate the Event Hub platform that enables event-driven capabilities across the enterprise. In this role, you will own the underlying Confluent Kafka and Apache Flink infrastructure, ensuring it is production-grade, highly available, scalable, and resilient, with robust disaster recovery. Key Responsibilities Provision, configure, and manage Confluent Kafka … brokers, topics/partitions, ACLs, schema registry) and enforce platform governance standards (retention, quotas, security). Operate Apache Flink infrastructure (job/task managers, checkpointing, state backend) and support runtime availability and performance. Design and maintain high availability (AZ/region) and disaster recovery plans, including failover testing ...

Housing solutions. Proven experience installing and supporting software on Linux, Solaris. Experience on Windows is a bonus. Hands on deployment and support of Apache Tomcat based applications. Experience working in live customer environments, providing production support. Practical experience using ITSM tools such as Ivanti, ServiceNow, or similar. Ability … operationally involved. Strong customer communication skills across video, telephone, and email. Eligibility for UK Security Clearance. Desirable Skills/Experience Oracle Certification. Experience with Apache Web Server configuration and support. Unix/Linux shell scripting skills for automation. Experience implementing scripted database and application backup and recovery processes. Understanding ...

Data Engineer, working with large-scale, complex datasets in regulated environments Scala development experience supporting analytics or data-processing solutions Hands-on experience with Apache Spark for large-scale distributed data processing Experience with model calibration, threshold management, and score explainability to meet AML governance and regulatory standards Ability … Analyst or Data Engineer, working with large, complex datasets in regulated environments Solid Scala development experience, writing and supporting scalable data and analytics solutions Apache Spark experience, including batch and/or dynamic processing of high-volume data About Us FDM is an award-winning global leader in tech ...