19 of 19 Apache Jobs in the North West

skills, with experience of Java or Scala beneficial Experience building large-scale ETL/ELT and data processing pipelines Hands‐on experience with Apache Spark and distributed data processing technologies Experience designing and operating cloud‐native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/ ...

clean, maintainable, and efficient code, ensuring adherence to best practices through code reviewsBig Data EngineeringDesign, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache AirflowOptimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performanceDevelop and fine-tune complex queries using Apache … related field (or equivalent experience)8+ years of experience in software and/or data engineering with expertise in big data technologies such as Apache Spark and Apache AirflowAdvanced SQL skills, with expertise in query optimisation for large datasetsExpertise in developing APIs and robust backend services, with strong ...

stakeholder/data consumer management. Strong programming skills in languages such as Python, familiarity with large scale, distributed data processing engines such as Apache Spark, with a solid understanding of data structures and algorithms. Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL) or NoSQL databases (e.g. ...

volume, data-intensive environments. Extensive AWS experience including services such as Glue, Lambda, S3, Redshift, and wider cloud-native data tooling. Strong knowledge of Apache Spark and large-scale data processing. Experience working with streaming technologies such as Kafka. Expert SQL and data modelling capabilities. Experience designing modern data ...

/ML Familiarity with Microsoft Fabric (Data Engineering, Data Science, Real-Time Analytics) and Azure ML, including MLflow Proficiency with tools such as Apache Spark, Azure Data Factory, GIT, Python and SQL Skilled in developing, training and deploying machine learning models with frameworks like TensorFlow, PyTorch or Scikit-learn ...

platform and lakehouse transformation journeys What We're Looking For Strong commercial experience in Data Engineering Hands-on experience with Databricks and/or Apache Spark Strong PySpark and SQL development skills Experience designing, building and supporting data pipelines Experience working with Azure or AWS Good understanding of modern ...

concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise• Observability – Experience ...

have strong hands-on experience of building scalable data pipelines in cloud based environments using tools such as DBT, AWS Glue, AWS Lake Formation, Apache Spark and Amazon Redshift You have a good knowledge of data modelling, ELT design patterns, data governance and security best practices You're collaborative ...

Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.You’ll build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Delta Live Tables (DLT), and Kafka (MSK), ensuring our business teams across Liquidity, Product, Marketing, Finance, and Compliance have fast, trusted … looking for:We’re looking for an experienced Data Engineer with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark or Scala, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well ...

configuration management and an interest in migrating to Ansible and cloud native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

Upgrades and Support Package Stack patchingSystem copies & refreshesLog and trace file analysisSolution ManagerHANA Database AdministrationDesirable but not essential: Installation Performance analysisWeb Dispatcher, SAP Router, Apache administration skillsSSL/TLS knowledgeCloud Connector install and configSSO/IAMKnowledge of SAP/HANA/Oracle HA and DR set upBackup & RecoverySAP Cloud ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

make improvements for the long-term. Docker Java/Scala Event streaming technologies such as Kafka, Pulsar, or Azure Event Hub Integration with Collibra Apache Iceberg Apache Arrow Pyspark AI engineering (Snowflake AI, Langchain, Llamaindex, Pinecone, etc) Insight is committed to being an inclusive employer and encourages applications ...

coding skills (any version, but we use Oracle) Experience coding in at least one dynamic scripting language (e.g., Python, Node JS, PowerShell or Apache Groovy) Business reporting intelligence experience (using tools like BIRT, Tableau or Power BI) Knowledge of REST APIs and standard HTTP methods and data migration; either ...

needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking … experience with TerraformExperience in creating workflows for Apache Airflow#LI-GL1What's Roku's approach to hybrid working Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

software development team Hands-on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands-on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross-functional … highly scalable data engineering solutions that power Moody's next generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody's technical teams ...

ESXi, Windows 11, Ubuntu LTS, Dell PowerEdge, HP ProLiant, NetApp, Palo Alto, SonicWall, Check Point, UniFi, Aruba, Veeam, Bitdefender, PRTG, SQL Server, MySQL, IIS, Apache, WSUS, and related technologies. Desirable ITIL Foundation. Microsoft certifications. VMware experience. Exposure to cybersecurity, SIEM, and MDR solutions. This is an excellent opportunity ...