3 of 3 Apache Spark Jobs in Hounslow

robust, efficient, and ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data … experience with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles. Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components. Experience working with ETL tools such as Informatica for data integration tasks. Demonstrated ability to analyze complex ...

Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises and Azure SQL) and Oracle Database ingestion into Azure landing zones Strong Apache Spark skills — PySpark or Scala, optimisation, partitioning, and job scheduling in Databricks Experience assessing and remediating partially built or vendor-abandoned data platform ...

lead the design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security. You will leverage Informatica and scripting ...