A global technology consulting and digital solutions client of ours is looking for a Senior BigData Platform Engineer to join their growing team in the UK. Below are more details of the position - Ideal Qualifications Must Have - Platform engineer, Azure DevOps and CI/CD … tools, Azure Cloud, Microsoft Fabric, Azure Services, Apache Spark, Experience of using IAC (terraform, APIs), DataEngineer, BigData, PySpark Solid understanding of data Engineering concepts & experience of building and maintaining reliable & scalable bigdata platforms Experience of integrating azure hosted platforms withing more »
Extensive experience working with large data sets with hands on technology skills to design and build robust BigData solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement … and analyze the source system data to come up with a high performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB Good to have Knowledge in ADF CI CD Experience in designing architecting … and implementing large scale data processing data storage data distribution systems Ability to produce high quality work products under pressure and within deadlines Strong understanding of BigData Analytics platforms and ETL in the context of BigData Ability to frame architectural decisions more »
Extensive experience working with large data sets with hands on technology skills to design and build robust BigData solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement … and analyze the source system data to come up with a high performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB Good to have Knowledge in ADF CI CD Experience in designing architecting … and implementing large scale data processing data storage data distribution systems Ability to produce high quality work products under pressure and within deadlines Strong understanding of BigData Analytics platforms and ETL in the context of BigData Ability to frame architectural decisions more »
london (city of london), south east england, United Kingdom
McGregor Boyall
Data Analytics Engineer - Inside IR35 - £600 - 800 Per day I am actively recruiting for an Immediate start Data analytics opportunity in Central London. This is for an international investment banking firm and will require a strong background in business change and transformation focussed expressly around Data analytics and Bigdata platforms. 5+ years of BigData Experience utilising Pyspark 5+ years of managing data analytical projects within a financial domain (Banking/Investments) Background within investment managment, financial services, etc. Project management experience, consultancy experience to deal and operate with more »
The role involves the design, development, implementation, and support of a cutting-edge real-time data platform, which includes data streaming, a data lake, and a blazing fast analytics database. We are looking for someone who is passionate, motivated, driven, and up for the challenge. Strong knowledge … of database design and development with previous experience in developing ETL processes, and multidimensional data models. High understanding of both relational and multidimensional modelling principles. Deep knowledge of Object-Oriented Programming languages and must have a strong experience in Java. Strong experience on data quality standards and contribution … on defining and monitoring data quality metrics and KPIs Key Skills Needed: Flink Beam Kafka Connect Java more »
Data Analytics Engineer - Inside IR35 - £600 - 800 Per day I am actively recruiting for an Immediate start Data analytics opportunity in Central London. This is for an international investment banking firm and will require a strong background in business change and transformation focussed expressly around Data analytics and Bigdata platforms. 5+ years of BigData Experience utilising Pyspark 5+ years of managing data analytical projects within a financial domain (Banking/Investments) Background within investment managment, financial services, etc. Project management experience, consultancy experience to deal and operate with more »
Some of the main Objectives of the Data Intelligence Platform are: • Efficiently load and transform data into a DWH • Provide advanced orchestration to use Data Lake based approach • Integration with 3rd party sources, open-source APIs • Data movement in both batch and real-time change data capture • Leverage BigData technologies (Spark) to ingest, clean & transform data • Apply Machine Learning on DWH to proactively figure out issues and generate insights • Create dashboards in Oracle Analytics Cloud to drive decision-making Your Opportunity You will be responsible for applying your extensive knowledge as … a dataengineer and building Digital Government Data Platform . Our Ideal Candidate We are looking for a strong DataEngineer who thrives on research and development projects. Be technically strong and hands-on, who works efficiently with other product groups and engineering leaders to more »
Exciting Opportunity: Python/Spark BigData Software Engineer - Financial Services Sector Location: Glasgow Contract: 6 Months (Inside IR35) Rate: Up to £600 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in … the financial services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark BigData Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond … traditional methods to tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying more »
Technology (IT) Group Functions Job Reference # 294845BR City London Job Type Full Time Your role Do you have proven track record of building bigdata solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in … class, cloud native bigdata solutions? We’re looking for a BigData Lead Engineer to: • engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively. • transform data into … valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques. • develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems. • ensure the quality, security, reliability, and compliance of our solutions by applying our digital more »
