Data Engineer

Role Title: Scala Engineer /Data Engineer (CIP)

Duration: 6 month contract

Location: London, mainly remote working with 1 day per month at office for co-working days

Rate: up to £598 p/d Umbrella inside IR35

Role purpose / summary

What is the Customer Insight Platform (CIP)?

• CIP is composed of multiple agile, lean teams who together provide a platform and services to collect, evaluate and analyse customer interaction data.
• Context: Teams across CIP
• CIP focuses on capturing customer interaction data across the client estate and making it easily available to a wide audience through several different channels.
• CIP processes and stores a vast amount of customer interaction data, using cutting edge & emerging technologies to perform bulk operations at scale, whilst operating, maintaining, and improving a critical platform that our consumers depend on.
• It also provides several different channels that allow teams within the client to access and analyse the data in a digestible format to support their day-to-day responsibilities.
• Context: CIP Insights & Reputation Team (CIR) CIP is driven by the principal need to detect and prevent fraudulent access to taxpayer data and prevent organised repayment fraud. Our team splits this process into two phases:

Attribute Reputation

• We build, operate and maintain services that prioritise collecting high quality data, that is verifiable and reputable from Customers; the services we offer can help confirm and validate the data points (or attributes) they have provided.

For example:

Bank Accounts

• Check the sort code exists
• Check against a Third-Party API to confirm that the Sort Code, Account Number and Name provided match the name held by the Bank Addresses Ingest UK Postal Data from Post Office and Ordnance Survey data Provide a postcode lookup for addresses Phone Numbers A verification service that sends a text message via a Third-Party to confirm that the User has access to the mobile device and number provided.

Emails

• A verification service that sends an email to confirm that the User has access to the email they have provided We are constantly building an enhancing these services to continually improve the data attribute quality held by the client. We also continually ingest many other attributes of interest from all transactions across the client that are captured as part of Audit Events.

Insights

• The process through which large amounts of data are collated from tax transactions to glean insights into common attributes. In particular, we assert their validity and derive risk scores for transactions based on whether the attributes in question, or other attributes used in combination with that attribute, have been used in historic transactions associated with past suspicious or fraudulent activity.
• Collaboration with other data product and front-end product teams will form the core of creating a frictionless customer experience to exploit the digital audit data that CIP holds.
• Insights from Attribute Reputation are crucial for the client services, and the CIR team is pioneering data sharing with other government departments and local authorities.
• Desired behaviours
• Be proactive
• Responsible and motivated self-starter
• User centric attitude
• Prioritise people over processes
• Drive lean results; understand the value of iterative delivery Be evidence driven Advocate for ‘doing the right thing’
• Help others understand your work through co-participatory design, pairing, demos and documentation Make complex look and sound simple Be kind, creative and convincing Role description The CIP Insights & Reputation team is seeking a Software/Data Engineer to help develop and maintain both the Attribute and Insights Data Products. We support services that run both on the Multi-Channel Digital Tax Platform (MDTP) and the Customer Insights Platform (CIP).
• The Software Engineer will be part of a vibrant multi-disciplinary team. They should be comfortable around back-end coding languages (Scala/Python), frontend languages (HTML/CSS/JS), development frameworks (Play/Spark), Agile Methodologies/Practices (Kanban/Scrum/Sprint), Operational Support (Kibana/Grafana), CI/CD (Jenkins/Airflow), RESTful APIs, Databases (MongoDB, Postgres, Hudi), AWS (Aurora RDS, S3, ECS, Secrets Manager), Infrastructure as code (Terraform) and third-party libraries.

How we work:

We favour:

• Breaking down a high-level problem as a team upfront and delivering the core value first Delivering individual business benefits to production, rather than bundling tasks together Collaboration, communication, regular pairing and thoughtful course-correction Taking the time to write simple and easy to maintain code Willingness to make and participate in improvements for the greater good of CIP Working cross-discipline rather than adhering to tightly defined roles.
• Common tasks including to:
• Participate in the design and creation of scalable software Design and develop clean functioning, testable code on the frontends and backends, write effective APIs, develop and manage well-functioning databases and applications with security and data protection settings Collaborate with the CIR product owner, business analyst, data engineers and the wider CIP teams to ideate software solutions Peer reviewing pull requests Testing and fixing bugs or other coding issues Set up, maintain and improve continuous integration Support live services with troubleshooting and monitoring Write technical documentation Knowledge & experience Knowledge of frontend languages (HTML, CSS, JavaScript) Knowledge of multiple backend languages (e.g. Scala, Java, Python) and libraries Familiarity with databases (e.g. Postgres, MongoDB, Splunk) Familiarity with big data tools (Spark, Presto, AWS EMR) Proven experience as a Full Stack Developer or similar role Experience coding in continuous integration context AWS suite experience Understands the importance of testing and automation Working in a lean, agile environment Working in a “you build it you run it” team Experience coding in continuous integration context Excellent communication Team player Great attention to detail An analytical mind Skills & technologies

Essential:

• Scala/Java
• Play Framework (or other MVC/Rest API frameworks)
• SQL DB (e.g. Aurora, Postgres)
• NoSQL DB (e.g. MongoDB)
• Linux/Unix AWS (S3, ECS, Lamda, etc.)
• HTML/CSS/JavaScript
• Terraform
• SBT
• Continuous Integration (Jenkins)
• Agile methodologies

Desirable:

• Python
• Airflow
• Docker
• Kibana
• Grafana

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!