Back to all work

UK central government

UK government justice department

Reports that match the figures staff already trust, checked by automated tests and delivered securely.

Client
UK government justice department
Sector
UK central government
My role
Data engineer, reporting pipeline

Context and challenge

Staff relied on operational reports that had to match the figures they already trusted. The data sat across many services, and the reports could not go wrong. The work is sensitive, so I describe it in general terms.

What I did

I built the mission critical reporting pipeline from request to finished report, with automated checks and secure delivery. I also protected personal data and sped up the slow queries.

Solution

  1. 01

    Built the pipeline end to end

    From the report request to the finished file, so one pipeline owns the whole path.

  2. 02

    Matched the figures staff trust

    Output is checked by automated tests against the numbers people already rely on.

  3. 03

    Delivered securely

    Reports move through secure cloud storage with time-limited access.

  4. 04

    Protected personal data

    Personal information is kept out of logs and places it should not be.

  5. 05

    Made it fast enough

    Tuned the heavy queries so reports people wait on arrive on time.

Impact

Reports that match the figures staff already trust, checked by automated tests and delivered securely.

Secure deliveryAutomated testsQuery tuningCloud storage

Tell me where the data hurts most.

A 15 minute call. I will tell you honestly whether I can help.