test(backend): fail the build when the compose file lacks a required variable (#107)
SonarQube Analysis / sonarqube (pull_request) Canceled after 0s
Tests / lint (pull_request) Canceled after 0s
Tests / backend-unit (pull_request) Canceled after 0s
Tests / frontend-e2e (pull_request) Canceled after 0s

The one-line compose fix in the previous commit unblocks QA. This is the part that stops it happening again, and it is the more useful half.

The failure was not really a missing variable. It was that nothing connected two files: envValidation.ts gained a required variable, docker-compose.qa.yml did not set it, and nothing noticed until a container refused to boot on deploy. CI passed the whole time, because CI supplies its own environment and never reads the compose file — which is exactly why "CI is green" was the wrong evidence to have offered.

So a unit test now reads the compose file and asserts it sets everything the validator demands. It imports ALWAYS_REQUIRED rather than restating it, which is the only version of this test worth having: a copied list would pass forever while the next variable added to the validator went unguarded in precisely the same way.

Two further assertions earn their place. UPLOADS_DIR is hardcoded rather than taken from a stack variable on the grounds that it must agree with the volume mapping, so the test checks it against the mount rather than leaving that a claim in a comment. And ADMIN_GATE_SECRET must be present as an interpolation rather than a literal, since a secret in the repository would defeat the point of having one.

There is also a test guarding the test: a regex that matched nothing would make every other assertion in the file vacuously true, so one case asserts that parsing found entries at all.

Fired deliberately rather than assumed. Removing the UPLOADS_DIR line reproduces the original failure as two failing tests; restoring it returns to ten passing. A guard that has only ever been observed passing is not known to guard anything.

What this cannot do is check production, which runs from a Portainer stack outside this repository. That gap is now written into the README beside the validation rules, along with the reason a variable set only in Portainer's stack UI never reaches the container: stack variables are interpolated into the compose file, not handed to the service.

172 unit tests pass, lint unchanged at 4 warnings.

Refs #107
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
2026-08-21 17:35:17 -05:00
parent 0710cccac1
commit a2500a9901
3 changed files with 87 additions and 1 deletions
+4
View File
@@ -97,6 +97,10 @@ mkdir -p /tmp/redefined-uploads
`PUBLIC_URL` is required only alongside SMTP because its only job is building links in email; an environment that cannot send mail does not need it. `UPLOADS_DIR` has no such reprieve — its fallback of `/app/uploads` is correct inside the container and wrong everywhere else.
**Adding to the required list has reach beyond this repository.** A variable added to `ALWAYS_REQUIRED` must also be set in every environment that deploys, and there are two of those. `docker-compose.qa.yml` is checked automatically — `backend/tests/unit/composeEnvironment.test.ts` reads the validator's own list and fails if the compose file does not set something on it, which is what #107 existed to prevent from recurring. Production runs from a Portainer stack **outside this repository**, so nothing can check it: that one has to be updated by hand, before the deploy rather than during it.
Note also that setting a variable in Portainer's stack environment is not the same as giving it to the container. Stack variables are interpolated into the compose file as `${VAR}`; a service receives exactly what its own `environment:` block lists. A variable with no line there never arrives, however carefully it was set in the UI.
**Note (PowerShell):** environment variables set with `$env:` only last for the current terminal session/tab. If you close and reopen VS Code's terminal, you'll need to re-run step 3 before starting the backend again.
### 4. Run the backend
+7 -1
View File
@@ -27,7 +27,13 @@ export interface EnvValidation {
}
// Without these the process cannot do its job at all.
const ALWAYS_REQUIRED = [
//
// Exported so tests/unit/composeEnvironment.test.ts can assert the deploying
// environment actually sets them. #107 happened because this list grew and
// docker-compose.qa.yml did not: the check has to read this list rather than a
// copy of it, or the next variable added here goes unguarded in exactly the
// same way.
export const ALWAYS_REQUIRED = [
'PGHOST',
'PGPORT',
'PGUSER',
@@ -0,0 +1,76 @@
import { readFileSync } from 'fs';
import path from 'path';
import { ALWAYS_REQUIRED } from '../../src/envValidation';
/**
* The guard for #107.
*
* That failure was not the missing variable — it was that nothing connected two
* files. envValidation.ts gained a required variable and docker-compose.qa.yml
* did not set it, and nothing noticed until the container refused to boot on a
* deploy. CI passed throughout, because CI sets its own environment and never
* reads the compose file.
*
* So this reads the real list from the validator rather than a copy. A copy
* would pass forever while the next added variable went unguarded in precisely
* the same way.
*
* What this cannot cover: production runs from a Portainer stack outside this
* repository, so nothing here can check it. Adding a required variable still
* means updating that stack by hand, and this test is not evidence that it was
* done.
*/
const COMPOSE_PATH = path.resolve(__dirname, '..', '..', '..', 'docker-compose.qa.yml');
const compose = readFileSync(COMPOSE_PATH, 'utf8');
// Only real environment entries — `- NAME=value` at an indented list position.
// A mention inside a comment cannot match, because a comment line starts with #.
function environmentEntries(source: string): Map<string, string> {
const entries = new Map<string, string>();
for (const line of source.split('\n')) {
const match = /^\s+- ([A-Z_0-9]+)=(.*)$/.exec(line);
if (match) {
entries.set(match[1], match[2].trim());
}
}
return entries;
}
const entries = environmentEntries(compose);
describe('the QA compose file provides everything the app requires to boot', () => {
it('parsed some environment entries at all', () => {
// Guards the guard: a regex that matched nothing would make every
// assertion below vacuously true.
expect(entries.size).toBeGreaterThan(5);
});
it.each([...ALWAYS_REQUIRED])('sets %s', (name) => {
expect(entries.has(name)).toBe(true);
});
// DEMO_MODE is required too, but validated separately from ALWAYS_REQUIRED
// because its rule is stricter than presence — it must be exactly 'true' or
// 'false'. Named explicitly here so it is not missed by reading only the list.
it('sets DEMO_MODE, to one of the two values that are allowed', () => {
expect(entries.has('DEMO_MODE')).toBe(true);
expect(['true', 'false']).toContain(entries.get('DEMO_MODE'));
});
// The reason UPLOADS_DIR is hardcoded rather than taken from a stack
// variable is that it has to agree with the volume mapping. That claim is
// only worth making if something checks it.
it('points UPLOADS_DIR at the directory the uploads volume is mounted on', () => {
const uploadsDir = entries.get('UPLOADS_DIR');
expect(uploadsDir).toBeTruthy();
expect(compose).toContain(`:${uploadsDir}`);
});
// Interpolated rather than hardcoded, so the secret itself never enters the
// repository. Present as a reference is what matters; an unset stack variable
// resolves to empty, which the validator and the gate both read as "off".
it('references ADMIN_GATE_SECRET from the stack rather than holding a value', () => {
expect(entries.get('ADMIN_GATE_SECRET')).toBe('${ADMIN_GATE_SECRET}');
});
});