agent: lumotia — Phase A.1+A.2 rebrand migration tests + copy_dir_recursive hardening
Phase A of dogfood verification for the Magnotia -> Lumotia rebrand
cascade. The existing in-crate unit tests prove the migration copies
bytes correctly; this commit closes the gaps an atomiser-grade review
would flag.
Phase A.1 — end-to-end integration test (crates/storage/tests/legacy_db_migration.rs):
Seeds a real on-disk magnotia.db via lumotia_storage::init (which runs
every schema migration head-to-tail), inserts a transcript via the
public API, drops the pool, runs migrate_legacy_data_dir_with_pairs,
then re-opens the migrated lumotia.db and asserts the transcript is
queryable. Three scenarios covered:
1. Legacy-only -> migrate -> reopen -> row survives. Also verifies a
non-DB companion file is carried along by the directory rename.
2. Idempotency: first boot migrates, user writes new data, second
boot is a no-op and BOTH rows survive.
3. Both-paths-present: refuses to merge, target's empty DB is
preserved, legacy retained on disk as a backup.
Wires the test surface by renaming the previously-private
migrate_legacy_data_dir_inner to pub migrate_legacy_data_dir_with_pairs
(mirroring migrate_tauri_app_data_dir_with_paths in the sibling
tauri_app_data_migration module).
Phase A.2a — copy_dir_recursive hardening (crates/core/src/paths.rs):
Pre-existing footgun: the fall-through branch called std::fs::copy()
on any DirEntry that was not a symlink or a directory. On Unix that
includes FIFOs, sockets, and char/block device nodes. Opening a FIFO
for read with no writer attached blocks forever — a stale debug FIFO
in the user's ~/.magnotia tree would silently hang first launch.
The branch now explicitly distinguishes is_file() (real regular file
-> copy) from anything else (-> Err with ErrorKind::Unsupported,
naming the offending path). Migration becomes re-runnable once the
user cleans up the offending node. Same-filesystem rename via
std::fs::rename is atomic and unaffected; only the EXDEV fallback path
touches the new guard.
Phase A.2b — three adversarial probes (crates/core/src/paths.rs tests):
- FIFO inside the legacy tree: copy_dir_recursive must return an
Unsupported error WITHOUT hanging. Test bounded by a 5s wall clock
+ a worker thread so a regression to the old fall-through would
surface as a panic, not a stalled CI job.
- Unreadable file (mode 0000): copy_dir_recursive must surface
PermissionDenied, not silently skip. Skips its core assertion under
euid 0 (root bypasses DAC permissions, would mask the regression).
- Dangling symlink (target nonexistent): symlink is recreated at
destination with link target preserved verbatim; the migration
does NOT try to dereference and does NOT abort the rest of the copy.
Verification:
- cargo fmt --check: clean
- cargo clippy --workspace --all-targets -- -D warnings: clean
- cargo test --workspace: 409 passed, 0 failed (up from 405 pre-commit;
3 storage integration tests + 3 paths adversarial + 1 net carry-over)
This commit is contained in:
@@ -29,3 +29,12 @@ thiserror = "1"
|
||||
|
||||
# UUIDs for profile + profile_terms ids (v7 random).
|
||||
uuid = { version = "1", features = ["v4"] }
|
||||
|
||||
[dev-dependencies]
|
||||
# Real-file tempdirs for integration tests that need an on-disk DB (the
|
||||
# in-memory `sqlite::memory:` connection in src/database.rs unit tests
|
||||
# doesn't cover the rename-then-reopen path the rebrand migration exercises).
|
||||
tempfile = "3"
|
||||
# `rt-multi-thread` is required for the `#[tokio::test(flavor = "multi_thread")]`
|
||||
# variants that drive blocking lumotia_core::paths migrations from async tests.
|
||||
tokio = { version = "1", features = ["rt", "rt-multi-thread", "sync", "macros"] }
|
||||
|
||||
282
crates/storage/tests/legacy_db_migration.rs
Normal file
282
crates/storage/tests/legacy_db_migration.rs
Normal file
@@ -0,0 +1,282 @@
|
||||
//! End-to-end migration test for the Magnotia -> Lumotia rebrand.
|
||||
//!
|
||||
//! The in-crate unit tests in `crates/core/src/paths.rs` prove that the
|
||||
//! migration copies bytes and renames files correctly, but they don't
|
||||
//! verify that the resulting `lumotia.db` is *openable* by
|
||||
//! `lumotia-storage`. A byte-perfect copy with a torn SQLite header,
|
||||
//! a stale WAL pointer, or a row count off by one would still pass
|
||||
//! those tests. This integration test closes that gap by:
|
||||
//!
|
||||
//! 1. Seeding a real on-disk `magnotia/magnotia.db` via the public
|
||||
//! `lumotia_storage::init` API (which runs every schema migration
|
||||
//! head-to-tail). A real transcript row is inserted via
|
||||
//! `insert_transcript`, then the pool is dropped to flush + close.
|
||||
//! 2. Running the rebrand migration via
|
||||
//! `lumotia_core::paths::migrate_legacy_data_dir_with_pairs` with
|
||||
//! the synthesised (legacy, target) pair.
|
||||
//! 3. Re-opening the migrated `lumotia/lumotia.db` via `init`
|
||||
//! (which re-runs migrations — they must be no-ops against the
|
||||
//! already-migrated schema) and querying for the inserted
|
||||
//! transcript by id.
|
||||
//!
|
||||
//! If any of the three steps fails — rename, reopen, or query — the
|
||||
//! migration is unsafe to ship even though the unit tests pass.
|
||||
|
||||
use std::path::Path;
|
||||
|
||||
use lumotia_core::paths::{migrate_legacy_data_dir_with_pairs, MigrationStatus};
|
||||
use lumotia_storage::{
|
||||
get_transcript, init, insert_transcript, list_transcripts, InsertTranscriptParams,
|
||||
DEFAULT_PROFILE_ID,
|
||||
};
|
||||
use tempfile::TempDir;
|
||||
|
||||
const SEEDED_TRANSCRIPT_ID: &str = "t-rebrand-survivor";
|
||||
const SEEDED_TRANSCRIPT_TEXT: &str =
|
||||
"Migration sentinel row. If this read fails, the rebrand orphaned user data.";
|
||||
const SEEDED_TRANSCRIPT_TITLE: &str = "rebrand-survivor";
|
||||
|
||||
/// Drop the pool and yield long enough for sqlx's background reaper to
|
||||
/// close its connections. The integration test re-opens the migrated DB
|
||||
/// immediately afterwards, so any sqlx-held file descriptor on Windows
|
||||
/// would block the rename. tokio's `yield_now` is a single scheduler
|
||||
/// hop, not a sleep — enough to flush the pool's tokio task queue.
|
||||
async fn drop_and_yield(pool: sqlx::SqlitePool) {
|
||||
pool.close().await;
|
||||
tokio::task::yield_now().await;
|
||||
}
|
||||
|
||||
/// Build the canonical seed-row params. Centralised so the assertions
|
||||
/// in each test can reference the same expected values without drift.
|
||||
fn seed_params() -> InsertTranscriptParams<'static> {
|
||||
InsertTranscriptParams {
|
||||
id: SEEDED_TRANSCRIPT_ID,
|
||||
text: SEEDED_TRANSCRIPT_TEXT,
|
||||
source: "microphone",
|
||||
profile_id: DEFAULT_PROFILE_ID,
|
||||
title: Some(SEEDED_TRANSCRIPT_TITLE),
|
||||
audio_path: None,
|
||||
duration: 2.5,
|
||||
engine: Some("whisper"),
|
||||
model_id: Some("whisper-tiny-en"),
|
||||
inference_ms: Some(420),
|
||||
sample_rate: Some(16_000),
|
||||
audio_channels: Some(1),
|
||||
format_mode: Some("plain"),
|
||||
remove_fillers: false,
|
||||
british_english: true,
|
||||
anti_hallucination: false,
|
||||
}
|
||||
}
|
||||
|
||||
/// Seed `<legacy>/magnotia.db` with the live schema head and one
|
||||
/// transcript row. Returns nothing; the asserts live in the test body.
|
||||
async fn seed_legacy_db(legacy_dir: &Path) {
|
||||
std::fs::create_dir_all(legacy_dir).expect("create legacy dir");
|
||||
let legacy_db = legacy_dir.join("magnotia.db");
|
||||
|
||||
let pool = init(&legacy_db).await.expect("init legacy magnotia.db");
|
||||
insert_transcript(&pool, &seed_params())
|
||||
.await
|
||||
.expect("insert seed transcript into legacy db");
|
||||
drop_and_yield(pool).await;
|
||||
|
||||
assert!(
|
||||
legacy_db.exists(),
|
||||
"legacy magnotia.db should be on disk after pool drop"
|
||||
);
|
||||
}
|
||||
|
||||
#[tokio::test(flavor = "multi_thread")]
|
||||
async fn legacy_db_survives_rebrand_and_remains_queryable() {
|
||||
let tmp = TempDir::new().expect("tempdir");
|
||||
let legacy = tmp.path().join("magnotia");
|
||||
let target = tmp.path().join("lumotia");
|
||||
|
||||
seed_legacy_db(&legacy).await;
|
||||
|
||||
// Bonus: drop a non-DB file inside the legacy tree to confirm the
|
||||
// migration sweeps the whole directory, not just the .db file.
|
||||
let companion = legacy
|
||||
.join("recordings")
|
||||
.join("2026-05-13")
|
||||
.join("clip.wav");
|
||||
std::fs::create_dir_all(companion.parent().unwrap()).expect("nested dir");
|
||||
std::fs::write(&companion, b"fake-wav-bytes").expect("write companion file");
|
||||
|
||||
// Migrate. Blocking I/O is fine inside the multi-thread flavour.
|
||||
let statuses = migrate_legacy_data_dir_with_pairs(vec![(legacy.clone(), target.clone())])
|
||||
.expect("migration must not error");
|
||||
|
||||
assert_eq!(statuses.len(), 1, "single pair must yield single status");
|
||||
match &statuses[0] {
|
||||
MigrationStatus::Migrated {
|
||||
from,
|
||||
to,
|
||||
renamed_db,
|
||||
} => {
|
||||
assert_eq!(from, &legacy);
|
||||
assert_eq!(to, &target);
|
||||
assert!(renamed_db, "magnotia.db must have been renamed");
|
||||
}
|
||||
other => panic!("expected Migrated, got {other:?}"),
|
||||
}
|
||||
|
||||
assert!(!legacy.exists(), "legacy dir should be gone after rename");
|
||||
assert!(target.exists(), "target dir should exist after rename");
|
||||
let migrated_db = target.join("lumotia.db");
|
||||
assert!(migrated_db.exists(), "lumotia.db must be at new path");
|
||||
assert!(
|
||||
!target.join("magnotia.db").exists(),
|
||||
"old db filename must not survive at new path"
|
||||
);
|
||||
let migrated_companion = target
|
||||
.join("recordings")
|
||||
.join("2026-05-13")
|
||||
.join("clip.wav");
|
||||
assert!(
|
||||
migrated_companion.exists(),
|
||||
"non-DB files inside legacy must be carried along"
|
||||
);
|
||||
assert_eq!(
|
||||
std::fs::read(&migrated_companion).expect("read migrated companion"),
|
||||
b"fake-wav-bytes",
|
||||
"non-DB file contents must survive verbatim"
|
||||
);
|
||||
|
||||
// Re-open via the same public API a fresh app boot would use. This
|
||||
// also re-runs `run_migrations`, which must be idempotent against
|
||||
// the already-migrated schema.
|
||||
let pool = init(&migrated_db)
|
||||
.await
|
||||
.expect("init migrated lumotia.db must succeed");
|
||||
|
||||
let found = get_transcript(&pool, SEEDED_TRANSCRIPT_ID)
|
||||
.await
|
||||
.expect("get_transcript must not error against migrated db")
|
||||
.expect("seeded transcript must survive the migration");
|
||||
|
||||
assert_eq!(found.id, SEEDED_TRANSCRIPT_ID);
|
||||
assert_eq!(found.text, SEEDED_TRANSCRIPT_TEXT);
|
||||
assert_eq!(found.title.as_deref(), Some(SEEDED_TRANSCRIPT_TITLE));
|
||||
|
||||
// And the list view sees exactly one row, ruling out duplicates or
|
||||
// schema-rebuild-from-empty (which would yield zero).
|
||||
let listed = list_transcripts(&pool, 100)
|
||||
.await
|
||||
.expect("list_transcripts must not error against migrated db");
|
||||
assert_eq!(
|
||||
listed.len(),
|
||||
1,
|
||||
"exactly one transcript should be visible post-migration"
|
||||
);
|
||||
assert_eq!(listed[0].id, SEEDED_TRANSCRIPT_ID);
|
||||
|
||||
drop_and_yield(pool).await;
|
||||
}
|
||||
|
||||
#[tokio::test(flavor = "multi_thread")]
|
||||
async fn rerun_after_migration_is_idempotent_and_preserves_user_state() {
|
||||
// First boot: migrate. Second boot: legacy preserved? Per the design
|
||||
// the legacy DOES NOT preserve (rename moves it; see paths.rs
|
||||
// rename_or_copy_tree). So the second run sees no legacy and yields
|
||||
// NoLegacyFound. This test exists to nail down that contract — if a
|
||||
// future change starts copying-rather-than-renaming, the test will
|
||||
// catch the subsequent loss of idempotency.
|
||||
let tmp = TempDir::new().expect("tempdir");
|
||||
let legacy = tmp.path().join("magnotia");
|
||||
let target = tmp.path().join("lumotia");
|
||||
|
||||
seed_legacy_db(&legacy).await;
|
||||
|
||||
let first = migrate_legacy_data_dir_with_pairs(vec![(legacy.clone(), target.clone())])
|
||||
.expect("first migration");
|
||||
assert!(matches!(first[0], MigrationStatus::Migrated { .. }));
|
||||
|
||||
// User immediately starts using the app: writes new data to the
|
||||
// migrated DB. The follow-up reboot must NOT clobber this.
|
||||
let pool = init(&target.join("lumotia.db"))
|
||||
.await
|
||||
.expect("post-migrate init");
|
||||
insert_transcript(
|
||||
&pool,
|
||||
&InsertTranscriptParams {
|
||||
id: "t-post-migration",
|
||||
text: "Written after the rebrand boot.",
|
||||
..seed_params()
|
||||
},
|
||||
)
|
||||
.await
|
||||
.expect("insert new row post-migration");
|
||||
drop_and_yield(pool).await;
|
||||
|
||||
// Second boot: no legacy on disk, nothing to do. Note empty input
|
||||
// yields a single NoLegacyFound entry by contract.
|
||||
let second = migrate_legacy_data_dir_with_pairs(Vec::new()).expect("second migration");
|
||||
assert_eq!(second, vec![MigrationStatus::NoLegacyFound]);
|
||||
|
||||
// Open and confirm both rows present + user's post-migration write
|
||||
// intact.
|
||||
let pool = init(&target.join("lumotia.db"))
|
||||
.await
|
||||
.expect("reopen after second boot");
|
||||
let listed = list_transcripts(&pool, 100).await.expect("list");
|
||||
let ids: Vec<_> = listed.iter().map(|r| r.id.as_str()).collect();
|
||||
assert!(
|
||||
ids.contains(&SEEDED_TRANSCRIPT_ID),
|
||||
"pre-migration row should survive second boot: {ids:?}"
|
||||
);
|
||||
assert!(
|
||||
ids.contains(&"t-post-migration"),
|
||||
"post-migration row should survive second boot: {ids:?}"
|
||||
);
|
||||
drop_and_yield(pool).await;
|
||||
}
|
||||
|
||||
#[tokio::test(flavor = "multi_thread")]
|
||||
async fn both_paths_present_refuses_to_overwrite_user_data() {
|
||||
// Reproduces the "stale legacy + freshly-installed lumotia" scenario:
|
||||
// user reinstalls after deleting their data dir manually, or runs an
|
||||
// older + newer build side-by-side. The migration must NOT clobber
|
||||
// the lumotia-side DB even if the legacy contains a richer one —
|
||||
// user authority on what's authoritative.
|
||||
let tmp = TempDir::new().expect("tempdir");
|
||||
let legacy = tmp.path().join("magnotia");
|
||||
let target = tmp.path().join("lumotia");
|
||||
|
||||
// Both DBs exist; the legacy has the seeded row, the target is
|
||||
// freshly initialised with no rows.
|
||||
seed_legacy_db(&legacy).await;
|
||||
let pool = init(&target.join("lumotia.db")).await.expect("seed target");
|
||||
drop_and_yield(pool).await;
|
||||
|
||||
let statuses = migrate_legacy_data_dir_with_pairs(vec![(legacy.clone(), target.clone())])
|
||||
.expect("migration must not error in both-exist case");
|
||||
|
||||
assert_eq!(statuses.len(), 1);
|
||||
assert_eq!(
|
||||
statuses[0],
|
||||
MigrationStatus::TargetAlreadyExists {
|
||||
target: target.clone()
|
||||
}
|
||||
);
|
||||
|
||||
// Critical: target's empty DB must be untouched.
|
||||
let pool = init(&target.join("lumotia.db"))
|
||||
.await
|
||||
.expect("reopen target post-decision");
|
||||
let listed = list_transcripts(&pool, 100).await.expect("list");
|
||||
assert_eq!(
|
||||
listed.len(),
|
||||
0,
|
||||
"target's user-installed empty DB must not have been merged with legacy"
|
||||
);
|
||||
drop_and_yield(pool).await;
|
||||
|
||||
// And the legacy DB must still be on disk for manual recovery —
|
||||
// we don't quietly delete user data the migration refused to copy.
|
||||
assert!(
|
||||
legacy.join("magnotia.db").exists(),
|
||||
"legacy DB must be preserved as a backup when target exists"
|
||||
);
|
||||
}
|
||||
Reference in New Issue
Block a user