Solutions Architect | On-Prem to AWS Document Migration (Public Sector)
Solution architecture and delivery for a public-sector organization migrating a large on-premises document repository (SharePoint) into AWS. The goal: move years of archived documents off aging infrastructure into a durable, searchable, cost-efficient store — without losing metadata or risking the source during cutover.
Client details are withheld — this is an active engagement.
What I Did
- Target architecture on AWS, designed against the Well-Architected Framework — durable object storage on S3 with lifecycle and retention policy, least-privilege IAM, and CloudWatch observability.
- Automated sync pipeline pulling documents from SharePoint via the Microsoft Graph API, with incremental/delta processing so only changed items move on each run.
- Staged cutover with rollback safety — write-back of lightweight stub links at the source, metadata preservation, and a recovery path so no original is lost if a step fails.
- Scope-safe filtering — age, path, and flag-based rules so only in-scope documents are migrated, with the pipeline excluding its own generated artifacts to avoid re-ingest loops.
Highlights
- Migration safety first — rollback and metadata-preservation designed in, not bolted on
- Delta-incremental sync to keep repeated runs cheap and idempotent
- Searchable archive replacing a legacy on-prem platform
- Documented runbook so the client’s team can operate and extend the pipeline
Outcome
A repeatable, auditable migration pipeline that moves documents from on-premises SharePoint into a governed AWS archive — reducing dependence on legacy infrastructure while preserving the integrity of the original records.
Technologies
AWSS3Microsoft Graph APIPythonTerraformIAMCloudWatchWell-Architected