Work/ETL Monitoring & Recovery Tool
Serverless ETL tracking and automated recovery service.
ETL file processing state was spread across multiple DynamoDB and MySQL databases with no single view, and a failed Step Function needed someone to notice it and retry it by hand.
Tracks ETL file processing across services, aggregating state from multiple DynamoDB and MySQL databases, with a recovery mechanism that automatically retries failed AWS Step Functions. Serverless backend on AWS Lambda via AWS SAM, UI on AWS ECS, with end-to-end Jenkins CI/CD for both.
Reduced operational overhead and manual intervention on the platform ETL flows.
Next project
OMEGA Agentic System