Updater

Description

Scheduler for downloading and updating cars and COE data.

Prerequisites

• Node.js (compatible with Node 22.x)
• pnpm

Installation

pnpm install

Scripts

• pnpm dev: Start development server using SST (Serverless Stack) in dev stage
• pnpm test: Run tests using Vitest
• pnpm test:coverage: Run tests with coverage report
• pnpm migrate: Run database migrations using Drizzle Kit

Key Dependencies

• Hono (Web framework)
• Drizzle ORM
• Neon Database Serverless
• Upstash Redis
• Trigger.dev (Job scheduling and orchestration)
• AdmZip (File extraction)
• Node.js Crypto (Checksum generation)

Development Tools

• Vitest (Testing)
• Biome (Linting)

Key Features

• Automated job scheduling with Trigger.dev
• Efficient file download and extraction
• SHA-256 checksum calculation
• Serverless database migrations
• Redis caching support

Database Migrations

Migrations are managed using Drizzle Kit. Run pnpm migrate to apply database schema changes.

Performance Considerations

• Streaming file processing to minimize memory usage
• Chunk-based file checksum calculation
• Lightweight ZIP file handling
• Serverless job scheduling

License

MIT License

Author

Ru Chern Chong [email protected]