NIEdge
Student Academic Resource Platform offering instant offline-first portal scraping and a sandboxed browser development playground.
Signature: Edge scraping · offline-first caching · serverless request routing
Key Verified Performance Metrics
01 System Context & Problem
Students faced slow portal loading speeds, frequent downtime, and lack of mobile offline access to schedules and academic records.
02 Architecture & Implementation
Next-gen static frontend with Progressive Web App (PWA) client service workers, communicating with serverless Cloudflare Workers acting as API routing gateways and scraping nodes.
Engineering Approach: Built a decoupled system with an ultra-lightweight client scraping the portal through a serverless backend proxy, coupled with offline-first client storage.
03 Technical Decisions & Trade-offs
Core Architectural Decision
Chose Firebase for instant authentication and database updates. Used Cheerio for parsing DOM responses directly inside edge functions rather than spinning up full headless browsers (Puppeteer), saving significant memory and execution costs.
Constraints & Incurred Trade-off
Cheerio relies on stable portal HTML structure. Changes to the university portal UI require backend regex/selectors updating, but the extreme latency drop made this trade-off worthwhile.
04 Scalability, Throughput & Security
Cloudflare Workers distribute the scraping traffic globally. Serverless architecture scales automatically to handle spike hours during grade releases without infrastructure maintenance.
Reduced load times from 8.2s (standard portal) to 350ms on subsequent visits by serving data directly from local caches and pre-fetching in the background.
05 Verified Outcomes
- Served 1,900+ users and 35,000+ page views with a full-stack academic platform, using a serverless Cloudflare Workers API gateway and Cheerio-based scrapers to securely sync real-time college portal data.
- Shipped an offline-first PWA with Service Workers for instant asset caching, plus a sandboxed in-browser programming playground that lets students run code without a backend.