Aug 2025 - Apr 2026Edge & Offline Systems

NIEdge

Student Academic Resource Platform offering instant offline-first portal scraping and a sandboxed browser development playground.

Signature: Edge scraping · offline-first caching · serverless request routing

Key Verified Performance Metrics

Primary Metric1,900+ Active Users
Secondary Benchmark8.2s → 350ms Load Latency

01 System Context & Problem

Students faced slow portal loading speeds, frequent downtime, and lack of mobile offline access to schedules and academic records.

02 Architecture & Implementation

Next-gen static frontend with Progressive Web App (PWA) client service workers, communicating with serverless Cloudflare Workers acting as API routing gateways and scraping nodes.

Engineering Approach: Built a decoupled system with an ultra-lightweight client scraping the portal through a serverless backend proxy, coupled with offline-first client storage.

03 Technical Decisions & Trade-offs

Core Architectural Decision

Chose Firebase for instant authentication and database updates. Used Cheerio for parsing DOM responses directly inside edge functions rather than spinning up full headless browsers (Puppeteer), saving significant memory and execution costs.

Constraints & Incurred Trade-off

Cheerio relies on stable portal HTML structure. Changes to the university portal UI require backend regex/selectors updating, but the extreme latency drop made this trade-off worthwhile.

04 Scalability, Throughput & Security

Cloudflare Workers distribute the scraping traffic globally. Serverless architecture scales automatically to handle spike hours during grade releases without infrastructure maintenance.

Reduced load times from 8.2s (standard portal) to 350ms on subsequent visits by serving data directly from local caches and pre-fetching in the background.

05 Verified Outcomes

  • Served 1,900+ users and 35,000+ page views with a full-stack academic platform, using a serverless Cloudflare Workers API gateway and Cheerio-based scrapers to securely sync real-time college portal data.
  • Shipped an offline-first PWA with Service Workers for instant asset caching, plus a sandboxed in-browser programming playground that lets students run code without a backend.

Technologies & Protocols

HTMLCSSJavaScriptFirebaseCloudflare WorkersCheerioService Workers