A modernized fork of Markdowner by Dhravya Shah - updated for Wrangler v4 and latest Cloudflare Workers patterns.

🚀 What's New in This Fork:

• ✅ Updated to Wrangler v4 with latest features
• ✅ Modern JSON configuration format
• ✅ Strict TypeScript with zero compilation errors
• ✅ Enhanced development safety with separate KV namespaces
• ✅ Latest dependency versions and security updates
• ✅ Comprehensive developer documentation

A fast tool to convert any website into LLM-ready markdown data, now modernized for the latest Cloudflare Workers ecosystem.

Perfect for AI applications where structured markdown data improves LLM response quality significantly compared to raw HTML.

• Convert any website into markdown
• LLM Filtering with AI Workers
• Detailed markdown mode
• Auto Crawler (without sitemap!)
• Text and JSON responses
• Easy to self-host on Cloudflare
• Modern development experience with Wrangler v4
• Type-safe development with strict TypeScript

To use the API, make a GET request with a URL parameter:

curl 'https://your-markdowner.your-subdomain.workers.dev/?url=https://example.com'

• url (string) → The website URL to convert into markdown

• enableDetailedResponse (boolean: false) → Include full HTML content instead of just article content
• crawlSubpages (boolean: false) → Crawl and return markdown for up to 10 subpages
• llmFilter (boolean: false) → Filter out unnecessary information using LLM

• Add Content-Type: text/plain in headers for plain text response
• Add Content-Type: application/json in headers for JSON response

This modernized version uses:

• Cloudflare Workers with Wrangler v4
• Browser Rendering API for web scraping
• Durable Objects for stateful browser management
• KV Storage for caching with separate dev/prod namespaces
• AI Workers for content filtering
• TypeScript with strict type checking
• Modern ES2022 syntax and patterns

You can easily self-host this modernized version. You'll need the Workers paid plan for Browser Rendering and Durable Objects.

• Node.js 18+
• Cloudflare account with Workers paid plan
• Git

This project follows the standard template approach for handling sensitive configuration in public repositories.

1. Clone this modernized fork:

   git clone https://github.com/ahlstrominfo/markdowner
   cd markdowner

2. Install dependencies:

   npm install

3. Create your KV namespaces:

   # Create production KV namespace
   npx wrangler kv namespace create md_cache
   
   # Create preview KV namespace
   npx wrangler kv namespace create md_cache --preview
   
   # For development environment
   npx wrangler kv namespace create md_cache_dev
   npx wrangler kv namespace create md_cache_dev --preview

4. Create your configuration:

   # Copy the example configuration
   cp wrangler.example.json wrangler.json

   Then edit wrangler.json and replace the placeholder values with your actual KV namespace IDs from step 3:

   {
     "kv_namespaces": [
       {
         "binding": "MD_CACHE",
         "id": "your-actual-kv-namespace-id",
         "preview_id": "your-actual-preview-kv-namespace-id"
       }
     ],
     "env": {
       "production": {
         "kv_namespaces": [
           {
             "binding": "MD_CACHE",
             "id": "your-production-kv-namespace-id",
             "preview_id": "your-production-preview-kv-namespace-id"
           }
         ]
       }
     }
   }

5. Set up local development variables (optional):

   # Copy the example file
   cp .dev.vars.example .dev.vars
   
   # Edit .dev.vars with any local development secrets
   # (This file is gitignored and won't be committed)

6. Development and deployment:

   # Local development
   npm run dev
   
   # Deploy to default environment
   npm run deploy
   
   # Deploy to production environment
   npx wrangler deploy --env production

• ✅ Safe for public repos: wrangler.example.json contains placeholder values (committed)
• 🔒 Your config: wrangler.json contains your real IDs (gitignored)
• 🔒 Local secrets: Use .dev.vars for local development secrets (gitignored)
• 🏭 Production secrets: Use wrangler secret put for production secrets
• 🔄 Environment isolation: Production uses separate KV namespaces via environments

For local development with the modern setup:

# Start development server
npm run dev

# Type checking
npm run lint

# View logs
npm run logs

# Generate types
npm run types

The modernized architecture includes:

• Main Worker: Modern export with proper TypeScript typing
• Browser Durable Object: Manages browser instances with enhanced error handling
• Caching Layer: KV storage with separate development and production namespaces
• Rate Limiting: API protection with configurable limits
• AI Integration: Optional LLM filtering for content cleanup

This is a modernized fork of the excellent Markdowner originally created by Dhravya Shah.

Original Creator: Dhravya Shah
Modernization: Updated for Wrangler v4 and latest Cloudflare Workers patterns

Both the original and this fork are licensed under the MIT License - see the LICENSE file for details.

• 🐛 Issues: Report bugs or request features in the Issues section
• 💡 Original Project: Check out the original Markdowner by Dhravya Shah
• 📚 Documentation: See CLAUDE.md for development guidance

⭐ Star this repo if the Wrangler v4 modernization helped you!