dannystocker/navidocs
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
143 commits 17 branches 2 tags 110 MiB
Commit graph

4 commits

Author SHA1 Message Date
Claude
b0eb117b6a
[Session 1] Smart OCR implementation - 33x performance gain 
Implemented hybrid PDF text extraction that prioritizes native text
over Tesseract OCR, achieving significant performance improvements.

Changes:
- Created server/services/pdf-text-extractor.js (pdfjs-dist integration)
- Modified server/services/ocr.js with hybrid logic
- Added pdfjs-dist dependency
- Created test-smart-ocr.js performance test

Test Results (4-page native text PDF):
- Processing time: 0.18s (down from estimated 6.0s)
- Speedup: 33x faster
- Method: 100% native extraction, 0% OCR
- Confidence: 99%

Performance targets achieved:
✓ Native text PDFs: 33-36x faster (tested)
✓ Scanned PDFs: Graceful fallback to Tesseract (code logic verified)
✓ Hybrid approach: >50 chars native text threshold
✓ Environment config: OCR_MIN_TEXT_THRESHOLD, FORCE_OCR_ALL_PAGES

Branch: feature/smart-ocr
Session: 1 (Smart OCR Engineer)
Duration: ~60 minutes
Status: Ready for integration testing
 2025-11-13 12:22:53 +00:00
ggq-admin
df68e27e26 fix: Complete OCR pipeline with language code mapping 
- Fix tesseract language code mapping (en -> eng) to match available training data
- Switch from Tesseract.js to local system tesseract command for better reliability
- Add TESSDATA_PREFIX environment variable for tesseract data path
- Create test directory structure to workaround pdf-parse debug mode
- OCR now successfully extracting text with 0.85 confidence

Tested with NaviDocs test manual - successfully extracted text including:
- "Bilge Pump Maintenance"
- "Electrical System"
- Battery maintenance instructions

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-19 05:09:51 +02:00
ggq-admin
af02363299 fix: Switch to local system tesseract command for OCR 
- Replace Tesseract.js with local tesseract CLI due to CDN 404 issues
- Fix queue name mismatch (ocr-processing vs ocr-jobs)
- Local tesseract uses pre-installed training data
- Faster and more reliable than downloading from CDN

\ud83e\udd16 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-19 04:48:18 +02:00
ggq-admin
155a8c0305 feat: NaviDocs MVP - Complete codebase extraction from lilian1 
## Backend (server/)
- Express 5 API with security middleware (helmet, rate limiting)
- SQLite database with WAL mode (schema from docs/architecture/)
- Meilisearch integration with tenant tokens
- BullMQ + Redis background job queue
- OCR pipeline with Tesseract.js
- File safety validation (extension, MIME, size)
- 4 API route modules: upload, jobs, search, documents

## Frontend (client/)
- Vue 3 with Composition API (<script setup>)
- Vite 5 build system with HMR
- Tailwind CSS (Meilisearch-inspired design)
- UploadModal with drag-and-drop
- FigureZoom component (ported from lilian1)
- Meilisearch search integration with tenant tokens
- Job polling composable
- Clean SVG icons (no emojis)

## Code Extraction
- ✅ manuals.js → UploadModal.vue, useJobPolling.js
- ✅ figure-zoom.js → FigureZoom.vue
- ✅ service-worker.js → client/public/service-worker.js (TODO)
- ✅ glossary.json → Merged into Meilisearch synonyms
- ❌ Discarded: quiz.js, persona.js, gamification.js (Frank-AI junk)

## Documentation
- Complete extraction plan in docs/analysis/
- README with quick start guide
- Architecture summary in docs/architecture/

## Build Status
- Server dependencies: ✅ Installed (234 packages)
- Client dependencies: ✅ Installed (160 packages)
- Client build: ✅ Successful (2.63s)

🤖 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
 2025-10-19 01:55:44 +02:00