Document Management

From Collection View

1. Navigate to the collection where you want to add documents
2. Click "Upload Document" or drag and drop files into the upload area
3. Select one or more files from your computer
4. Wait for the upload and processing to complete

The system will automatically extract text from supported file formats and calculate metadata like character count and token count.

Pasting Text Directly

1. Navigate to the collection
2. Click "New Document from Text"
3. Enter a title and optional description
4. Paste your text into the rich text editor
5. Click "Save" to create the document

This is useful for quickly adding text without creating files first.

Plain Text (.txt)

Plain text files are uploaded directly. The content is stored as-is in the database.

• No processing required
• Fastest upload time
• Preserves exact text content

PDF (.pdf)

PDF files are processed to extract text content. The original PDF is stored for download.

• Text extraction using pdf-parse
• Page breaks are preserved/marked
• Original PDF stored as binary data
• Metadata extracted (title, author, etc.)

Word Documents (.docx)

DOCX files are processed to extract text while preserving formatting information.

• Text extraction using mammoth
• Formatting information preserved
• Tables handled appropriately
• Original file stored for download

Viewing Document Preview

1. Navigate to the collection containing the document
2. Click on a document in the list
3. The preview modal will open showing:
   • Full document text
   • Document metadata (size, character count, word count)
   • Creation date and creator
   • Language detection (if available)

Actions from Preview

From the preview modal, you can:

• Click "Start Annotating" to open the annotation workspace
• Download the original file (if uploaded)
• View quick statistics (character count, word count, token count)

How to Edit

1. Open the document in the annotation workspace or document view
2. Click "Edit" or enter edit mode
3. Make your changes to the text
4. Click "Save" to apply changes

Versioning

When you edit a document:

• A new version is automatically created
• The text hash is updated to reflect changes
• Existing annotations remain linked to the original text version
• You can view version history and restore previous versions

Impact on Annotations

When document text changes:

• Annotations are preserved and linked to their original text positions
• If text at annotation positions changes significantly, you may need to review and adjust annotations
• The changelog shows what changed between versions

Viewing Version History

1. Open the document view
2. Navigate to the "Versions" tab or section
3. View the list of all versions with:
   • Version number
   • Who made the change
   • When the change was made
   • Optional description of changes

Comparing Versions

You can view differences between versions:

• Select two versions to compare
• View a diff showing added, removed, and modified text
• See which annotations were created in each version

Restoring Versions

To restore a previous version:

1. View the version history
2. Select the version you want to restore
3. Click "Restore" or "Revert to This Version"
4. Confirm the restoration

Restoring creates a new version with the restored content, preserving the version history.

Searching Documents

1. Use the search bar on the dashboard or collection view
2. Enter your search query
3. Results will show documents matching your search in:
   • Document name
   • Document content
   • Creator name

Search Features

The search supports:

• Case-insensitive matching
• Partial word matching
• Search across all collections or filter by collection
• Results sorted by relevance
• Highlighted search terms in result snippets

Filtering Results

You can filter search results by:

• Collection
• Document status (annotated, pending)
• Date range
• Creator