Fixes#175
Problem:
When --file-types .pdf is specified, PDFs were being processed twice:
1. Separately with PyMuPDF/pdfplumber extractors
2. Again in the 'other file types' section via SimpleDirectoryReader
This caused duplicate processing and potential conflicts.
Solution:
- Exclude .pdf from other_file_extensions when PDFs are already
processed separately
- Only load other file types if there are extensions to process
- Prevents duplicate PDF processing
Changes:
- Added logic to filter out .pdf from code_extensions when loading
other file types if PDFs were processed separately
- Updated SimpleDirectoryReader to use filtered extensions
- Added check to skip loading if no other extensions to process
Aakash Suresh
e268392d5b