wjones
78c8d4256c
- Moved all documentation to docs/ and updated README with categorized links and new docs/INDEX.md - Added HOW_TO_SWITCH_DATABASE.md and several new analysis/action docs - Introduced db-config.ps1 for centralized DB config; all scripts now use it for easy DB switching - Added db-quick.ps1 for interactive diagnostics and index management - Updated Add-All-Indexes.bat to use db-config.ps1 - Added Fix-ItemValues-Performance.ps1 to create 3 critical indexes on ItemValues, addressing 1.3B row seq scan issue - Updated performance_indexes.sql with new ItemValues indexes and ANALYZE - Updated diagnostics.sql and database_report.txt for improved output and clarity - All scripts and docs now reference the new config and index optimization workflow
155 lines
3.9 KiB
Markdown
155 lines
3.9 KiB
Markdown
# ✅ ItemValues Indexes Added to performance_indexes.sql
|
|
|
|
## What Was Added
|
|
|
|
I've added the three critical ItemValues table indexes to `sql/performance_indexes.sql`:
|
|
|
|
### 1. idx_itemvalues_cleanvalue
|
|
```sql
|
|
CREATE INDEX CONCURRENTLY IF NOT EXISTS idx_itemvalues_cleanvalue
|
|
ON library."ItemValues" ("CleanValue")
|
|
WHERE "CleanValue" IS NOT NULL;
|
|
```
|
|
**Purpose**: Genre/tag searches by name
|
|
|
|
### 2. idx_itemvalues_value
|
|
```sql
|
|
CREATE INDEX CONCURRENTLY IF NOT EXISTS idx_itemvalues_value
|
|
ON library."ItemValues" ("Value")
|
|
WHERE "Value" IS NOT NULL;
|
|
```
|
|
**Purpose**: Direct value searches
|
|
|
|
### 3. idx_itemvalues_id_cleanvalue
|
|
```sql
|
|
CREATE INDEX CONCURRENTLY IF NOT EXISTS idx_itemvalues_id_cleanvalue
|
|
ON library."ItemValues" ("ItemValueId", "CleanValue");
|
|
```
|
|
**Purpose**: ItemValuesMap joins (improves genre/tag filtering)
|
|
|
|
---
|
|
|
|
## Location in File
|
|
|
|
The indexes are added after the ItemValuesMap section and before the ActivityLog section:
|
|
|
|
```
|
|
Line ~112-120: ItemValuesMap indexes
|
|
Line ~121-142: ItemValues indexes (NEW!)
|
|
Line ~143-150: ActivityLog indexes
|
|
```
|
|
|
|
---
|
|
|
|
## What This Fixes
|
|
|
|
**Problem**:
|
|
- 1.3 BILLION rows being scanned sequentially in ItemValues table
|
|
- Genre/tag filtering taking 5+ seconds
|
|
- Massive network traffic on remote databases
|
|
|
|
**Solution**:
|
|
- Three targeted indexes for the most common query patterns
|
|
- Expected improvement: **70-90% faster** genre/tag queries
|
|
|
|
---
|
|
|
|
## How to Use
|
|
|
|
### Option 1: Run the Updated Script
|
|
|
|
```powershell
|
|
# Make sure you're on the remote database
|
|
. .\db-config.ps1
|
|
|
|
# Run the performance indexes script
|
|
& $PSQL_PATH -h $DB_HOST -p $DB_PORT -U $DB_USER -d $DB_NAME -f sql\performance_indexes.sql
|
|
```
|
|
|
|
### Option 2: Use the Dedicated Script (Recommended)
|
|
|
|
The `Fix-ItemValues-Performance.ps1` script specifically creates just these three indexes:
|
|
|
|
```powershell
|
|
.\Fix-ItemValues-Performance.ps1
|
|
```
|
|
|
|
**Advantage**:
|
|
- Faster (only creates 3 indexes, not all of them)
|
|
- Already tested and working
|
|
- Better progress feedback
|
|
|
|
---
|
|
|
|
## Files Updated
|
|
|
|
1. ✅ `sql\performance_indexes.sql` - Added ItemValues indexes
|
|
2. ✅ `sql\all_performance_indexes.sql` - Already had these (different format)
|
|
3. ✅ `Fix-ItemValues-Performance.ps1` - Dedicated script for just ItemValues
|
|
|
|
---
|
|
|
|
## Testing the Indexes
|
|
|
|
After running, verify they were created:
|
|
|
|
```powershell
|
|
. .\db-config.ps1
|
|
|
|
# Check ItemValues indexes
|
|
$query = "SELECT indexrelname as indexname, pg_size_pretty(pg_relation_size(indexrelid)) as size FROM pg_stat_user_indexes WHERE schemaname = 'library' AND relname = 'ItemValues' ORDER BY indexrelname;"
|
|
& $PSQL_PATH -h $DB_HOST -p $DB_PORT -U $DB_USER -d $DB_NAME -c $query
|
|
```
|
|
|
|
**Expected output:**
|
|
```
|
|
indexname | size
|
|
-----------------------------------+------
|
|
idx_itemvalues_cleanvalue | 128 kB
|
|
idx_itemvalues_id_cleanvalue | 256 kB
|
|
idx_itemvalues_value | 128 kB
|
|
IX_ItemValues_Type_CleanValue | ... (existing)
|
|
IX_ItemValues_Type_Value | ... (existing)
|
|
PK_ItemValues | ... (existing)
|
|
```
|
|
|
|
---
|
|
|
|
## Next Steps
|
|
|
|
1. **Run the indexes** (use `Fix-ItemValues-Performance.ps1` or the full script)
|
|
2. **Use Jellyfin for 1 week** - Browse, filter by genre/tags
|
|
3. **Run diagnostics** - Check if sequential scans decreased
|
|
4. **Compare performance** - Genre/tag queries should be much faster!
|
|
|
|
---
|
|
|
|
## Expected Results
|
|
|
|
### Before:
|
|
```
|
|
ItemValues Table:
|
|
- Sequential scans: 226,121
|
|
- Rows read: 1,313,356,213 (1.3 billion!)
|
|
- Genre filter time: 5+ seconds
|
|
```
|
|
|
|
### After (Expected):
|
|
```
|
|
ItemValues Table:
|
|
- Sequential scans: ~20,000 (91% reduction)
|
|
- Rows read: ~1,000,000 (99.9% reduction)
|
|
- Genre filter time: <100ms (99% faster!)
|
|
```
|
|
|
|
---
|
|
|
|
## Summary
|
|
|
|
✅ **Added 3 critical indexes to performance_indexes.sql**
|
|
✅ **Targets the 1.3 billion row sequential scan problem**
|
|
✅ **Expected 70-90% performance improvement**
|
|
✅ **Safe to run (uses IF NOT EXISTS and CONCURRENTLY)**
|
|
|
|
**Ready to deploy!** 🚀
|