ratyim commited on
Commit
eb51aef
·
verified ·
1 Parent(s): 9eefba1

Create requirements.txt

Browse files
Files changed (1) hide show
  1. requirements.txt +23 -0
requirements.txt ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Core dependencies for Fire Evacuation RAG System
2
+ numpy
3
+ torch
4
+ transformers
5
+ sentence-transformers
6
+ gradio
7
+
8
+ # FAISS for vector similarity search
9
+ # Use faiss-cpu for CPU-only systems, or faiss-gpu for GPU systems
10
+ faiss-cpu
11
+ # faiss-gpu>=1.7.4 # Uncomment if you have CUDA-capable GPU
12
+
13
+ # Optional: For faster model loading and inference
14
+ unsloth # Faster model loading with Unsloth
15
+
16
+ # Optional: For model quantization (4-bit/8-bit)
17
+ bitsandbytes # Required for 4-bit/8-bit quantization
18
+
19
+ # Optional: For optimized attention (FlashAttention2)
20
+ # flash-attn>=2.0.0 # Uncomment if you want FlashAttention2 support
21
+ # Note: flash-attn requires CUDA and may need to be installed separately
22
+ # Install with: pip install flash-attn --no-build-isolation
23
+