CascadeRec: Deployed Adaptive LLM Compute Allocation for Multi-Tenant Content Recommendation
arXiv:2611.08566v1 Announce Type: new Abstract: Large language models (LLMs) are attractive rerankers for recommendation. Running an expensive model on every re…