Noise ratio definition

I just viewed the paper, it inspires me a lot! 
Just found that Noise Ratio (means 3 out of 5 retrieved documents are irrelevant or noisy) is significant factor for ACC of TurboRAG 
How do you define the retrieved documents is relevant or irrelevant ? like using reranking model ?  or some measurement ? 
and maybe some threshold value ? 

  