Skip to content

Commit fa8c185

Browse files
committed
FCP
1 parent aad4c62 commit fa8c185

File tree

1 file changed

+39
-0
lines changed

1 file changed

+39
-0
lines changed

book/5-ranking.tex

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -233,6 +233,45 @@ \subsection{Normalized Discounted Cumulative Gain}
233233

234234
% great resource: https://aman.ai/recsys/metrics/#normalized-discounted-cumulative-gain-ndcg-1
235235

236+
237+
% ---------- Fraction of Concordant Pairs ----------
238+
\clearpage
239+
\thispagestyle{rankingstyle}
240+
\section{FCP}
241+
\subsection{Fraction of Concordant Pairs}
242+
243+
Fraction of Concordant Pairs (FCP) is a ranking metric used in recommender systems to evaluate how well a model ranks
244+
preferred items higher than less preferred ones. It measures the proportion of correctly ordered item pairs among all
245+
comparable pairs in a recommendation list. Given a user’s interactions, FCP checks whether the model ranks a more relevant
246+
item above a less relevant one.
247+
248+
\begin{center}
249+
FORMULA GOES HERE
250+
\end{center}
251+
252+
A concordant pair is one where the model correctly ranks a preferred item above a less preferred one. FCP values range from
253+
0 to 1, with 1 indicating a perfect ranking and 0 meaning the model fails to rank preferred items higher.
254+
255+
\textbf{When to use FCP?}
256+
257+
Use FCP when evaluating recommender systems that generate personalized rankings, especially in cases where relative
258+
ranking quality is more important than absolute scores. It is particularly useful in implicit feedback scenarios,
259+
such as e-commerce or media streaming, where explicit relevance scores are unavailable, and user preferences must be
260+
inferred from interactions.
261+
262+
\coloredboxes{
263+
\item It directly measures how accurately the system's rankings align with user preferences.
264+
}
265+
{
266+
\item It only evaluates pairs of items where user preferences can be inferred, potentially reducing
267+
the number of evaluated pairs.
268+
\item Calculating FCP can be resource-intensive for large datasets, as the number of item pairs grows
269+
quadratically with dataset size.
270+
}
271+
272+
% great references: https://aman.ai/recsys/metrics/#fraction-of-concordant-pairs-fcp
273+
% https://www.ijcai.org/Proceedings/13/Papers/449.pdf
274+
236275
% ---------- Behavioral Metrics (Novelty, Serendipity, Diversity/Intra-List Diversity, Coverage) ----------
237276
\clearpage
238277
\thispagestyle{rankingstyle}

0 commit comments

Comments
 (0)