@@ -233,6 +233,45 @@ \subsection{Normalized Discounted Cumulative Gain}
233
233
234
234
% great resource: https://aman.ai/recsys/metrics/#normalized-discounted-cumulative-gain-ndcg-1
235
235
236
+
237
+ % ---------- Fraction of Concordant Pairs ----------
238
+ \clearpage
239
+ \thispagestyle {rankingstyle}
240
+ \section {FCP }
241
+ \subsection {Fraction of Concordant Pairs }
242
+
243
+ Fraction of Concordant Pairs (FCP) is a ranking metric used in recommender systems to evaluate how well a model ranks
244
+ preferred items higher than less preferred ones. It measures the proportion of correctly ordered item pairs among all
245
+ comparable pairs in a recommendation list. Given a user’s interactions, FCP checks whether the model ranks a more relevant
246
+ item above a less relevant one.
247
+
248
+ \begin {center }
249
+ FORMULA GOES HERE
250
+ \end {center }
251
+
252
+ A concordant pair is one where the model correctly ranks a preferred item above a less preferred one. FCP values range from
253
+ 0 to 1, with 1 indicating a perfect ranking and 0 meaning the model fails to rank preferred items higher.
254
+
255
+ \textbf {When to use FCP? }
256
+
257
+ Use FCP when evaluating recommender systems that generate personalized rankings, especially in cases where relative
258
+ ranking quality is more important than absolute scores. It is particularly useful in implicit feedback scenarios,
259
+ such as e-commerce or media streaming, where explicit relevance scores are unavailable, and user preferences must be
260
+ inferred from interactions.
261
+
262
+ \coloredboxes {
263
+ \item It directly measures how accurately the system's rankings align with user preferences.
264
+ }
265
+ {
266
+ \item It only evaluates pairs of items where user preferences can be inferred, potentially reducing
267
+ the number of evaluated pairs.
268
+ \item Calculating FCP can be resource-intensive for large datasets, as the number of item pairs grows
269
+ quadratically with dataset size.
270
+ }
271
+
272
+ % great references: https://aman.ai/recsys/metrics/#fraction-of-concordant-pairs-fcp
273
+ % https://www.ijcai.org/Proceedings/13/Papers/449.pdf
274
+
236
275
% ---------- Behavioral Metrics (Novelty, Serendipity, Diversity/Intra-List Diversity, Coverage) ----------
237
276
\clearpage
238
277
\thispagestyle {rankingstyle}
0 commit comments