bee的测试集具体是那几个？复现效果明显低于给出的效果

[ZJZhao123]

感谢你们提供的数据集和工作。在学习和复现的过程中我遇到了一些问题。

首先，为什么在数据集的test中的数据集是BEE24-12，BEE24-13，BEE24-16，BEE24-34，BEE24-36。而在result/gt中是12，13，16，18，20。

我将result/gt改为和test中的数据一致，并下载了bee24对应的两个pth文件进行复现，但是只能达到hota 39.642，mota61.961，idf1 48.675。

我非常困惑，希望得到您的解答，感谢！

[ZJZhao123]

我查看了一下，result/gt中的18，20gt对应BEE24-34，BEE24-36，所以对result/gt进行了修改。但是评价指标依然上不去。不管是普通的还是post版本hota都不到40。

[1104682213]

我查看了一下，result/gt中的18，20gt对应BEE24-34，BEE24-36，所以对result/gt进行了修改。但是评价指标依然上不去。不管是普通的还是post版本hota都不到40。

我用同样的方式复现也是没办法达到论文中的效果

[hedaShg]

val Config:
USE_PARALLEL : False
NUM_PARALLEL_CORES : 8
BREAK_ON_ERROR : True
RETURN_ON_ERROR : False
LOG_ON_ERROR : /home/a607/shg/TOPICTrack-main(1)/TOPICTrack-main/external/TrackEval/error_log.txt
PRINT_RESULTS : True
PRINT_ONLY_COMBINED : False
PRINT_CONFIG : True
TIME_PROGRESS : True
DISPLAY_LESS_PROGRESS : False
OUTPUT_SUMMARY : True
OUTPUT_EMPTY_CLASSES : True
OUTPUT_DETAILED : True
PLOT_CURVES : True

MotChallenge2DBox Config:
PRINT_CONFIG : True
GT_FOLDER : results/gt/
TRACKERS_FOLDER : results/trackers/
OUTPUT_FOLDER : None
TRACKERS_TO_EVAL : ['bee24_test']
CLASSES_TO_EVAL : ['pedestrian']
BENCHMARK : BEE24
SPLIT_TO_EVAL : val
INPUT_AS_ZIP : False
DO_PREPROC : True
TRACKER_SUB_FOLDER : data
OUTPUT_SUB_FOLDER :
TRACKER_DISPLAY_NAMES : None
SEQMAP_FOLDER : None
SEQMAP_FILE : None
SEQ_INFO : None
GT_LOC_FORMAT : {gt_folder}/{seq}/gt/gt.txt
SKIP_SPLIT_FOL : False

CLEAR Config:
METRICS : ['HOTA', 'Identity', 'CLEAR']
THRESHOLD : 0.5
PRINT_CONFIG : True

Identity Config:
METRICS : ['HOTA', 'Identity', 'CLEAR']
THRESHOLD : 0.5
PRINT_CONFIG : True

Evaluating 1 tracker(s) on 5 sequence(s) for 1 class(es) on MotChallenge2DBox dataset using the following metrics: HOTA, CLEAR, Identity, Count

Evaluating bee24_test

MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2412)                0.0181 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian)                0.0246 sec
HOTA.eval_sequence()                                                   0.0423 sec
CLEAR.eval_sequence()                                                  0.0047 sec
Identity.eval_sequence()                                               0.0018 sec
Count.eval_sequence()                                                  0.0000 sec

1 eval_sequence(BEE2412, bee24_test) 0.0918 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2413) 0.0270 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0272 sec
HOTA.eval_sequence() 0.0507 sec
CLEAR.eval_sequence() 0.0060 sec
Identity.eval_sequence() 0.0031 sec
Count.eval_sequence() 0.0000 sec
2 eval_sequence(BEE2413, bee24_test) 0.1145 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2416) 0.0215 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0258 sec
HOTA.eval_sequence() 0.0464 sec
CLEAR.eval_sequence() 0.0051 sec
Identity.eval_sequence() 0.0027 sec
Count.eval_sequence() 0.0000 sec
3 eval_sequence(BEE2416, bee24_test) 0.1020 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2434) 0.6194 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.5290 sec
HOTA.eval_sequence() 1.2749 sec
CLEAR.eval_sequence() 0.1223 sec
Identity.eval_sequence() 1.5514 sec
Count.eval_sequence() 0.0000 sec
4 eval_sequence(BEE2434, bee24_test) 4.1066 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2436) 0.3812 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.4867 sec
HOTA.eval_sequence() 0.8393 sec
CLEAR.eval_sequence() 0.0936 sec
Identity.eval_sequence() 0.0569 sec
Count.eval_sequence() 0.0000 sec
5 eval_sequence(BEE2436, bee24_test) 1.8648 sec

All sequences for bee24_test finished in 6.28 seconds

HOTA: bee24_test-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0)
BEE2412 41.728 46.762 37.414 48.097 83.829 39.035 76.183 84.585 42.382 50.149 82.162 41.203
BEE2413 39.47 50.518 30.969 52.437 80.334 32.976 64.237 82.115 40.284 49.445 78.869 38.996
BEE2416 29.708 45.673 19.422 47.482 82.758 22.646 51.622 84.523 30.339 35.527 81.408 28.922
BEE2434 36.582 54.875 24.473 66.523 65.013 37.764 44.887 79.606 40.335 49.243 74.453 36.663
BEE2436 34.725 50.717 24.138 54.714 69.014 25.641 67.197 75.851 36.25 49.55 69.244 34.311
COMBINED 36.138 53.131 24.766 61.65 66.89 34.216 52.447 78.746 39.037 49.107 73.226 35.959

CLEAR: bee24_test-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
BEE2412 50.684 82.712 56.868 57.121 99.558 5.2632 47.368 47.368 40.809 1127 846 5 122 1 9 9 136
BEE2413 53.962 79.486 63.293 64.284 98.483 9.2593 61.111 29.63 40.775 4154 2308 64 603 5 33 16 559
BEE2416 41.22 82.879 53.501 55.438 96.625 3.75 67.5 28.75 31.729 2090 1680 73 463 3 54 23 389
BEE2434 62.811 76.265 67.06 84.691 82.769 51.181 42.345 6.4742 42.709 87626 15839 18242 4397 585 484 74 4634
BEE2436 68.64 70.783 71.018 75.148 94.79 6.135 71.779 22.086 46.683 39498 13062 2171 1250 10 117 36 1703
COMBINED 63.666 74.911 67.729 79.947 86.743 41.398 47.772 10.829 43.608 134495 33735 20555 6835 604 697 158 7421

Identity: bee24_test-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
BEE2412 55.523 43.69 76.148 862 1111 270
BEE2413 50.393 41.643 63.798 2691 3771 1527
BEE2416 31.485 24.775 43.181 934 2836 1229
BEE2434 46.583 47.124 46.055 48757 54708 57111
BEE2436 43.592 39.075 49.288 20538 32022 21131
COMBINED 45.646 43.858 47.586 73782 94448 81268

Count: bee24_test-pedestrian Dets GT_Dets IDs GT_IDs
BEE2412 1132 1973 32 19
BEE2413 4218 6462 117 54
BEE2416 2163 3770 83 80
BEE2434 105868 103465 1391 1143
BEE2436 41669 52560 374 163
COMBINED 155050 168230 1997 1459

Timing analysis:
MotChallenge2DBox.get_raw_seq_data 1.0673 sec
MotChallenge2DBox.get_preprocessed_seq_data 1.0933 sec
HOTA.eval_sequence 2.2536 sec
CLEAR.eval_sequence 0.2317 sec
Identity.eval_sequence 1.6158 sec
Count.eval_sequence 0.0000 sec
eval_sequence 6.2798 sec
Evaluator.evaluate 6.6412 sec

Eval Config:
USE_PARALLEL : False
NUM_PARALLEL_CORES : 8
BREAK_ON_ERROR : True
RETURN_ON_ERROR : False
LOG_ON_ERROR : /home/a607/shg/TOPICTrack-main(1)/TOPICTrack-main/external/TrackEval/error_log.txt
PRINT_RESULTS : True
PRINT_ONLY_COMBINED : False
PRINT_CONFIG : True
TIME_PROGRESS : True
DISPLAY_LESS_PROGRESS : False
OUTPUT_SUMMARY : True
OUTPUT_EMPTY_CLASSES : True
OUTPUT_DETAILED : True
PLOT_CURVES : True

MotChallenge2DBox Config:
PRINT_CONFIG : True
GT_FOLDER : results/gt/
TRACKERS_FOLDER : results/trackers/
OUTPUT_FOLDER : None
TRACKERS_TO_EVAL : ['bee24_test_post']
CLASSES_TO_EVAL : ['pedestrian']
BENCHMARK : BEE24
SPLIT_TO_EVAL : val
INPUT_AS_ZIP : False
DO_PREPROC : True
TRACKER_SUB_FOLDER : data
OUTPUT_SUB_FOLDER :
TRACKER_DISPLAY_NAMES : None
SEQMAP_FOLDER : None
SEQMAP_FILE : None
SEQ_INFO : None
GT_LOC_FORMAT : {gt_folder}/{seq}/gt/gt.txt
SKIP_SPLIT_FOL : False

CLEAR Config:
METRICS : ['HOTA', 'Identity', 'CLEAR']
THRESHOLD : 0.5
PRINT_CONFIG : True

Identity Config:
METRICS : ['HOTA', 'Identity', 'CLEAR']
THRESHOLD : 0.5
PRINT_CONFIG : True

Evaluating 1 tracker(s) on 5 sequence(s) for 1 class(es) on MotChallenge2DBox dataset using the following metrics: HOTA, CLEAR, Identity, Count

Evaluating bee24_test_post

MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2412)           0.0113 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian)                0.0249 sec
HOTA.eval_sequence()                                                   0.0438 sec
CLEAR.eval_sequence()                                                  0.0047 sec
Identity.eval_sequence()                                               0.0018 sec
Count.eval_sequence()                                                  0.0000 sec

1 eval_sequence(BEE2412, bee24_test_post) 0.0869 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2413) 0.0317 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0281 sec
HOTA.eval_sequence() 0.0532 sec
CLEAR.eval_sequence() 0.0066 sec
Identity.eval_sequence() 0.0032 sec
Count.eval_sequence() 0.0000 sec
2 eval_sequence(BEE2413, bee24_test_post) 0.1233 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2416) 0.0163 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0263 sec
HOTA.eval_sequence() 0.0481 sec
CLEAR.eval_sequence() 0.0054 sec
Identity.eval_sequence() 0.0027 sec
Count.eval_sequence() 0.0000 sec
3 eval_sequence(BEE2416, bee24_test_post) 0.0992 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2434) 0.6560 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.5315 sec
HOTA.eval_sequence() 1.2859 sec
CLEAR.eval_sequence() 0.1218 sec
Identity.eval_sequence() 1.6071 sec
Count.eval_sequence() 0.0000 sec
4 eval_sequence(BEE2434, bee24_test_post) 4.2116 sec
MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2436) 0.3995 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.4782 sec
HOTA.eval_sequence() 0.8527 sec
CLEAR.eval_sequence() 0.0967 sec
Identity.eval_sequence() 0.0587 sec
Count.eval_sequence() 0.0000 sec
5 eval_sequence(BEE2436, bee24_test_post) 1.8929 sec

All sequences for bee24_test_post finished in 6.41 seconds

HOTA: bee24_test_post-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0)
BEE2412 53.751 53.966 53.661 58.279 78.274 56.945 78.192 84.1 55.909 66.054 80.919 53.45
BEE2413 50.07 57.325 43.907 65.325 71.621 48.15 66.948 81.41 53.547 64.758 76.892 49.793
BEE2416 36.646 49.321 27.513 58.541 68.732 34.333 52.249 83.351 40.051 45.125 77.305 34.884
BEE2434 36.908 52.986 25.795 71.964 58.139 43.042 43.085 79.356 43.073 50.071 73.924 37.014
BEE2436 36.341 52.784 25.432 59.038 66.163 27.349 66.193 75.605 38.647 52.462 68.415 35.892
COMBINED 37.54 52.902 26.871 67.21 60.938 39.203 51.181 78.5 42.447 51.398 72.546 37.287

CLEAR: bee24_test_post-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
BEE2412 61.429 82.298 64.014 69.235 92.988 31.579 21.053 47.368 49.173 1366 607 103 51 6 4 9 51
BEE2413 65.057 78.869 69.39 80.3 88.039 31.481 42.593 25.926 48.089 5189 1273 705 280 17 23 14 242
BEE2416 42.546 82.092 50.902 68.037 79.882 12.5 60 27.5 30.362 2565 1205 646 315 10 48 22 243
BEE2434 57.38 76.06 59.652 91.716 74.096 64.129 29.659 6.2117 35.423 94894 8571 33175 2351 733 339 71 2393
BEE2436 70.902 70.665 71.914 80.573 90.296 6.135 72.393 21.472 47.266 42349 10211 4551 532 10 118 35 885
COMBINED 61.614 74.763 63.712 87.002 78.884 53.187 36.463 10.35 39.658 146363 21867 39180 3529 776 532 151 3814

Identity: bee24_test_post-pedestrianIDF1 IDR IDP IDTP IDFN IDFP
BEE2412 65.66 57.273 76.923 1130 843 339
BEE2413 60.602 57.939 63.522 3744 2718 2150
BEE2416 39.02 36.127 42.417 1362 2408 1849
BEE2434 46.743 52.301 42.253 54113 49352 73956
BEE2436 44.096 41.722 46.757 21929 30631 24971
COMBINED 46.515 48.908 44.344 82278 85952 103265

Count: bee24_test_post-pedestrian Dets GT_Dets IDs GT_IDs
BEE2412 1469 1973 32 19
BEE2413 5894 6462 117 54
BEE2416 3211 3770 83 80
BEE2434 128069 103465 1391 1143
BEE2436 46900 52560 374 163
COMBINED 185543 168230 1997 1459

Timing analysis:
MotChallenge2DBox.get_raw_seq_data 1.1148 sec
MotChallenge2DBox.get_preprocessed_seq_data 1.0890 sec
HOTA.eval_sequence 2.2838 sec
CLEAR.eval_sequence 0.2352 sec
Identity.eval_sequence 1.6735 sec
Count.eval_sequence 0.0000 sec
eval_sequence 6.4139 sec
Evaluator.evaluate 6.7589 sec
结果好差，请问你们的结果是啥样的

[hjhxy]

不仅是结果，我自己训练的bee24 Re-id模型运行验证代码都跑不起来，gmot也不行，作者提供的是可以正常运行的（但是效果非常差）

[hjhxy]

感谢你们提供的数据集和工作。在学习和复习的过程中我遇到了一些问题。

首先，为什么在数据集的test中的数据集是BEE24-12，BEE24-13，BEE24-16，BEE24-34，BEE24-36。而在result/gt中是12，13，16，18，20。

我将result/gt改为和test中的数据一致，并下载了bee24对应的两个pth文件进行复现，但只能达到hota 39.642，mota61.961，idf1 48.675。

我非常困惑，希望得到您的解答，谢谢！

请问你的BEE24 数据集运行测试和验证的代码是否有碰到报错呢？我一行代码没改，就BEE24这个数据集跑不了，一运行就报错。

[hjhxy]

val Config: USE_PARALLEL : False NUM_PARALLEL_CORES : 8 BREAK_ON_ERROR : True RETURN_ON_ERROR : False LOG_ON_ERROR : /home/a607/shg/TOPICTrack-main(1)/TOPICTrack-main/external/TrackEval/error_log.txt PRINT_RESULTS : True PRINT_ONLY_COMBINED : False PRINT_CONFIG : True TIME_PROGRESS : True DISPLAY_LESS_PROGRESS : False OUTPUT_SUMMARY : True OUTPUT_EMPTY_CLASSES : True OUTPUT_DETAILED : True PLOT_CURVES : True

MotChallenge2DBox Config: PRINT_CONFIG : True GT_FOLDER : results/gt/ TRACKERS_FOLDER : results/trackers/ OUTPUT_FOLDER : None TRACKERS_TO_EVAL : ['bee24_test'] CLASSES_TO_EVAL : ['pedestrian'] BENCHMARK : BEE24 SPLIT_TO_EVAL : val INPUT_AS_ZIP : False DO_PREPROC : True TRACKER_SUB_FOLDER : data OUTPUT_SUB_FOLDER : TRACKER_DISPLAY_NAMES : None SEQMAP_FOLDER : None SEQMAP_FILE : None SEQ_INFO : None GT_LOC_FORMAT : {gt_folder}/{seq}/gt/gt.txt SKIP_SPLIT_FOL : False

CLEAR Config: METRICS : ['HOTA', 'Identity', 'CLEAR'] THRESHOLD : 0.5 PRINT_CONFIG : True

Identity Config: METRICS : ['HOTA', 'Identity', 'CLEAR'] THRESHOLD : 0.5 PRINT_CONFIG : True

Evaluating 1 tracker(s) on 5 sequence(s) for 1 class(es) on MotChallenge2DBox dataset using the following metrics: HOTA, CLEAR, Identity, Count

Evaluating bee24_test

MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2412)                0.0181 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian)                0.0246 sec
HOTA.eval_sequence()                                                   0.0423 sec
CLEAR.eval_sequence()                                                  0.0047 sec
Identity.eval_sequence()                                               0.0018 sec
Count.eval_sequence()                                                  0.0000 sec

1 eval_sequence(BEE2412, bee24_test) 0.0918 sec MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2413) 0.0270 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0272 sec HOTA.eval_sequence() 0.0507 sec CLEAR.eval_sequence() 0.0060 sec Identity.eval_sequence() 0.0031 sec Count.eval_sequence() 0.0000 sec 2 eval_sequence(BEE2413, bee24_test) 0.1145 sec MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2416) 0.0215 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0258 sec HOTA.eval_sequence() 0.0464 sec CLEAR.eval_sequence() 0.0051 sec Identity.eval_sequence() 0.0027 sec Count.eval_sequence() 0.0000 sec 3 eval_sequence(BEE2416, bee24_test) 0.1020 sec MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2434) 0.6194 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.5290 sec HOTA.eval_sequence() 1.2749 sec CLEAR.eval_sequence() 0.1223 sec Identity.eval_sequence() 1.5514 sec Count.eval_sequence() 0.0000 sec 4 eval_sequence(BEE2434, bee24_test) 4.1066 sec MotChallenge2DBox.get_raw_seq_data(bee24_test, BEE2436) 0.3812 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.4867 sec HOTA.eval_sequence() 0.8393 sec CLEAR.eval_sequence() 0.0936 sec Identity.eval_sequence() 0.0569 sec Count.eval_sequence() 0.0000 sec 5 eval_sequence(BEE2436, bee24_test) 1.8648 sec

All sequences for bee24_test finished in 6.28 seconds

HOTA: bee24_test-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) BEE2412 41.728 46.762 37.414 48.097 83.829 39.035 76.183 84.585 42.382 50.149 82.162 41.203 BEE2413 39.47 50.518 30.969 52.437 80.334 32.976 64.237 82.115 40.284 49.445 78.869 38.996 BEE2416 29.708 45.673 19.422 47.482 82.758 22.646 51.622 84.523 30.339 35.527 81.408 28.922 BEE2434 36.582 54.875 24.473 66.523 65.013 37.764 44.887 79.606 40.335 49.243 74.453 36.663 BEE2436 34.725 50.717 24.138 54.714 69.014 25.641 67.197 75.851 36.25 49.55 69.244 34.311 COMBINED 36.138 53.131 24.766 61.65 66.89 34.216 52.447 78.746 39.037 49.107 73.226 35.959

CLEAR: bee24_test-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag BEE2412 50.684 82.712 56.868 57.121 99.558 5.2632 47.368 47.368 40.809 1127 846 5 122 1 9 9 136 BEE2413 53.962 79.486 63.293 64.284 98.483 9.2593 61.111 29.63 40.775 4154 2308 64 603 5 33 16 559 BEE2416 41.22 82.879 53.501 55.438 96.625 3.75 67.5 28.75 31.729 2090 1680 73 463 3 54 23 389 BEE2434 62.811 76.265 67.06 84.691 82.769 51.181 42.345 6.4742 42.709 87626 15839 18242 4397 585 484 74 4634 BEE2436 68.64 70.783 71.018 75.148 94.79 6.135 71.779 22.086 46.683 39498 13062 2171 1250 10 117 36 1703 COMBINED 63.666 74.911 67.729 79.947 86.743 41.398 47.772 10.829 43.608 134495 33735 20555 6835 604 697 158 7421

Identity: bee24_test-pedestrian IDF1 IDR IDP IDTP IDFN IDFP BEE2412 55.523 43.69 76.148 862 1111 270 BEE2413 50.393 41.643 63.798 2691 3771 1527 BEE2416 31.485 24.775 43.181 934 2836 1229 BEE2434 46.583 47.124 46.055 48757 54708 57111 BEE2436 43.592 39.075 49.288 20538 32022 21131 COMBINED 45.646 43.858 47.586 73782 94448 81268

Count: bee24_test-pedestrian Dets GT_Dets IDs GT_IDs BEE2412 1132 1973 32 19 BEE2413 4218 6462 117 54 BEE2416 2163 3770 83 80 BEE2434 105868 103465 1391 1143 BEE2436 41669 52560 374 163 COMBINED 155050 168230 1997 1459

Timing analysis: MotChallenge2DBox.get_raw_seq_data 1.0673 sec MotChallenge2DBox.get_preprocessed_seq_data 1.0933 sec HOTA.eval_sequence 2.2536 sec CLEAR.eval_sequence 0.2317 sec Identity.eval_sequence 1.6158 sec Count.eval_sequence 0.0000 sec eval_sequence 6.2798 sec Evaluator.evaluate 6.6412 sec

Eval Config: USE_PARALLEL : False NUM_PARALLEL_CORES : 8 BREAK_ON_ERROR : True RETURN_ON_ERROR : False LOG_ON_ERROR : /home/a607/shg/TOPICTrack-main(1)/TOPICTrack-main/external/TrackEval/error_log.txt PRINT_RESULTS : True PRINT_ONLY_COMBINED : False PRINT_CONFIG : True TIME_PROGRESS : True DISPLAY_LESS_PROGRESS : False OUTPUT_SUMMARY : True OUTPUT_EMPTY_CLASSES : True OUTPUT_DETAILED : True PLOT_CURVES : True

MotChallenge2DBox Config: PRINT_CONFIG : True GT_FOLDER : results/gt/ TRACKERS_FOLDER : results/trackers/ OUTPUT_FOLDER : None TRACKERS_TO_EVAL : ['bee24_test_post'] CLASSES_TO_EVAL : ['pedestrian'] BENCHMARK : BEE24 SPLIT_TO_EVAL : val INPUT_AS_ZIP : False DO_PREPROC : True TRACKER_SUB_FOLDER : data OUTPUT_SUB_FOLDER : TRACKER_DISPLAY_NAMES : None SEQMAP_FOLDER : None SEQMAP_FILE : None SEQ_INFO : None GT_LOC_FORMAT : {gt_folder}/{seq}/gt/gt.txt SKIP_SPLIT_FOL : False

CLEAR Config: METRICS : ['HOTA', 'Identity', 'CLEAR'] THRESHOLD : 0.5 PRINT_CONFIG : True

Identity Config: METRICS : ['HOTA', 'Identity', 'CLEAR'] THRESHOLD : 0.5 PRINT_CONFIG : True

Evaluating 1 tracker(s) on 5 sequence(s) for 1 class(es) on MotChallenge2DBox dataset using the following metrics: HOTA, CLEAR, Identity, Count

Evaluating bee24_test_post

MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2412)           0.0113 sec
MotChallenge2DBox.get_preprocessed_seq_data(pedestrian)                0.0249 sec
HOTA.eval_sequence()                                                   0.0438 sec
CLEAR.eval_sequence()                                                  0.0047 sec
Identity.eval_sequence()                                               0.0018 sec
Count.eval_sequence()                                                  0.0000 sec

1 eval_sequence(BEE2412, bee24_test_post) 0.0869 sec MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2413) 0.0317 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0281 sec HOTA.eval_sequence() 0.0532 sec CLEAR.eval_sequence() 0.0066 sec Identity.eval_sequence() 0.0032 sec Count.eval_sequence() 0.0000 sec 2 eval_sequence(BEE2413, bee24_test_post) 0.1233 sec MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2416) 0.0163 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.0263 sec HOTA.eval_sequence() 0.0481 sec CLEAR.eval_sequence() 0.0054 sec Identity.eval_sequence() 0.0027 sec Count.eval_sequence() 0.0000 sec 3 eval_sequence(BEE2416, bee24_test_post) 0.0992 sec MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2434) 0.6560 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.5315 sec HOTA.eval_sequence() 1.2859 sec CLEAR.eval_sequence() 0.1218 sec Identity.eval_sequence() 1.6071 sec Count.eval_sequence() 0.0000 sec 4 eval_sequence(BEE2434, bee24_test_post) 4.2116 sec MotChallenge2DBox.get_raw_seq_data(bee24_test_post, BEE2436) 0.3995 sec MotChallenge2DBox.get_preprocessed_seq_data(pedestrian) 0.4782 sec HOTA.eval_sequence() 0.8527 sec CLEAR.eval_sequence() 0.0967 sec Identity.eval_sequence() 0.0587 sec Count.eval_sequence() 0.0000 sec 5 eval_sequence(BEE2436, bee24_test_post) 1.8929 sec

All sequences for bee24_test_post finished in 6.41 seconds

HOTA: bee24_test_post-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA RHOTA HOTA(0) LocA(0) HOTALocA(0) BEE2412 53.751 53.966 53.661 58.279 78.274 56.945 78.192 84.1 55.909 66.054 80.919 53.45 BEE2413 50.07 57.325 43.907 65.325 71.621 48.15 66.948 81.41 53.547 64.758 76.892 49.793 BEE2416 36.646 49.321 27.513 58.541 68.732 34.333 52.249 83.351 40.051 45.125 77.305 34.884 BEE2434 36.908 52.986 25.795 71.964 58.139 43.042 43.085 79.356 43.073 50.071 73.924 37.014 BEE2436 36.341 52.784 25.432 59.038 66.163 27.349 66.193 75.605 38.647 52.462 68.415 35.892 COMBINED 37.54 52.902 26.871 67.21 60.938 39.203 51.181 78.5 42.447 51.398 72.546 37.287

CLEAR: bee24_test_post-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag BEE2412 61.429 82.298 64.014 69.235 92.988 31.579 21.053 47.368 49.173 1366 607 103 51 6 4 9 51 BEE2413 65.057 78.869 69.39 80.3 88.039 31.481 42.593 25.926 48.089 5189 1273 705 280 17 23 14 242 BEE2416 42.546 82.092 50.902 68.037 79.882 12.5 60 27.5 30.362 2565 1205 646 315 10 48 22 243 BEE2434 57.38 76.06 59.652 91.716 74.096 64.129 29.659 6.2117 35.423 94894 8571 33175 2351 733 339 71 2393 BEE2436 70.902 70.665 71.914 80.573 90.296 6.135 72.393 21.472 47.266 42349 10211 4551 532 10 118 35 885 COMBINED 61.614 74.763 63.712 87.002 78.884 53.187 36.463 10.35 39.658 146363 21867 39180 3529 776 532 151 3814

Identity: bee24_test_post-pedestrianIDF1 IDR IDP IDTP IDFN IDFP BEE2412 65.66 57.273 76.923 1130 843 339 BEE2413 60.602 57.939 63.522 3744 2718 2150 BEE2416 39.02 36.127 42.417 1362 2408 1849 BEE2434 46.743 52.301 42.253 54113 49352 73956 BEE2436 44.096 41.722 46.757 21929 30631 24971 COMBINED 46.515 48.908 44.344 82278 85952 103265

Count: bee24_test_post-pedestrian Dets GT_Dets IDs GT_IDs BEE2412 1469 1973 32 19 BEE2413 5894 6462 117 54 BEE2416 3211 3770 83 80 BEE2434 128069 103465 1391 1143 BEE2436 46900 52560 374 163 COMBINED 185543 168230 1997 1459

Timing analysis: MotChallenge2DBox.get_raw_seq_data 1.1148 sec MotChallenge2DBox.get_preprocessed_seq_data 1.0890 sec HOTA.eval_sequence 2.2838 sec CLEAR.eval_sequence 0.2352 sec Identity.eval_sequence 1.6735 sec Count.eval_sequence 0.0000 sec eval_sequence 6.4139 sec Evaluator.evaluate 6.7589 sec 结果好差，请问你们的结果是啥样的

我的和你的指标差不多（直接用作者提供的模型验证的话），不知道是否和楼上兄弟说的数据集有关，但是我认为可能关系不大，因为验证集就算给错了也不应该影响结果，反而如果混进去了训练集效果应该更好。
我尝试自己训练BEE24的Re-id模型，但是训练出来的模型一运行验证代码就报错！