如果您无法下载资料，请参考说明：
1、部分资料下载需要金币，请确保您的账户上有足够的金币
2、已购买过的文档，再次下载不重复扣费
3、资料包下载后请先用软件解压，在使用对应软件打开
Lecture2EvaluationinDocumentRetrieval文档检索系统评价ReviewEvaluationindocumentretrieval:outlineHistoryTRECConferenceTRECConference(Cont’d)TRECgeneralformatTREC:prosandconsTypesofEvaluationEvaluationindocumentretrieval:outlineRelevanceTestCollectionsSampleTestCollectionsFindingRelevantDocumentsFindingrelevantdocuments(2)Evaluationindocumentretrieval:outlinePrecisionandRecallAnothercommonrepresentationPrecisionandRecallexampleAverageprecisionofaqueryPrecisionandRecallexample2Recall/precisiongraphsAveragingacrossqueriesAveraginggraphs:afalsestartInterpolationofgraphsPossibleinterpolationapproachesHowtochoose?Ourexample,interpolatedthiswayOurexample(Cont’d)Averaginggraphs:usinginterpolationInterpolationandaveragingInterpolatedaverageprecisionEvaluationindocumentretrieval:outlineMoreSingle-ValuedMeasuresSymmetricDifferenceandEFmeasureFmeasureasanaverageFmeasure,geometricinterpretationEvaluationindocumentretrieval:outlineOtherSingle-ValuedMeasuresExpectedSearchLengthExpectedSearchLengthExpectedSearchLengthEvaluationindocumentretrieval:outlineHomework1BackupWhysignificancetests?SignificanceTestsSignTestExampleEvaluationindocumentretrieval:outlineFeedbackEvaluationUserPerceptionsComputationalAspectsEvaluationProblemsSwets’criteria
