Terrier Users :  Terrier Forum terrier.org
General discussion about using/developing applications using Terrier 
MRF Dependence Model
Posted by: arezki ()
Date: May 17, 2010 11:01AM

Hi All,


I would test Sequential Dependence MRF Model, I set terrier properties as :


matching.dsms=MRFDependenceScoreModifier
#choose SD or FD (sequential or full dependence)
proximity.dependency.type=SD
#size of window: 2 is an exact phrase, 10 is a larger window
#proximity.ngram.length=10
#weight of SD
proximity.w_o=1
#weight of FD
#proximity.w_u=1
#for MRF
#mu in the dirichlet formula.
mrf.mu=4000




I get this Error





INFO - 550 : how are the volcanoes made
INFO - Processing query: 550: 'how are the volcanoes made'
phrase term: volcano
phrase term: made
Error in org.terrier.matching.dsms.MRFDependenceScoreModifier java.lang.ArrayInd
exOutOfBoundsException: 949
java.lang.ArrayIndexOutOfBoundsException: 949
at org.terrier.utility.Distance.noTimesSameOrder(Distance.java:221)
at org.terrier.matching.dsms.DependenceScoreModifier.scoreFDSD(Dependenc
eScoreModifier.java:382)
at org.terrier.matching.dsms.DependenceScoreModifier.doDependency(Depend
enceScoreModifier.java:290)
at org.terrier.matching.dsms.DependenceScoreModifier.modifyScores(Depend
enceScoreModifier.java:170)
at org.terrier.matching.BaseMatching.finalise(BaseMatching.java:262)
at org.terrier.matching.taat.Full.match(Full.java:85)
at org.terrier.querying.Manager.runMatching(Manager.java:558)
at org.terrier.applications.TRECQuerying.processQuery(TRECQuerying.java:
671)
at org.terrier.applications.TRECQuerying.processQueryAndWrite(TRECQueryi
ng.java:607)
at org.terrier.applications.TRECQuerying.processQueries(TRECQuerying.jav
a:821)
at org.terrier.applications.TrecTerrier.run(TrecTerrier.java:402)
at org.terrier.applications.TrecTerrier.applyOptions(TrecTerrier.java:57
3)
at org.terrier.applications.TrecTerrier.main(TrecTerrier.java:237)
INFO - Time to process query: 0.36
INFO - Settings of Terrier written to C:\terrier-3.0\var\results/DirichletLM_mu2
500.0_8.res.settings
INFO - Finished topics, executed 50 queries in 20.109 seconds, results written t
o C:\terrier-3.0\var\results/DirichletLM_mu2500.0_8.res
Time elapsed: 23.922 seconds.




Thanks,

Arezki


Options: ReplyQuote
Re: MRF Dependence Model
Posted by: craigm ()
Date: May 17, 2010 12:53PM

Hi Arezki,

Two questions:
* Can you confirm that this is WT10G corpus?

* On line 220 in the Distance class, can you change documentLengthInTokens to numberOfNGrams and confirm that this fixes the problem?

Thanks

Craig

Options: ReplyQuote
Re: MRF Dependence Model
Posted by: craigm ()
Date: May 17, 2010 01:01PM

I'm tracking this on the issue tracker: [terrier.org]

Options: ReplyQuote
Re: MRF Dependence Model
Posted by: arezki ()
Date: May 17, 2010 02:48PM

Hi Craig,

could you send me "compile_package.bat" because I use windows version

and this file do not exist

Thanks
Arezki

Options: ReplyQuote
Re: MRF Dependence Model
Posted by: craigm ()
Date: May 17, 2010 02:50PM

You can compile Terrier using the ant build.xml file. See [terrier.org]

Craig

Options: ReplyQuote
Re: MRF Dependence Model
Posted by: arezki ()
Date: May 19, 2010 02:32PM

Hi Craig,

Thanks , it works

But when I set parameters (w_T ;w_O;w_U) = (0.85, 0.10, 0.05) for SD and length=10
as specified in Metzler Papers (optimal parameter)
I get AP = 0.2127 for WT10G collection

and when I set (w_T ;w_O;w_U) = (0.0, 1.0, 0.0) for SD and length=2
I get AP = 0.2244.

how can I find the optimal parameters.

Thanks


Options: ReplyQuote


Sorry, only registered users may post in this forum.
This forum powered by Phorum.