[TR-119] Temporary jar/properties in HDFS /tmp are not deleted Created: 13/May/10  Updated: 24/May/10  Resolved: 24/May/10

Status: Resolved
Project: Terrier Core
Component/s: .utility
Affects Version/s: 2.2, 2.2.1, 3.0
Fix Version/s: 3.5

Type: Improvement Priority: Minor
Reporter: Craig Macdonald Assignee: Craig Macdonald
Resolution: Fixed  
Labels: None

Attachments: File TR-119.final.patch    

 Description   
We rely on Hadoop's FileSystem.deleteOnExit() method to delete temporary jar/property files that are uploaded to HDFS /tmp folder. However, this doesn't seem to ever work.

We should instead add a HadoopUtility.finishTerrierJob(JobConf) to do the opposite of HadoopUtility.finishTerrierJob();

 Comments   
Comment by Craig Macdonald [ 24/May/10 ]

Final patch for this issue. HadoopUtility.finishTerrierJob(JobConf) should be called after each MR job has finished.

Comment by Craig Macdonald [ 24/May/10 ]

This has been committed to trunk.

Generated at Sat Dec 16 20:34:34 GMT 2017 using JIRA 7.1.1#71004-sha1:d6b2c0d9b7051e9fb5e4eb8ce177ca56d91d7bd8.