Mailing List Archive: Lucene: Java-Dev

[jira] [Commented] (LUCENE-3910) remove special hudson nightly linedocs

Index | Next | Previous | View Threaded

jira at apache

May 4, 2012, 3:44 AM

Post #1 of 4 (67 views)
Permalink

[jira] [Commented] (LUCENE-3910) remove special hudson nightly linedocs

[ https://issues.apache.org/jira/browse/LUCENE-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268252#comment-13268252 ]

Robert Muir commented on LUCENE-3910:
-------------------------------------

If we are going to keep this large file, local reproducibility needs to be made easier.

Currently, if something fails in the nightly build, nobody fixes it because of this problem:
I know i wont go wasting my time with tests that dont reproduce!

If we arent going to do this we should disable the linedocs (I will do this in 72 hours,
if the situation isnt improved)

There is absolutely no point of finding test fails that no one will debug because its too hard.

> remove special hudson nightly linedocs
> --------------------------------------
>
> Key: LUCENE-3910
> URL: https://issues.apache.org/jira/browse/LUCENE-3910
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Fix For: 4.1
>
>
> Hudson has a special huge linedocs file that it sets via a -D parameter,
> but this means that anything using LineDocs won't reproduce via our home
> computers if it fails on hudson.
> I think we should disable this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe [at] lucene
For additional commands, e-mail: dev-help [at] lucene

jira at apache

May 4, 2012, 5:38 AM

Post #2 of 4 (59 views)
Permalink

[jira] [Commented] (LUCENE-3910) remove special hudson nightly linedocs [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268297#comment-13268297 ]

Michael McCandless commented on LUCENE-3910:
--------------------------------------------

bq. If we are going to keep this large file, local reproducibility needs to be made easier.

+1

I think, first, we should add -Dtests.linedocsfile=XXX to the "reproduce line", when that was passed to 'ant test'.

Second, I think we should put the nightly line file somewhere "accessible". It's currently at http://people.apache.org/~mikemccand/enwiki.random.lines.txt ...

Maybe we can have an ant target, or ivy, to pull down a copy to your local area? I also like Dawid's idea to have a separate "big test data" repository somewhere...

> remove special hudson nightly linedocs
> --------------------------------------
>
> Key: LUCENE-3910
> URL: https://issues.apache.org/jira/browse/LUCENE-3910
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Fix For: 4.1
>
>
> Hudson has a special huge linedocs file that it sets via a -D parameter,
> but this means that anything using LineDocs won't reproduce via our home
> computers if it fails on hudson.
> I think we should disable this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe [at] lucene
For additional commands, e-mail: dev-help [at] lucene

jira at apache

May 4, 2012, 5:50 AM

Post #3 of 4 (59 views)
Permalink

[jira] [Commented] (LUCENE-3910) remove special hudson nightly linedocs [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268305#comment-13268305 ]

Robert Muir commented on LUCENE-3910:
-------------------------------------

{quote}
I also like Dawid's idea to have a separate "big test data" repository somewhere...
{quote}

+1 for some better separation here. Source release and svn checkouts are bloated because of
all this test data.
E.g. linefile data is over 5MB, snowball test data is over 3MB, ...

Maybe we should separate this out in svn? its "artifact" is a .jar file
with all these huge files in the appropriate places or something?

So basically we could sucker this thing down with ivy and put it in the classpath like
any other dependency.

The problems that make it hard though, are versioning and "releasing" this thing:
* if its outside of dev/ SVN that makes versioning the testdata wrt different releases/branches hard.
this could easily get annoying and complicated.
* where would we put the resulting "jar" to download via ivy? I dont think we should be downloading
this from SVN, since our source releases would actually have this as a test dependency.

> remove special hudson nightly linedocs
> --------------------------------------
>
> Key: LUCENE-3910
> URL: https://issues.apache.org/jira/browse/LUCENE-3910
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Fix For: 4.1
>
>
> Hudson has a special huge linedocs file that it sets via a -D parameter,
> but this means that anything using LineDocs won't reproduce via our home
> computers if it fails on hudson.
> I think we should disable this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe [at] lucene
For additional commands, e-mail: dev-help [at] lucene

jira at apache

May 4, 2012, 12:38 PM

Post #4 of 4 (57 views)
Permalink

[jira] [Commented] (LUCENE-3910) remove special hudson nightly linedocs [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268659#comment-13268659 ]

Michael McCandless commented on LUCENE-3910:
--------------------------------------------

Maybe as a baby step (before we figure out how to hold/release test data in a separate repository)... we can add ant/ivy sugar to pull down the nightly line docs file from p.a.o?

We can then eg improve the patch I put up to give instructions to run that...

> remove special hudson nightly linedocs
> --------------------------------------
>
> Key: LUCENE-3910
> URL: https://issues.apache.org/jira/browse/LUCENE-3910
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Fix For: 4.1
>
> Attachments: LUCENE-3910.patch
>
>
> Hudson has a special huge linedocs file that it sets via a -D parameter,
> but this means that anything using LineDocs won't reproduce via our home
> computers if it fails on hudson.
> I think we should disable this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe [at] lucene
For additional commands, e-mail: dev-help [at] lucene

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads