Goal: Fix indexing for Jakarta lists not currently being properly indexed
Status:
DONE bsf-user
DONE bsf-dev
DONE commons-user
DONE commons-httpclient-dev
DONE tapestry-user
DONE tapestry-dev
DONE turbine-jcs-user
DONE turbine-jcs-dev
- On nagoya, as qmlist
- Copy over replacement mbox file(s):
{{{ *** daedalus:/www/tlp.apache.org/mail/list has the mbox files in compressed format. They need to be uncompressed before running eyebrowse.
["DONE"] for bsf-user ["DONE"] for bsf-dev ["DONE"] for tapestry-user ["DONE"] for turbine-jcs-user ["DONE"] for turbine-jcs-dev
- cd /opt/tomcat/webapps/eyebrowse/archive/jakarta.apache.org/bsf-user
["DONE"] wget jakarta.apache.org/mail/bsf-user/200303.gz ["DONE"] wget jakarta.apache.org/mail/bsf-user/200304.gz ["DONE"] wget jakarta.apache.org/mail/bsf-user/200305.gz ["DONE"] wget jakarta.apache.org/mail/bsf-user/200306.gz ["DONE"] wget jakarta.apache.org/mail/bsf-user/200307.gz ["DONE"] wget jakarta.apache.org/mail/bsf-user/200308.gz ["DONE"] wget jakarta.apache.org/mail/bsf-user/200309.gz ["DONE"] rm 200303 200304 200305 200306 200307 200308 200309 ["DONE"] gunzip *.gz }}}
- On nagoya as a regular user - delete the single indexed message in the May archive file
{{{DONE for bsf-user ["DONE"] for bsf-dev ["NOT DONE"] for tapestry-user - too many already indexed messages ["DONE"] for turbine-jcs-user ["NOT DONE"] for turbine-jcs-dev - indexed message
- SELECT @listid := listId FROM eb_List WHERE listName LIKE "bsf-user@jakarta%";
fileId = 2102 (select * from eb_ListFile where listId = @listid; and look for 200305) (using select * from eb_Message where listId = @listid and fileId = 2102); msgId = 706200 threadId = 348538
- * delete eb_Message entry
["DONE"] DELETE from eb_Message where listId = @listid and msgId = 706200;
* delete eb_MessageId entry
["DONE"] DELETE from eb_MessageId where listId = @listid and msgId = 706200;
- * delete eb_Thread entry
["DONE"] DELETE from eb_Thread where listId = @listid and threadId = 348538;
- On nagoya as regular user - re-index the files, one at a time
["DONE"] for bsf-user ["DONE"] for bsf-dev ["DONE"] for tapestry-user ["DONE"] for turbine-jcs-user ["DONE"] for turbine-jcs-dev
- SELECT @listid := listId FROM eb_List WHERE listName LIKE "bsf-user@jakarta%"; }}}
- Now update each file in turn
{{{DONE UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200309"; ["DONE"] UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200303"; ["DONE"] ~noel/force-list 'bsf-user@jakarta.apache.org' }}}
- There is no file entry in the database for April (even though the current archive file has messages)... so...
["DONE"] ~noel/update-list 'bsf-user@jakarta.apache.org' 200304
- Go back to re-indexing existing file names
{{{DONE UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200304"; ["DONE"] UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200305"; ["DONE"] ~noel/force-list 'bsf-user@jakarta.apache.org' ["DONE"] UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200305"; ["DONE"] UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200306"; ["DONE"] ~noel/force-list 'bsf-user@jakarta.apache.org' ["DONE"] UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200306"; ["DONE"] UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200307"; ["DONE"] ~noel/force-list 'bsf-user@jakarta.apache.org' ["DONE"] UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200307"; ["DONE"] UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200308"; ["DONE"] ~noel/force-list 'bsf-user@jakarta.apache.org' ["DONE"] UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200308"; ["DONE"] UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200309"; ["DONE"] ~noel/force-list 'bsf-user@jakarta.apache.org' }}}
Have apmail@apache.org subscribe qmlist-jakarta-archive-bsf-user@nagoya.apache.org to the bsf-user list. This will start adding data to September. NOTE: Eyebrowse should not add any new messages, as the last update-list will have left it with August as the active list.
- Synch the current month - only when apmail has subscribed list, and September is starting to work.
- Copy current month (on nagoya as qmlist, in the right directory)
wget jakarta.apache.org/mail/bsf-user/200310
- Index current month (on nagoya as regular user)
{{{ UPDATE eb_ListFile SET isActive = 0 WHERE listId = @listid and filePath like "%200309";
UPDATE eb_ListFile SET isActive = 1 WHERE listId = @listid and filePath like "%200310"; ~noel/force-list 'bsf-user@jakarta.apache.org' }}}
DONE Drink large scotch