Goal: Setup indexing for xml.apache.org lists
More streamlined order of operations than previous task lists.
Status:
- On nagoya as qmlist user
- Make new mbox archive area(s)
{{{DONE mkdir -p /opt/ezmlm/archive/xml.apache.org/xmlbeans-cvs ["DONE"] mkdir -p /opt/ezmlm/archive/xml.apache.org/xmlbeans-dev ["DONE"] mkdir -p /opt/ezmlm/archive/xml.apache.org/xmlbeans-user }}}
- Subscribe lists (on daedalus)
{{{DONE ezmlm-sub /home/apmail/lists/xml.apache.org/xmlbeans-cvs/ qmlist-xml-archive-xmlbeans-cvs@nagoya.apache.org ["DONE"] ezmlm-sub /home/apmail/lists/xml.apache.org/xmlbeans-dev/ qmlist-xml-archive-xmlbeans-dev@nagoya.apache.org ["DONE"] ezmlm-sub /home/apmail/lists/xml.apache.org/xmlbeans-user/ qmlist-xml-archive-xmlbeans-user@nagoya.apache.org }}}
- On nagoya as qmlist user
- Copy over initial mbox file(s):
daedalus:/www/tlpxml.apache.org/mail/list has the mbox files in compressed format. They need to be uncompressed before running eyebrowse.
- Copy over initial mbox file(s):
{{{DONE cd /opt/ezmlm/archive/xml.apache.org/xmlbeans-cvs ["DONE"] wget xml.apache.org/mail/xmlbeans-cvs/200307.gz ["DONE"] wget xml.apache.org/mail/xmlbeans-cvs/200308 ["DONE"] gunzip *.gz }}}
{{{DONE cd /opt/ezmlm/archive/xml.apache.org/xmlbeans-dev ["DONE"] wget xml.apache.org/mail/xmlbeans-dev/200307.gz ["DONE"] wget xml.apache.org/mail/xmlbeans-dev/200308 ["DONE"] gunzip *.gz }}}
{{{DONE cd /opt/ezmlm/archive/xml.apache.org/xmlbeans-user ["DONE"] wget xml.apache.org/mail/xmlbeans-user/200307.gz ["DONE"] wget xml.apache.org/mail/xmlbeans-user/200308 ["DONE"] gunzip *.gz }}}
Verify contents of current month. Refetch if necessary.
- On nagoya as regular user
- Register new lists
{{{ export WEB_APP_DIR='/opt/tomcat/webapps/eyebrowse'
- export EYEBROWSE="${WEB_APP_DIR}/WEB-INF/bin/eyebrowse --props=${WEB_APP_DIR}/WEB-INF/classes/eyebrowse.properties"
["DONE"] ${EYEBROWSE} --command=addlist --listname='xmlbeans-cvs@xml.apache.org' --descr='Apache XML Beans CVS records' --indexdir="${WEB_APP_DIR}/index/xml.apache.org/xmlbeans-cvs" ["DONE"] ${EYEBROWSE} --command=addlist --listname='xmlbeans-dev@xml.apache.org' --descr='Apache XML Beans Development' --indexdir="${WEB_APP_DIR}/index/xml.apache.org/xmlbeans-dev" ["DONE"] ${EYEBROWSE} --command=addlist --listname='xmlbeans-user@xml.apache.org' --descr='Apache XML Beans Users' --indexdir="${WEB_APP_DIR}/index/xml.apache.org/xmlbeans-user" }}}
- Add initial mbox file(s) to the database, update the database and Lucene indices:
- ~noel/update-list implements addlistfile, updatelist, and updateindex in order
{{{DONE find "${WEB_APP_DIR}/archive/xml.apache.org/xmlbeans-cvs/" -type f | sort | xargs -n 1 -I {} ~noel/update-list 'xmlbeans-cvs@xml.apache.org' {} ["DONE"] find "${WEB_APP_DIR}/archive/xml.apache.org/xmlbeans-dev/" -type f | sort | xargs -n 1 -I {} ~noel/update-list 'xmlbeans-dev@xml.apache.org' {} ["DONE"] find "${WEB_APP_DIR}/archive/xml.apache.org/xmlbeans-user/" -type f | sort | xargs -n 1 -I {} ~noel/update-list 'xmlbeans-user@xml.apache.org' {} }}}