Item11672: TOPICINFO or rcslite with mongo missing topics

Main concern is that newly registered topics don't show up in mongo queries. If I type the topic in the URL it goes there but it's not searchable from within Foswiki in any way. So the number of hits are less with mongo that default store settings. When I move/delete the txt,v files and reimport mongo all topics show in the query. But then I loose all history.

The only difference I can think of is the first line of META:TOPICINFO is different for some topics. That is also a concern because many topic show UnknownUser instead of LarsEik. Here are some examples of topicinfo:

%META:TOPICINFO{_authorWikiName="UnknownUser" author="BaseUserMapping_999" date="0" version="1"}%

%META:TOPICINFO{_authorWikiName="AdminUser" author="BaseUserMapping_333" date="1310385741" format="1.1" version="1"}%

%META:TOPICINFO{_authorWikiName="LarsEik" author="lek" date="1330607503" format="1.1" version="1"}%

%META:TOPICINFO{author="lek" date="1331800126" format="1.1" version="2"}%

From what I've seen touch'ing the ,v files could help. But it didn't. We use rcslite in configure. We use and have always used LdapContrib against AD.

How can I cleanup and reimport? I can do some bash/sed/awk/perl scripting and reimport or something like that. But I need help figuring out what to do...

I also imagine some kind of use of Foswiki::Support/Faq53 to updating? Depending of what need to be done.

UPDATE:

I notice that after deleting txt,v file and reimporting mongo from scratch one troubled topic now has the following in browser:

%META:TOPICINFO{_authorWikiName="UnknownUser" author="BaseUserMapping_999" date="0" version="1"}%
%META:TOPICINFO{_authorWikiName="LarsEik" author="lek" comment="" date="1330701101" format="1.1" reprev="8" version="9"}%

And of course the third line with TOPICINFO just shows as text in the topic. The fun part is that it is only in my fresh mongo, not in the txt file... This is the text file:

%META:TOPICINFO{_authorWikiName="LarsEik" author="lek" comment="" date="1330701101" format="1.1" reprev="8" version="9"}%

I set it to urgent assuming it's not only me

-- LarsEik - 19 Mar 2012

I will investigate shortly. Is this a new problem? What is the svn rev of core you're running? I assume you have the store listener configured with MongoDB's listener? FWIW this isn't happening on our production environment, but it's using a mangled checkout of trunk from November.

Can I assume that the steps to reproduce are:

• Create new topic, matching some SEARCH
• Revisit the SEARCH, and observe the topic to be missing
• Flick back to BruteForce/Forking search/query algos, and see that SEARCH includes it

I guess it's possible I broke something recently within MongoDBPlugin.

-- PaulHarvey - 21 Mar 2012

After a few tests it is clear that new topics as of today seem to be ok, but one Topic279 from 2012-01-31 is not (edit:among others). When I delete the Topic279.txt,v file and reimport mongo it shows ok. It's a small topic with only form data contents and has 4 revisions.

So something borks on the ,v files when importing.

When doing the mongo import with -recurse off -revision off it works.

-- LarsEik - 21 Mar 2012

What happend in rev=3 (see rev=2) on this topic here?? I submitted a comment without editing the whole page and all META info from my comments further up are at the bottom..should I have used literal?

Commenting is disabled while not logged in

%META:TOPICINFO{_authorWikiName="UnknownUser" author="BaseUserMapping_999" date="0" version="1"}% %META:TOPICINFO{_authorWikiName="AdminUser" author="BaseUserMapping_333" date="1310385741" format="1.1" version="1"}% %META:TOPICINFO{_authorWikiName="LarsEik" author="lek" date="1330607503" format="1.1" version="1"}% %META:TOPICINFO{author="lek" date="1331800126" format="1.1" version="2"}% %META:TOPICINFO{_authorWikiName="UnknownUser" author="BaseUserMapping_999" date="0" version="1"}% %META:TOPICINFO{_authorWikiName="LarsEik" author="lek" comment="" date="1330701101" format="1.1" reprev="8" version="9"}% %META:TOPICINFO{_authorWikiName="LarsEik" author="lek" comment="" date="1330701101" format="1.1" reprev="8" version="9"}%