26790 0 true 2008-12-05T13:46:36+13:00 26789 2009-05-20T00:00:00+12:00 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 1 14288 resolved browse bug correctness duplicates oai-record search xml zebra zoom 2009-03-09T12:26:34+13:00 26790 Kieran P James Kieran P http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2 ## Summary ## After a number of edits, a topic can end up appearing multiple times in search results. An example of this happening can be seen at http://kete.net.nz/site/all/topics/ right now. (You may need to view 10 or 20 results on a page to see the problem.) ## Possible causes ## Possible causes could be: * Invalid XML OAI record being generated and therefore not being being locate an existing zoom record for the item * A non-matching XML OAI recording being generated, leading to the same problem as mentioned above Possible indirect causes of these could be: * Race conditions in zoom related code in Kete * A bug in XML OAI generating code that leads to invalid/inconsistent XML generation * Another known code issue ## Possible Solutions ## * Locate and fix bugs in OAI XML generation or zoom interface code * Update Zebra to a version which allows exact matching of individual records by OAI Identifier, rather than entire record ## Summary ## After a number of edits, a topic can end up appearing multiple times in search results. An example of this happening can be seen at http://kete.net.nz/site/all/topics/ right now. (You may need to view 10 or 20 results on a page to see the problem.) ## Possible causes ## Possible causes could be: * Invalid XML OAI record being generated and therefore not being being locate an existing zoom record for the item * A non-matching XML OAI recording being generated, leading to the same problem as mentioned above Possible indirect causes of these could be: * Race conditions in zoom related code in Kete * A bug in XML OAI generating code that leads to invalid/inconsistent XML generation * Another known code issue ## Possible Solutions ## * Locate and fix bugs in OAI XML generation or zoom interface code * Update Zebra to a version which allows exact matching of individual records by OAI Identifier, rather than entire record <div><h2>Summary</h2> <p>After a number of edits, a topic can end up appearing multiple times in search results.</p> <p>An example of this happening can be seen at <a href="http://kete.net.nz/site/all/topics/">http://kete.net.nz/site/all/topics/</a> right now. (You may need to view 10 or 20 results on a page to see the problem.)</p> <h2>Possible causes</h2> <p>Possible causes could be:</p> <ul> <li>Invalid XML OAI record being generated and therefore not being being locate an existing zoom record for the item</li> <li>A non-matching XML OAI recording being generated, leading to the same problem as mentioned above</li> </ul> <p>Possible indirect causes of these could be: * Race conditions in zoom related code in Kete * A bug in XML OAI generating code that leads to invalid/inconsistent XML generation * Another known code issue</p> <h2>Possible Solutions</h2> <ul> <li>Locate and fix bugs in OAI XML generation or zoom interface code</li> <li>Update Zebra to a version which allows exact matching of individual records by OAI Identifier, rather than entire record</li> </ul></div> 26298 0 ## Summary ## After a number of edits, a topic can end up appearing multiple times in search results. An example of this happening can be seen at http://kete.net.nz/site/all/topics/ right now. (You may need to view 10 or 20 results on a page to see the problem.) ## Possible causes ## Possible causes could be: * Invalid XML OAI record being generated and therefore not being being locate an existing zoom record for the item * A non-matching XML OAI recording being generated, leading to the same problem as mentioned above Possible indirect causes of these could be: * Race conditions in zoom related code in Kete * A bug in XML OAI generating code that leads to invalid/inconsistent XML generation * Another known code issue ## Possible Solutions ## * Locate and fix bugs in OAI XML generation or zoom interface code * Update Zebra to a version which allows exact matching of individual records by OAI Identifier, rather than entire record <div><h2>Summary</h2> <p>After a number of edits, a topic can end up appearing multiple times in search results.</p> <p>An example of this happening can be seen at <a href="http://kete.net.nz/site/all/topics/">http://kete.net.nz/site/all/topics/</a> right now. (You may need to view 10 or 20 results on a page to see the problem.)</p> <h2>Possible causes</h2> <p>Possible causes could be:</p> <ul> <li>Invalid XML OAI record being generated and therefore not being being locate an existing zoom record for the item</li> <li>A non-matching XML OAI recording being generated, leading to the same problem as mentioned above</li> </ul> <p>Possible indirect causes of these could be:</p> <ul> <li>Race conditions in zoom related code in Kete</li> <li>A bug in XML OAI generating code that leads to invalid/inconsistent XML generation</li> <li>Another known code issue</li> </ul> <h2>Possible Solutions</h2> <ul> <li>Locate and fix bugs in OAI XML generation or zoom interface code</li> <li>Update Zebra to a version which allows exact matching of individual records by OAI Identifier, rather than entire record</li> </ul></div> false 2008-12-05T13:46:36+13:00 26789 --- {} 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 0 14288 new browse bug correctness oai-record search xml zebra zoom 2008-12-05T13:46:48+13:00 26789 James James Kete http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2 26298 0 I noticed that a topic on Kete net (enhancement topic) had duplicate records after * related topic was added * and then that related topic had comment added <div><p>I noticed that a topic on Kete net (enhancement topic) had duplicate records after</p> <ul> <li> <p>related topic was added</p> </li> <li> <p>and then that related topic had comment added</p> </li> </ul></div> false 2008-12-17T15:07:14+13:00 26789 --- {} 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 0 14288 new browse bug correctness oai-record search xml zebra zoom 2008-12-17T15:07:24+13:00 26790 Kieran P James Kete http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2 26789 0 false 2008-12-17T15:16:24+13:00 26789 --- :assigned_user: 26298 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 0 14288 new browse bug correctness oai-record search xml zebra zoom 2008-12-17T15:16:28+13:00 26789 James James James http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2 26789 0 Re. Kieran's comment (see above): > I noticed that a topic on Kete net (enhancement topic) had duplicate records after > * related topic was added > * and then that related topic had comment added I have investigated this specifically and unfortunately could not find any correlation between this taking place and search result duplication. --- During testing I did find an issue with moderation which has subsequently been fixed which would have contributed to search result duplication when full moderation was turned on or possibly if moderation was actively in use. See http://github.com/kete/kete/commit/6eaf5d1661f70f7f3039ed5a97d85a5da93420e8 for more details. One common pattern among topics that have duplicates is that they always have related topic(s) and it seems have a number of edits in both related topics by different parties in quick succession. This seems to point to some kind of race condition in the zoom record deletion and replacement routines relating to related topics. I think this should probably be next area of investigation. Cheers, James <div><p>Re. Kieran's comment (see above):</p> <blockquote> <p>I noticed that a topic on Kete net (enhancement topic) had duplicate records after * related topic was added * and then that related topic had comment added</p> </blockquote> <p>I have investigated this specifically and unfortunately could not find any correlation between this taking place and search result duplication.</p> <hr> <p>During testing I did find an issue with moderation which has subsequently been fixed which would have contributed to search result duplication when full moderation was turned on or possibly if moderation was actively in use. See <a href="http://github.com/kete/kete/commit/6eaf5d1661f70f7f3039ed5a97d85a5da93420e8"> http://github.com/kete/kete/comm...</a> for more details.</p> <p>One common pattern among topics that have duplicates is that they always have related topic(s) and it seems have a number of edits in both related topics by different parties in quick succession.</p> <p>This seems to point to some kind of race condition in the zoom record deletion and replacement routines relating to related topics.</p> <p>I think this should probably be next area of investigation.</p> <p>Cheers,</p> <p>James</p></div> false 2009-01-12T15:25:13+13:00 26789 --- :state: new :tag: browse bug correctness oai-record search xml zebra zoom 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 0 14288 open browse bug correctness duplicates oai-record search xml zebra zoom 2009-01-12T15:25:16+13:00 26789 James James James http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2 26790 0 false 2009-02-10T13:11:32+13:00 26789 --- :assigned_user: 26789 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 0 14288 open browse bug correctness duplicates oai-record search xml zebra zoom 2009-02-10T13:11:33+13:00 26790 Kieran P James Kieran P http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2 26790 0 No further duplicate search results have shown up in a while. The integration tests can't find any issues with the most common use cases. If the problem happens again, we can open this ticket. For now, I'd call it resolved (and marking ticket as such). <div><p>No further duplicate search results have shown up in a while. The integration tests can't find any issues with the most common use cases. If the problem happens again, we can open this ticket. For now, I'd call it resolved (and marking ticket as such).</p></div> true 2009-03-09T12:26:31+13:00 26789 --- :state: open 18592 126 duplicate-searchbrowse-topic-results-after-multiple-edits 0 14288 resolved browse bug correctness duplicates oai-record search xml zebra zoom 2009-03-09T12:26:34+13:00 26790 Kieran P James Kieran P http://kete.lighthouseapp.com/projects/14288/tickets/126 1.2