Ticket #1616 (closed defect: fixed)

Opened 2 years ago

Last modified 2 years ago

Catch exceptions when rebuilding the search index

Reported by: amercader Owned by: amercader
Priority: major Milestone: ckan-sprint-2012-04-02
Component: ckan Keywords: search [a:1.5d]
Cc: Repository: ckan
Theme: none

Description

Right now if an exception is found while reindexing, the whole process stops and the remaining datasets are left out of the index. The process should continue after logging the exception. If more than a certain number of exceptions occur in a row, the process should stop.

Change History

comment:1 Changed 2 years ago by dread

Maybe we just need a '-f' option to force it to continue if an exception occurs? It's a manual process and it's good to know loud and clear if there is a an exception setting up a new server say, but have the option to force it if the system is down temporarily is a critical service.

comment:2 Changed 2 years ago by amercader

  • Milestone changed from ckan-sprint-2012-01-09 to ckan-v1.6

Sounds like a good option. I will move it to ckan-v1.6 anyway because it may need some work than the expected.

comment:3 Changed 2 years ago by amercader

  • Milestone changed from ckan-v1.7 to current-ckan-sprint-2012-04-02

comment:4 Changed 2 years ago by amercader

  • Keywords [a:1.5d] added
  • Status changed from new to closed
  • Resolution set to fixed

Fixed in 10cfd168413

Also new flags and fixes for other commands were added:

  • Add -o option to only reindex datasets not already indexed
  • Add -i option to ignore exceptions when rebuilding
  • Add -r option to just refresh the index (not clearing it first)
  • Fix show command to show the index stored for a dataset
  • Add support for clearing the index of just one dataset
Note: See TracTickets for help on using tickets.