ES Search

ES Search is a search engine that searches various Morrowind and Oblivion mod sites.

Version 1 grew from a small PHP script using a MySQL database and became progressively larger until it became impossible to maintain. It also kept running into issues with the amount of load it was putting on the server. (So my account kept getting shutdown)

Version 2 was a total rewrite, designed from scratch to be faster. It still used PHP and MySQL but for the searching it used a PHP port of Lucene found in the Zend Framework.
For the most part pages are parsed using the Simple HTML DOM library. There is one specific case where the 1mb of HTML caused the script to run out of memory so regex was used.
The code is also designed in such a way that would allow for the searching to be preformed on another server if required without any major alteration to the original code.

Version 2.5 is the result of a code review of version 2, along with various bug fixes. The most major one changing the relationship of Mods to URLs from 'many to many' to 'one to many', as the many to many relationship didn't cope with mods names being changed. Also in the works is improved error checking as well as improvements to the general design to make it more robust.