Todd Benson
5/14/2008 9:32:00 PM
On Wed, May 14, 2008 at 2:50 PM, Robert Klemme
<shortcutter@googlemail.com> wrote:
> On 14.05.2008 13:29, James Dechiaro wrote:
>>
>> Thanks for the tip Robert I will give it a go...as the script has been
>> running for over 14 hours now after finding 13k matches =(
>
> Yet another approach would be to use a relational database for this. If the
> volume is large it may pay off to import your CSV data into two tables,
> create appropriate indexes and get your result via a SELECT.
I agree that a large dataset like this probably doesn't belong in the
high-level programming domain. Put the burden where it belongs.
For this type of data, the model would be simple in a database, as
would be the queries.
2c,
Todd