jmg3000
9/27/2006 1:06:00 AM
On 9/26/06, anne001 <anne@wjh.harvard.edu> wrote:
> Hi
>
> I work in a psychology lab which used to test subjects one on one. A
> subject would be tested on 1 to 20 tests each generating a summary
> value or text data file. Now in addition, we are getting thousands of
> responses on single or multiple tests from folks on the web in multiple
> websites. We can't possibly copy/paste that volume of data into an
> excel file. So we need to automate.
>
> One thought is to have a centralized depository with both data and data
> format so folks can analyse the data easily. Plus a way of filtering
> the data: for example extract data from subjects matched on some
> criteria... So I think that means a database.
Yup.
> Because the high volume data is accumulated on the web and can be sent
> by email, that suggests a webapplication. ruby on rails can probably do
> something like that.
Well, you mention "multiple websites", as if the data is already being
generated and you need to pick it up and do something with it.
Correct?
In that case, you may not need a webapp per se, since (it sounds like)
the webapps are already in place. If they're already sending you
auto-generated emails, then you're set: you just need to hack together
a script to periodically scan the relevant inbox, pull out those
messages, parse them for the data, and insert that data into your db.
Then you'll probably use a 2nd program to mine that data and do
something useful with it.
> Is this something a programmer with a little ruby and rails can design,
> or should we consult with some folks to figure out what the
> format/system should look like, and if so what kind of folks would be
> able to advise us? (folks knowing ruby or rails of course)
I like Philip's suggestion about finding a CS student or two to do it.
Just post a note on the bulletin board in the CS department and you
should get some help that way.
---John