Add a recordset to the page that is filtered by the inserted email field.
Then use sever validation to validate that the number of rows in that recordset is equal to zero.
You will have to manually move the recordset above the validation toolkit code for it to work properly.