Usually one can sense a gathering of power, a surge before the spell is cast. But, then we are still assuming what the Castle is doing is magic at all... but I cannot think what else it might be if not that.