But empiricism and rationalism aren't the same thing, for example, mathematics is not empiricist, it is actually rationalist; it often uses a priori reasoning, and that often, and i'm sure the physicists here can agree with me, the mathematic method is never wrong or practically never wrong, you are, same is true in deductive reasoning where your method of reasoning can be perfect and therefore your conclusion is correct, but only in so far as the principle you propose is true, which is where empiricism comes in to make sure the principle is true, even though the method itself can be flawed via bias. Same goes for the mind, social structures, and even time itself is a priori. In reality though, you would need rationalism and empiricism to really have reliable information, so while you are correct there, they aren't necessarily joined at the hip, and at times they can't be because there is simply no way to prove it via physical means.
Which is why i'm shocked that, Neosutra, being a physicist would reject arguments that aren't empirical. Since many parts of physics are theoretical. A physicist should know better than to say something can't exist because it can't be observed.