Changing grip mid-fight

Hi folks!



So I'm a few months into Judo by now, and one thing I've noticed is that whenever I try to swap grips mid fight, for whatever reason, I'm punished almost instantly for it - either by getting thrown or by being denied another grip.



Is this because I'm new and still relatively rubbish or have I accidentally discovered a golden rule of Judo?