The volume in your ovaries will change, especially if that ovary is the one that's doing the ovulating that month. In one scan your left ovarian volume may be higher and during the next month it may decrease (sometimes going from 4.8ml volume up to 10.48 ml and then back again). If you are ovulating on the 1st scan from the left ovary, then from the right at say the second, then it will have been the right ovary's turn to increase in volume.
It's when the volume continues to increase and never goes back to normal that's a problem, and this could be any nuber of things including a yeast infection.
It is natural to worry, but you are doing the right thing by consulting the specialists, and I hope it all goes well for you.