PCSX2 freezes for few seconds at first start

[vsub]

Any idea if this can be solved somehow
I am using the folder memory card feature and I have two cards
Slot 1 - it is a copy of my 64MB card which have almost 200 saves
Slot 2 - it is a copy of my 8MB card which have 41 saves

When I run any game I can see that pcsx2 freezes right after showing the memory card folders
On Rogue Galaxy for example,pcsx2 is not responding for around 10 seconds before showing the game first screen

[CK1]

Is there anything specifically that's freezing like the UI or GS window? We have been investigating a similar issue recently.

[vsub]

The game window don't change any of the numbers and pcsx2 shows not responding if I try to click on it