First thing, are these portables from portableapps.com ? There are others - samj for example.
Next, until comparatively recently GimpPortable was 32 bit and there were very few gimp_gmic_qt 32 bit plugins. see:
https://gmic.eu/files/windows/32bits_(old)/ (stupid underscore use
https://tinyurl.com/5n76szz3 ) and get the zip. For the last portable 2.10.38 there are problems with file versions. I went back to version 3.4.0 from
https://gmic.eu/files/windows/ Work you way through versions if you want.
GIMPPortable for some reason does not make a full user profile for plug-ins ...Data\.gimp\plug-ins and it is better to get the gimp_gmic zip version and just add to the portable version. How robust to moving about from computer-to-computer this is, I do not know. Win11 screenshots.
Attachment:
01-gmic.jpg [ 61.5 KiB | Viewed 2986 times ]
Then you need to add the path in Edit -> Preferences -> Files -> Plug-ins
Attachment:
02-gmic.jpg [ 94.2 KiB | Viewed 2986 times ]
...and that is working, at least it is here

Attachment:
03-gmic.jpg [ 77.44 KiB | Viewed 2986 times ]
best of luck with old stuff.