This was a very comprehensive evaluation with cross validation strategies!
Just wondering these problems were all integer based optimizations (TSP) and how MIP mixed integer programming stacks up?
I made a customizable optimization algorithm called kernelml (publicly available but the PSO backend is not open source yet) I would be more than happy to share it with someone with a deep understanding of optimization.
Also please feel free to add me on LinkedIn