Well I have no experience with Rekordbox, since it is very new. However it seems similar to Serato Video, with a few things still missing (which I guess they will release very soon).
However Serato Video: Very easy to use and maps nicely to any controller supporting it. I even tested with an old DDJ-Ergo and it got the job done. The whole experience is very intuitive, but it also has its limits when it comes to special effects etc.
VDJ is by far the most features for video, but no controller supports it. So basically you should be OK to learn a scripting language from their tutorials and get it to work. So it has a steep learning curve, but of course the possibilities are endless and I have seen things done with it that no other VJ has done. So it is by far the most feature packed software, but you need to custom tune it, if you do not have the abilities to do so it will stink in comparison to the others.
As for controller, honestly my favourite controller by far (no matter if video or music only) is currently the Denon MCX8000. Serato wise it outshines (for me) all Pioneer controllers, but of course this also depends on your workflow.