Sounds like a bad place to be in. I have had issues with latency and CDJ(like) players. It would play nice for a while (varying lenghts of time) and then start to distort horribly. They have also stopped playing the mids of sets. I cranked up the latency some and the problems went away, so that is worth checking out. Don’t be shy, start with doubling the time in ms and see what happens. If that solves the problem, you can start lowering the latency again in smaller steps until the problem recurrs.
Obviously you’ll need all the latest drivers, DJ software versions and firmware, but that goes without saying.